Pieces for Developers featured on the Microsoft Open Source Blog, highlighting the partnership between ONNX Runtime (Microsoft) and Pieces.
We embed ML into all of our products to ensure full coverage of the developer workflow. Pieces needs to run these models from the desktop, terminal, integrated development environment, browser, and team communication channels. ONNX Runtime emerged as the clear winner for an on-device model serving platform that would provide Pieces with low latency, privacy, and performance, while still giving machine learning engineers the flexibility that cloud serving offers. ONNX Runtime offers a standardized model optimization pipeline, and Pieces has used ONNX Runtime's convert generation.py tool to implement a T5 transformer model for code description generation. ONNX Runtime gracefully meets both performance and state-of-the-art machine learning model needs.
SHARE
