6 min readDevelopmentFeatured
On-Device Inference with GGUF, MLX, and ONNX Runtime
A technical comparison of GGUF, MLX, and ONNX Runtime for running large language models directly on mobile and edge devices.
Part 4 · Small Models & Distillation All tags
Tag
Edge Ai
Read 2 articles on Edge Ai by Ashish Srivastava — practical guides covering implementation patterns, security, and production lessons.
2 posts
6 min readDevelopmentFeatured
Why Small Language Models Are Winning Real Workloads
Small language models are proving their worth in production by offering significant cost and latency advantages for specific tasks without sacrificing necessary accuracy.
Part 1 · Small Models & Distillation