Tag

Ml Ops

Read 2 articles on Ml Ops by Ashish Srivastava — practical guides covering implementation patterns, security, and production lessons.

2 posts

Oct 7, 20266 min readDevelopmentFeatured

Deploying a Quantized Model End to End

Learn how to deploy quantized models in production. This guide covers model artifacts, kernel selection, serving infrastructure, and rollback strategies for ML and platform engineers.

Part 6 · Quantization in Practice

Oct 7, 20266 min readDevelopmentFeatured

Measuring Quantization Damage: Perplexity Isn't Enough

Perplexity is a common metric, but it often masks significant quality loss in quantized models. This article explores better ways to measure quantization damage.

Part 5 · Quantization in Practice

#quantization7 #inference14 #llm52 #performance8 #model-evaluation4 #benchmarks2 #serving2 #model-deployment1

Ml Ops

Deploying a Quantized Model End to End

Measuring Quantization Damage: Perplexity Isn't Enough

Related tags