Skip to content
Ashish.

Blog

Writing on Identity & Security

Practical guides on OAuth 2.0, OpenID Connect, SAML, Keycloak, and the platform engineering behind identity systems.

595 posts · page 1 of 30

6 min readDevelopment

SGLang's RadixAttention, Explained

Explore how SGLang uses RadixAttention and prefix caching to significantly boost throughput and efficiency in large language model serving.

6 min readDevelopmentFeatured

Shadow Traffic for LLM Deployments

Learn how to deploy candidate LLMs using shadow traffic and traffic mirroring to compare performance and detect side effects before full rollout.

6 min readDevelopmentFeatured

Kubernetes GPU Management: Beyond Passthrough

A technical guide to managing GPU workloads in Kubernetes, covering scheduling strategies, MIG, and time slicing for efficient resource utilization.

6 min readDevelopment

Estimating LLM Costs Before You Build

Learn how to accurately forecast LLM expenses before development begins. This guide covers unit economics, token forecasting, and sensitivity analysis for engineering leaders.

8 min readBackendFeatured

Multi-Provider Failover with LiteLLM

Learn how to configure LiteLLM's router for automatic failover across multiple AI providers, ensuring high availability and resilience for your backend applications.

6 min readDevelopmentFeatured

Ragas, DeepEval, and TruLens Compared

Compare Ragas, DeepEval, and TruLens for RAG evaluation. See how metric frameworks differ to help ML engineers select the best tool.

6 min readDevelopment

Building an Eval Harness with promptfoo

Learn how to implement a structured evaluation harness with promptfoo, covering assertions, CI integration, and effective prompt comparison strategies.

6 min readDevelopmentFeatured

Model Merging: SLERP, TIES, and DARE

Explore how SLERP, TIES, and DARE enable effective model merging, allowing engineers to combine specialized models without full retraining.