Project
LLM Inference Platform
A production-style LLM inference platform built with KServe, vLLM, llm-d, Envoy Gateway, Argo CD, and Helm — exploring scalable model serving, request routing, and GitOps workflows.
- Kubernetes
- KServe
- vLLM
- Argo CD
- Helm
Milind Dethe
Software engineer
IIT KGP graduate Ex-Atlan intern LFX Thanos contributor Kubeflow member CKA certified
experience
Jun — Nov 2025
Atlan — Software Engineer Intern, Platform
Automated EKS control-plane and node upgrades with Argo Workflows (80% faster), synced secrets with External Secrets Operator, built Grafana dashboards and alerts that cut MTTD by 40%, and served on the platform on-call rotation.
Jan 2025 — Now
Kubeflow — Contributor · CNCF
Cascade deletion in the Pipelines backend, release automation for Kubeflow Trainer, and Release Shadow for Kubeflow Community Distribution 26.03.
Sep — Nov 2024
CNCF Thanos — LFX Mentee
Optimized request hedging in Thanos Store Gateway with adaptive T-Digest thresholds, cutting P99 tail latency by 30% — merged upstream as an opt-in production option.
latest posts
view all- Writing the Code Is Only the Beginning
- A Backend Can Be Correct and Still Be Impossible to Operate
- The Database Update Succeeded. The Event Didn't. Now What?
- The Hardest Distributed Systems Problem: Not Knowing What Happened
- What Happens After You Put Something on a Queue?
- My Code Was Correct Until Two Requests Ran at Once
selected projects
view allProject
DeployGuard
A Kubernetes operator that analyzes Prometheus metrics during rollouts to automatically detect regressions and enable safer, metrics-driven deployments.
- Go
- Kubernetes
- Prometheus
- Operator SDK
Project
Predictive Kubernetes Autoscaler
An intelligent autoscaling system that forecasts workload demand and proactively scales Kubernetes applications using KEDA and time-series predictions.
- KEDA
- Python
- FastAPI
- Kubernetes
- Prophet
Project
Store Provisioning Platform
Automated provisioning of isolated MedusaJS stores using Argo Workflows, enabling repeatable deployments with GitOps and cloud-native infrastructure.
- Argo Workflows
- Kubernetes
- AWS
- Go
- GitOps