Skip to content
@milinddethe15

Projects

Selected work, collaborations, and personal projects.

  • LLM Inference Platform preview

    Project

    LLM Inference Platform

    A production-style LLM inference platform built with KServe, vLLM, llm-d, Envoy Gateway, Argo CD, and Helm — exploring scalable model serving, request routing, and GitOps workflows.

    • Kubernetes
    • KServe
    • vLLM
    • Argo CD
    • Helm
  • Project

    DeployGuard

    A Kubernetes operator that analyzes Prometheus metrics during rollouts to automatically detect regressions and enable safer, metrics-driven deployments.

    • Go
    • Kubernetes
    • Prometheus
    • Operator SDK
  • Predictive Kubernetes Autoscaler preview

    Project

    Predictive Kubernetes Autoscaler

    An intelligent autoscaling system that forecasts workload demand and proactively scales Kubernetes applications using KEDA and time-series predictions.

    • KEDA
    • Python
    • FastAPI
    • Kubernetes
    • Prophet
  • Project

    Store Provisioning Platform

    Automated provisioning of isolated MedusaJS stores using Argo Workflows, enabling repeatable deployments with GitOps and cloud-native infrastructure.

    • Argo Workflows
    • Kubernetes
    • AWS
    • Go
    • GitOps
  • AI Platform Engineering preview

    Series

    AI Platform Engineering

    A seven-day build log exploring GPU discovery, KV cache management, batching, and request routing for AI workloads.

    • Kubernetes
    • GPU scheduling
    • Go
    • LLMs
  • MLOps Foundations preview

    Series

    MLOps Foundations

    A practical walk-through of the MLOps lifecycle, from version control and training data to serving, monitoring, and iteration.

    • MLOps
    • Model serving
    • Experiment tracking
    • Python