Shubham Yadav

CommandCode · Full-time · Remote

• Inference infrastructure and DevOps for production AI systems.
• Backend reliability, deployments, observability, and platform operations.
• High-throughput APIs, GPU fleet reliability, and safe release paths.

Kubernetes · Go · Rust · TypeScript · vLLM · ROCm · Grafana · Prometheus · OpenTelemetry · Cloudflare Workers, R2, D1

routing.run · Full-time · Jaipur, remote

• Built and deployed routing.run from scratch as an LLM API gateway.
• Architected multi-provider routing, fallback, authentication, billing, and provider health.
• Ran the containerised production platform through acquisition and handover.

Python · FastAPI · PostgreSQL · Redis · Docker

ultrabalancer · Open source

• Production-grade HTTP/2 load balancer in Rust reaching 500k+ RPS with lock-free data structures and zero-copy I/O.
• HTTP/1.1, HTTP/2 multiplexing, WebSocket proxying, and TLS termination.
• Caching, gzip compression, rate limiting, sticky sessions, and circuit breakers.
• Health checking, retries, and failover, with Prometheus metrics and access logging.

Rust · Tokio · HTTP/2 · WebSocket · TLS · Prometheus

MegaLLM · Full-time · Bengaluru, hybrid

• High-performance TypeScript and Go backends for AI request routing.
• Native macOS application in Swift for AI chat interactions.
• Model inference and fine-tuning pipelines with vLLM, PyTorch, and Modal GPU infrastructure.
• Microservices over NATS, Redis caching, and a Grafana/Prometheus observability stack.
• Multi-tenant reseller platform and Jenkins-based container release pipelines.

Go · Python · PyTorch · vLLM · Swift · TypeScript · NATS · Redis · PostgreSQL · Docker · Kubernetes · Jenkins · AWS

DynTech · Full-time · Jaipur, remote

• Authentication and subscription systems for a copy-trading platform.
• Server-side services and trading tools built alongside senior engineers.
• Deployment workflows through Jenkins, Docker, and production operations.

Go · Python · PostgreSQL · TypeScript · Docker · Jenkins · AWS

Groot Music · Full-time · Bengaluru, remote

• Maintained and scaled the backend of a high-traffic Discord music bot.
• TypeScript services, payment integrations, and PostgreSQL/MongoDB data paths.
• Debugged production failures and improved reliability across thousands of servers.

TypeScript · PostgreSQL · MongoDB · Payments

HTTP/2 load balancer reaching 500k+ RPS. Round-robin, least-connections, IP-hash, weighted and random strategies, with health checks, circuit breakers, sticky sessions, rate limiting, caching, and compression. Graceful shutdown, Prometheus metrics, and CLI/YAML configuration.

Rust, Tokio, HTTP/2, TLS

Disposable coding environments for humans and AI agents without handing either the keys to the machine. Ships a 12-tool MCP server so coding agents can drive the lifecycle directly.

Go, control plane + CLI, MCP

An operator's lens for GPU inference servers: inspect, benchmark, and catch trouble before users do. Covers incidents, telemetry, canaries, and rollout validation.

Go, CUDA/ROCm telemetry

Moves useful coding-session context between opencode, Claude Code, and Codex without pretending hidden model state is portable.

Rust, CLI

Security review driven by the coding CLI you already have.

TypeScript

Lightweight SSH honeypot capturing attacker authentication attempts and executed commands. Simulates a realistic shell with structured JSON Lines logging for forensics, containerised for safe isolation.

Rust, Docker