working on inference infrastructure and devops for production ai systems

handling backend reliability, deployments, observability, and platform operations

focused on high-throughput apis, production reliability, and safe release paths

built and deployed routing.run from scratch, an llm api gateway with intelligent routing

architected multi-provider llm routing with fallback mechanisms

implemented user authentication, api key management, and credit-based billing

developed fastapi backend with async postgresql and redis integration

built real-time health monitoring and provider status dashboard

deployed containerized microservices with automatic scaling

handed it over after acquisition and moved to commandcode for work at scale inference

built a macos application in swift, improving usability, performance, and the overall user experience through optimized ui design and system-level integrations

designed and developed a reseller platform using turborepo, astro, drizzle orm, postgresql, docker, and better-auth, enabling scalable multi-tenant operations and streamlined deployment workflows

partnered with engineers to architect a high-performance backend in typescript and go, optimizing ai request routing across multiple providers for improved reliability, reduced latency, and cost efficiency

implemented an ai training pipeline with lora configuration, enabling efficient model fine-tuning and improved inference quality for domain-specific tasks

built and maintained ci/cd pipelines in jenkins, automating docker image builds, testing, and deployments while strengthening devops reliability and release speed

collaborated with senior engineers to design and implement a robust authentication system for a copy trading platform

developed trading tools that enhanced user experience and functionality within the financial technology space

created a subscription service to streamline user access to premium features, fostering customer engagement

used jenkins, docker, and devops practices to improve deployment processes and system reliability

maintained and scaled the backend of groot, a high-traffic discord music bot with premium features

developed services using typescript, postgresql, and mongodb, integrated secure payment apis

resolved major production bugs and optimized performance across thousands of servers

contributed to bot reliability, uptime, and scalability under heavy concurrent usage

coded memepay, a crypto trading platform for solana and memecoins, from scratch across frontend and backend

deployed the platform through nginx on ubuntu

built backend services with python, fastapi, psql, mongodb, solanapy, solders, twitter.py, and google oauth services

built frontend flows with next.js and javascript

worked on backend systems for medication reminder workflows

built api and data handling pieces for reminder, scheduling, and user-facing product features

helped keep the backend simple, maintainable, and ready for product iteration