Senior AI Operations Engineer - LLM & Agentic Ops

At Robinhood, our mission is to democratize finance for all. An estimated $124 trillion of assets will be inherited by younger generations over the next two decades—representing the largest transfer of wealth in human history.

The Corporate Engineering team is building and scaling the next generation of enterprise AI infrastructure at Robinhood. Our mission is to make AI capabilities reliable, secure, performant, and cost-efficient across the company, enabling internal teams to build, deploy, and operate intelligent solutions at scale.

As a Senior AI Operations Engineer on the Enterprise Tech team, you will own the infrastructure, observability, automation, and operational reliability powering Robinhood’s internal enterprise AI capabilities. You will manage commercial LLM provider integrations (Anthropic Claude, Google Gemini), optimize token utilization and API costs, support retrieval-augmented generation (RAG) pipelines and vector databases, and build self-service tooling for developers across the company.

Key Responsibilities

• Enterprise AI Infrastructure & Integration: Manage, scale, and optimize enterprise integrations with core LLM providers (Anthropic Claude, Google Gemini), focusing on system reliability, latency, rate limits, and token cost efficiency.
• AI Tooling & Developer Self-Service: Build custom internal automation and self-service tools using Python, Bash, and Infrastructure as Code (Terraform, Ansible) to streamline AI operations and reduce developer friction.
• Observability & Monitoring Pipelines: Develop robust monitoring and tracing dashboards for enterprise AI workloads, tracking key metrics including inference latency, token consumption, API error rates, and model performance.
• Agentic Workflows & RAG Optimization: Support and operationalize agentic orchestration frameworks, vector database systems, and RAG architectures to maintain high reliability and system scalability.
• Technical Escalation & Root Cause Analysis: Lead complex operational troubleshooting across production AI platforms, working directly with software engineers, systems leads, and business partners to resolve issues.
• Cross-Functional AI Strategy: Partner with Product, Security, Business Systems, and AI Strategy teams to identify systemic bottlenecks and incorporate feedback into long-term infrastructure roadmaps.

Requirements

AI Infrastructure, SRE & Operations Depth

• 5+ years of professional experience in IT Operations, Site Reliability Engineering (SRE), Systems Engineering, or AI Infrastructure and Operations.
• Enterprise LLM Integration Experience: Hands-on experience operating and troubleshooting enterprise AI platforms and commercial LLM APIs (Anthropic Claude and Google Gemini), including prompt operations, token management, and API gateway routing.
• Linux & Automation Mastery: Advanced Linux administration skills with strong proficiency scripting and automating workflows using Python or Bash.
• Infrastructure as Code & Orchestration: Practical experience with IaC, configuration management, and container orchestration tooling (Terraform, Ansible, Chef, or Kubernetes).
• Production System Reliability: Strong fundamentals in system architecture, cloud/on-premises networking, distributed monitoring, and systematic root-cause troubleshooting.
• Developer Collaboration: Outstanding communication skills with a proven track record partnering directly with software developers to solve complex production issues.

Preferred Qualifications

• Experience with vector databases (Pinecone, Milvus, Qdrant) and AI orchestration frameworks (LangChain, LlamaIndex).
• Hands-on experience with GPU clusters or AI workload orchestration engines (Slurm, Ray).
• Familiarity with hybrid cloud environments, bare-metal infrastructure, or enterprise model proxy/gateway architectures.

Total Rewards & Benefits

• Compensation & Equity: Zone-based base salary ($119,000 – $180,000 USD) + performance-driven multipliers + bonus programs + equity ownership + 401(k) company match.
• Exclusive Investment Perks: Access to the Robinhood Employee Fund, providing eligible US employees the opportunity to invest in a private fund with exposure to Robinhood Ventures funds.
• Comprehensive Healthcare: 100% employer-paid medical, dental, and vision insurance premiums for employees (90% coverage for dependents), plus fertility benefits and mental health support.
• AI Skill Development: Access to best-in-class AI tools and continuous AI skill-building resources for all employees.
• Lifestyle Wallet & Time Off: Flexible spending account for wellness and continuous learning, on-site catered meals, paid time off, company holidays, paid sick leave, and parental leave.