Back to results
Technology & IT

Software Engineer, Inference at Sierra, San Francisco, US

Sierra
On-site · San Francisco, California Mid-level Full-time USD 230k–390k / yr Posted just now International
Apply on company site ↗
Not ready to apply yet?
Free ATS check

Check your CV before you apply

See your score the way hiring software reads it. If it needs work, build a stronger resume in the same place.

About the role

Sierra is hiring a Software Engineer, Inference in San Francisco, the United States. Sierra is the leading platform for customer-facing AI agents, working with many of the world's biggest brands — including The GAP, Rocket Mortgage, SoFi, Sutter Health, and SoftBank — to transform how they serve customers and grow their businesses. We are primarily an in-person company based in San Francisco, with growing offices across North America, Europe, and Asia.

Key responsibilities

  • Sierra’s AI agents depend on foundation models to reason and act in real time. The Inference team builds the systems that make those models fast, reliable, and efficient at scale
  • This is a systems-first role at the intersection of distributed infrastructure and AI. You don’t need to be an ML researcher—we’re looking for engineers who love complex systems problems and are excited to apply that expertise to one of the fastest-moving areas of AI infrastructure.
  • Partner with frontier labs and providers. At our scale, we rely on frontier labs, and inference providers to supply capacity, training and inference infrastructure
  • Shape Sierra’s inference architecture. Design how inference traffic flows across models, infrastructure, and providers, including new serving and proxy layers as Sierra scales
  • Build for low latency and high reliability. Develop systems for routing, failover, capacity management, and quota that keep inference performant and available across large-scale production workloads
  • Build and operate self-hosted inference. Run models on GPU infrastructure, from building containers and operating inference engines to managing the underlying compute capacity
  • Optimize inference performance. Work with the Applied Research team on techniques such as speculative decoding and serving-engine optimizations that improve latency, throughput, and cost
  • Build across a hybrid inference stack. Work with both Sierra-managed infrastructure and leading inference platforms, making architectural decisions about where and how workloads should run
  • Push the serving stack forward. Work closely with inference providers to tune engines and infrastructure for Sierra’s workloads
  • Support the broader model lifecycle. Contribute to infrastructure that enables post-training while partnering closely with our Models and Agent Runtime teams

Requirements

  • Deep systems thinking and strong distributed systems fundamentals
  • Experience designing, building, and operating large-scale production systems
  • Strong judgment around tradeoffs involving latency, reliability, capacity, and cost
  • Experience taking ownership of complex infrastructure from architecture through production operation
  • Excitement about applying systems expertise to AI infrastructure and learning quickly as the underlying technology evolves
  • Experience with ML infrastructure, MLOps, or production inference systems
  • Experience serving LLMs or other large models at scale
  • Experience operating self-hosted inference and GPU infrastructure
  • Familiarity with inference frameworks such as vLLM or SGLang

About Sierra

Sierra is the leading platform for customer-facing AI agents, working with many of the world's biggest brands — including The GAP, Rocket Mortgage, SoFi, Sutter Health, and SoftBank — to transform how they serve customers and grow their businesses. We are primarily an in-person company based in San Francisco, with growing offices across North America, Europe, and Asia.

We are guided by a set of values that are at the core of our actions and define our culture: Trust, Customer Obsession, Craftsmanship, Intensity, and a commitment to balancing Family along the way. These values are the foundation of our work, and we are committed to upholding them in everything we do.

Location and schedule

  • Based in San Francisco, the United States (onsite role)
  • Build across a hybrid inference stack. Work with both Sierra-managed infrastructure and leading inference platforms, making architectural decisions about where and how workloads should run
  • We want our benefits to reflect our values and offer the following to full-time employees
  • Lunch, as well as delicious snacks and coffee to keep you energized when working onsite

Salary and benefits

The posting states a base salary of USD 230,000 to 390,000 a year. Benefits and what the employer offers, as the posting lists them:

  • Flexible (unlimited) paid time off
  • Medical, dental, and vision benefits for you and your family
  • Life insurance and disability benefits
  • Retirement plan dependent on country of employment
  • Fertility and family building benefits
  • Lunch, as well as delicious snacks and coffee to keep you energized when working onsite

How to apply

Apply on the company's own site.

Applying for a software engineer role?See the resume keywords 323 real job posts asked for.See keywords →
Sierra
Listed via Employer Career Pages
View companies

Source: Employer Career Pages · The Briefed never charges candidates.

The Weekly Brief

New roles, in your inbox.

One email a week — the best hand-picked roles, salary insights and career reads. No spam, unsubscribe any time.