Back to results
Technology & IT

Staff Software Engineer - AI Gateway at Databricks, New York

On-site · New York, New York Senior USD 190k–261k / yr Posted 1 hour ago International
Apply on company site ↗
Not ready to apply yet?
Free ATS check

Check your CV before you apply

See your score the way hiring software reads it. If it needs work, build a stronger resume in the same place.

About the role

Databricks is a data and AI company known for its lakehouse platform. Databricks is hiring a Staff Software Engineer - AI Gateway in New York, the United States. At Databricks, we are passionate about enabling data and AI teams to solve the world's toughest problems, from making the next mode of transportation a reality to accelerating medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers, and customer obsessed, we leap at every opportunity to solve.

Key responsibilities

  • Build the routing layer that picks the right model for each request across quality, cost, latency, availability, and remaining budget
  • Improve reliability, latency, and efficiency of distributed AI workloads
  • Collaborate with research, platform, infra, and AI/ML teams to deliver seamless end-to-end experiences
  • Shape how developers and data scientists build and interact with AI on Databricks
  • 8+ years of experience in backend or infrastructure engineering
  • Strong programming skills in Scala, or Go
  • Experience with distributed systems, high-throughput APIs, or cloud-native infrastructure
  • Familiarity with service-oriented architecture, deployment pipelines, and system observability
  • Strong product and ownership mindset. You care about building the right solution, not just any solution

Nice to have

  • Experience with real-time serving, AI infrastructure, or GPU orchestration
  • Exposure to platforms like Bedrock, Vertex AI, or Azure ML
  • Experience building developer platforms or internal tools supporting AI workflows

About Databricks

Databricks is the Data and AI company. More than 20,000 organizations worldwide — including adidas, AT&T, Bayer, Block, Mastercard, Rivian, Unilever, and 70% of the Fortune 500 — rely on the Databricks Data + AI Platform to build and scale data and AI apps, analytics and agents. Headquartered in San Francisco with 30+ offices around the globe, Databricks offers a unified platform that includes Genie, Lakebase, Agent Bricks, Lakeflow, Lakehouse, and Unity Catalog. To learn more, follow Databricks on LinkedIn , X , YouTube , and Instagram . Benefits At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific.

Location and schedule

  • Based in New York, the United States (onsite role)

Salary and benefits

The posting states a base salary of USD 190,000 to 261,250 a year. Benefits and what the employer offers, as the posting lists them:

  • $190,000 — $261,250 USD

How to apply

Apply on the company's own site.

Applying for a software engineer role?See the resume keywords 878 real job posts asked for.See keywords →
databricks
Listed via Employer Career Pages
View companies

Source: Employer Career Pages · The Briefed never charges candidates.

The Weekly Brief

New roles, in your inbox.

One email a week — the best hand-picked roles, salary insights and career reads. No spam, unsubscribe any time.