Back to results
Technology & IT

ML Inference Engineer – at Toptal, Remote Worldwide

Toptal
Remote Mid-level Competitive salary Posted 2 hours ago International
Apply on company site ↗
Not ready to apply yet?
Free ATS check

Check your CV before you apply

See your score the way hiring software reads it. If it needs work, build a stronger resume in the same place.

About the role

Toptal is hiring an ML Inference Engineer – Terminal-Bench Task Designer (vLLM / SGLang / TensorRT-LLM) (remote, open to people in any country). We are building a benchmark that tests how well AI agents handle real expert work in a terminal. We are hiring ML inference and serving experts to turn real, paid tasks from their jobs into expert-level Terminal-Bench challenges. Each task includes the environment, a working solution, and an automated check that proves the result is correct.

More about the role

• Design expert-level Terminal-Bench tasks that turn real, paid ML inference work from your own experience into challenges an AI agent must solve end to end.

• Define the files, systems and environments each task runs on, such as model serving with streaming, so the challenge is realistic, reproducible and command-line solvable.

• Write a working reference solution for every task and verify it runs end to end, sized for about 60 to 75 minutes of expert effort.

Key responsibilities

  • • Design expert-level Terminal-Bench tasks that turn real, paid ML inference work from your own experience into challenges an AI agent must solve end to end
  • • Define the files, systems and environments each task runs on, such as model serving with streaming, so the challenge is realistic, reproducible and command-line solvable
  • • Write a working reference solution for every task and verify it runs end to end, sized for about 60 to 75 minutes of expert effort

Remote details

  • Remote, open to people in any country (remote role)

Salary and benefits

The posting does not give a salary figure.

How to apply

Apply on the company's own site.

Toptal
Listed via RemoteOK
View companies

Source: RemoteOK · The Briefed never charges candidates.

The Weekly Brief

New roles, in your inbox.

One email a week — the best hand-picked roles, salary insights and career reads. No spam, unsubscribe any time.