• Companies
  • News
By technology
  • Python14.3k
  • AWS10.3k
  • Kubernetes7.4k
  • Docker7.2k
  • PostgreSQL5k
  • C++4.8k
  • SQL4k
By category
  • Backend Developer11k
  • DevOps Engineer3.1k
  • Machine Learning Engineer3k
  • Full Stack Developer2.8k
  • Data Engineer2.5k
  • Embedded Engineer2k
  • Frontend Developer780
By city
  • San Francisco, CA5.8k
  • New York, NY5.1k
  • Seattle, WA1.2k
  • Toronto, ON893
  • Washington, DC857
  • Austin, TX801
  • Boston, MA795
Work mode
  • On-site19.4k
  • Remote8.6k
  • Hybrid5.1k
Job type
  • Full-time32.1k
  • Part-time446
  • Contract434
  • Freelance147
  • internship4
  • seasonal1
Experience
  • Entry level
  • Mid level
  • Senior
  • Staff+
  • Engineering management

The job board for developers. Find your next role at companies that value great engineering.

© 2023-2026 . All rights reserved.

Logos provided by Logo.dev
Add
50 matches
NewestHighest base
Designworks Talent

Senior Inference Engineer

today
Designworks Talent · Bellevue, WA
HybridFull-timevLLM · SGLang
d-Matrix

Senior Staff Inference Performance Engineer

today
d-Matrix · Santa Clara, CA
$175k–265kHybridFull-timeKubernetes · Python
d-Matrix

Senior Staff LLM Inference Engineer

today
d-Matrix · Santa Clara, CA
$195k–285kOn-siteFull-timePython · C++
d-Matrix

Principal System Software Engineer, AI Inference Execution

today
d-Matrix · Santa Clara, CA
$195k–285kHybridFull-timeC++ · Python
Abridge

Member of Technical Staff, Machine Learning

today
Abridge · San Francisco, CA
$221k–260kHybridFull-timeKubernetes · NVIDIA Triton Server
Plaud

Machine Learning Engineer, Inference & Serving (Speech LLM) - San Francisco

today
Plaud · San Francisco, CA
$195k–365kHybridFull-timevLLM · TensorRT-LLM
Plaud

Machine Learning Engineer, Speech LLM Training - San Francisco

today
Plaud · San Francisco, CA
$195k–365kHybridFull-timePyTorch · JAX
Socure

Software Engineer II — Agentic AI Foundations

today
Socure · Toronto, ON
HybridFull-timePython · Java
Lambda

Senior Solution Engineer

today
Lambda · San Francisco, CA
$226k–355kHybridFull-timeKubernetes · Slurm
Baseten

Software Engineer - Partner Platform

today
Baseten · San Francisco, CA
$165k–330kOn-siteFull-timeKubernetes · Python
Baseten

Engineering Manager, Inference Performance

today
Baseten · San Francisco, CA
$240k–270kOn-siteFull-timePyTorch · TensorRT-LLM
Baseten

Software Engineer - Inference Platform

today
Baseten · San Francisco, CA
$180k–360kOn-siteFull-timeKubernetes · vLLM
Baseten

Software Engineer - Inference Performance

today
Baseten · San Francisco, CA
$180k–360kOn-siteFull-timePyTorch · Python
Baseten

Product Platform - Product Engineer

today
Baseten · San Francisco, CA
$165k–330kOn-siteFull-timeKubernetes · Python
Baseten

Solutions Architect, EMEA

today
Baseten · Remote; London
$145k–290kRemoteFull-timevLLM · SGLang
Baseten

Capacity Manager, Operations

today
Baseten · San Francisco, CA
$225k–235kOn-siteFull-timeKubernetes · Python
Baseten

Technical Program Manager, Model Performance

today
Baseten · San Francisco, CA
$165k–330kHybridFull-timevLLM · TensorRT-LLM
Baseten

Forward Deployed Engineer (Training)

today
Baseten · San Francisco, CA
$200k–400kOn-siteFull-timeKubernetes · Slurm
Baseten

Base Labs Fellowship

today
Baseten · San Francisco, CA
$225k–225kOn-siteFull-timeKubernetes · Python
Baseten

Product Manager, Developer Experience

today
Baseten · San Francisco, CA
$165k–330kOn-siteFull-timeKubernetes · Python
  • Previous
  • 1
  • 2
  • 3
  • Next
  • Designworks Talent

    Senior Inference Engineer

    Designworks Talent · 🇺🇸 Bellevue, WA · posted today
    ApplyFull posting

    Extracted from the posting

    Base
    Not stated
    Remote
    Hybrid, approx. 3 days/week in Bellevue, WA office
    Funding
    Well-funded; backed by significant long-term investment (no amount)
    Visa
    No visa sponsorship; US work authorization required
    Stack
    vLLM, SGLang, TensorRT-LLM, Triton Inference Server

    TL;DR

    Senior and Staff Inference Engineer role building and operating model-serving systems for a production AI inference platform with high-throughput, low-latency APIs. Work spans GPU utilization, latency and cost optimization, monitoring, and reliability, collaborating with GPU performance, training, and platform teams. Preferred stack includes vLLM, SGLang, TensorRT-LLM, Triton Inference Server, Kubernetes.

    About Designworks Talent →

    The full posting

    Inference Engineer

    Location: Hybrid | Bellevue, WA (downtown)
    Titles: Senior and Staff (multiple roles available)


    Build the Inference Platform Powering Next-Generation AI Applications


    About the Opportunity

    A well-funded, rapidly growing AI infrastructure company is building a next-generation cloud platform designed to power the full lifecycle of artificial intelligence. The organization is developing a comprehensive AI infrastructure, platform, and services portfolio that supports the full spectrum of AI workloads—including large-scale compute, model training, fine-tuning, inference, and emerging agentic AI applications.


    Backed by significant long-term investment, the company combines the speed, ownership, and innovation of a startup with the stability and resources of an established parent organization. Engineering teams are intentionally lean, highly collaborative, and AI-native, leveraging modern tooling and automation to build infrastructure capable of supporting the industry's most demanding AI workloads.


    We're seeking Inference Engineers to build and operate the model-serving systems behind a next-generation AI inference platform. This team focuses on delivering high-throughput, low-latency, reliable inference experiences that enable customers to consume advanced AI capabilities through production-scale APIs.

    The Opportunity

    This is a foundational engineering role focused on building the systems that bring AI models from research environments into reliable production services. You'll work on the infrastructure layer responsible for serving large models efficiently, optimizing performance, and ensuring reliability as usage scales.


    You'll collaborate closely with GPU performance, AI training infrastructure, platform engineering, and operations teams to solve complex challenges around model serving, latency optimization, resource efficiency, and production reliability.


    This opportunity is ideal for engineers who enjoy working at the intersection of distributed systems, machine learning infrastructure, GPU computing, and large-scale production systems.

    What You'll Do

    • Build and operate production-grade model-serving and inference systems supporting high-throughput, low-latency AI workloads.
    • Optimize inference infrastructure for token throughput, latency, scalability, and cost efficiency across different model architectures and workloads.
  • Design systems that maximize GPU utilization while maintaining predictable performance and reliability.
  • Improve the scalability and operational maturity of inference platforms as customer demand grows.
  • Partner with AI training, GPU performance, orchestration, and infrastructure teams to ensure smooth transitions from model development to production serving.
  • Develop monitoring, alerting, and operational practices to maintain reliable inference services.
  • Investigate and resolve performance, reliability, and capacity challenges across inference workloads.
  • Contribute to architecture decisions and engineering standards as the platform evolves.
  • What We're Looking For

    • Experience building and operating production machine learning inference or model-serving systems at scale.
    • Strong understanding of the performance trade-offs involved in serving large AI models, including latency, throughput, memory utilization, and cost efficiency.
    • Experience designing reliable distributed systems or production infrastructure.
    • Understanding of GPU-backed AI workloads and the challenges of scaling inference systems.
    • Strong engineering fundamentals and the ability to independently own complex technical problems.
    • Comfortable working in a fast-moving environment where systems and processes are being built from the ground up.

    Preferred Qualifications

    • Experience with modern inference-serving frameworks such as vLLM, SGLang, TensorRT-LLM, Triton Inference Server, or similar technologies.
    • Experience optimizing LLM inference workloads or large-scale AI serving platforms.
    • Background operating API-based AI products or high-volume production services.
    • Experience with GPU scheduling, distributed systems, Kubernetes, or cloud infrastructure platforms.
    • Familiarity with model optimization techniques such as quantization, batching, caching, or performance tuning.
    • Experience working at a hyperscaler, AI lab, GPU cloud provider, or large-scale ML infrastructure organization.

    Compensation

    • Competitive base pay for Bellevue market
    • Certain roles are eligible for additional rewards, including merit increases, annual bonus, and long term incentives. These awards are allocated based on individual performance
    • U.S. based employees have access to medical, dental, and vision insurance, a 401(k) plan and company match, employees also receive per calendar year, paid holidays.

    Location

    • Hybrid role based in the Bellevue, WA area.
    • Approximately three days per week in the office.
    • Candidates elsewhere in the U.S. who are open to relocation are encouraged to apply.
    • U.S. work authorization is required. Visa sponsorship is not currently available.

    Why Join?

    • Build the inference platform powering the next generation of AI applications.
    • Work directly on large-scale model serving, GPU optimization, and production AI systems.
    • Solve complex challenges around latency, throughput, reliability, and cost efficiency.
    • Join early enough to influence architecture, tooling, and engineering practices.
    • Collaborate with a highly experienced team building critical AI infrastructure from the ground up.
    • Enjoy the ownership and technical impact of a startup environment backed by significant long-term investment.