• Companies
  • News
By technology
  • Python17.9k
  • AWS12.6k
  • Kubernetes9.1k
  • Docker8.7k
  • C++5.9k
  • PostgreSQL5.7k
  • SQL5.3k
By category
  • Backend Developer11.3k
  • DevOps Engineer3.4k
  • Machine Learning Engineer3.3k
  • Full Stack Developer3.2k
  • Data Engineer2.8k
  • Embedded Engineer2.2k
  • Frontend Developer857
By city
  • San Francisco, CA6.2k
  • New York, NY5.6k
  • Seattle, WA1.3k
  • Washington, DC1.2k
  • Toronto, ON1.2k
  • Boston, MA1k
  • Austin, TX1k
Work mode
  • On-site21.9k
  • Remote10.2k
  • Hybrid7.3k
Job type
  • Full-time38k
  • Contract600
  • Part-time525
  • Freelance214
  • internship4
  • seasonal1
Experience
  • Entry level
  • Mid level
  • Senior
  • Staff+
  • Engineering management

The job board for developers. Find your next role at companies that value great engineering.

© 2023-2026 . All rights reserved.

Logos provided by Logo.dev
Add
21,887 matches
NewestHighest base
Handshake

Senior Software Engineer, LLM Platform

1 day ago
Handshake · San Francisco, CA
$176k–220kOn-siteFull-timePython · TypeScript
Handshake

Forward Deployed Engineer, Enterprise AI

1 day ago
Handshake · San Francisco, CA
$155k–170kOn-siteFull-timePython · Kubernetes
Handshake

Senior Software Engineer, Operator Experience

1 day ago
Handshake · San Francisco, CA
$225k–250kOn-siteFull-timePython · Kubernetes
Handshake

Staff Software Engineer, Consumer Experience

1 day ago
Handshake · San Francisco, CA
$265k–295kOn-siteFull-timeGo · Python
Dandy

Senior Controls Engineer, Manufacturing

1 day ago
Dandy · Provo, UT
$198k–248kOn-siteFull-timeIgnition · SCADA
Hinge Health

Senior Software Engineer - Backend

1 day ago
Hinge Health · San Francisco, CA
$157k–218kOn-siteFull-timeGolang · gRPC
Hinge Health

Senior Software Engineer - Backend

1 day ago
Hinge Health · San Francisco, CA
$157k–218kOn-siteFull-timeGolang · gRPC
Socure

Senior Post-Sales Solution Consultant, Federal Public Sector

1 day ago
Socure · Washington, DC
$150k–185kOn-siteFull-timeREST APIs
Socure

IT Support Engineer

1 day ago
Socure · San Francisco, CA
$125k–150kOn-siteFull-timemacOS · Windows
Socure

Platform Solution Consultant, Public Sector

1 day ago
Socure · Washington, DC
$145k–170kOn-siteFull-timeSQL
Socure

Senior Technical Project Manager

1 day ago
Socure · San Francisco, CA
$170k–195kOn-siteFull-timeJira · Smartsheet
Profound

Member of Technical Staff, TLM, Internal Tooling

1 day ago
Profound · New York, NY
$230k–275kOn-siteFull-timeTypeScript · Python
Profound

Member of Technical Staff, Internal Tooling

1 day ago
Profound · New York, NY
$140k–260kOn-siteFull-timeTypeScript · Python
Profound

Member of Technical Staff, Evals and Post-Training

1 day ago
Profound · New York, NY
$230k–325kOn-siteFull-timePython
Profound

Member of Technical Staff, Engineering Manager

1 day ago
Profound · New York, NY
$250k–320kOn-siteFull-timeRust
Profound

Member of Technical Staff, Product, Core Product

1 day ago
Profound · New York, NY
$200k–300kOn-siteFull-timePython · Rust
Profound

Member of Technical Staff, Web Design

1 day ago
Profound · New York, NY
$165k–190kOn-siteFull-timeFigma · HTML
Profound

Member of Technical Staff, Product, CMS

1 day ago
Profound · New York, NY
$200k–300kOn-siteFull-timePython · Rust
Profound

GTM Engineer, Post-Sales

1 day ago
Profound · New York, NY
$130k–200kOn-siteFull-timePython · JavaScript
Profound

Member of Technical Staff, Data Platform

1 day ago
Profound · New York, NY
$175k–265kOn-siteFull-timeSnowflake · ClickHouse
  • Previous
  • 1
  • More pages
  • 293
  • 294
  • 295
  • More pages
  • 1095
  • Next
  • Handshake

    Senior Software Engineer, LLM Platform

    Handshake · 🇺🇸 San Francisco, CA · posted 1 day ago
    ApplyFull posting

    Extracted from the posting

    Base
    $176,000 – $220,000
    Equity
    Equity in a fast-growing company
    Remote
    On-site
    On-call
    Participate in team on-call and support
    Stack
    Python, TypeScript, Go, Kubernetes

    TL;DR

    Senior LLM Platform Engineer on the Data and ML Platform team, owning the shared LLM control plane: LiteLLM gateways, provider integrations, shared clients, access controls, observability, cost attribution, and hosted or self-hosted inference. Also contributes to workflow orchestration, model serving, and cloud infrastructure. Stack includes Python, TypeScript, Go, LiteLLM, FastAPI, PostgreSQL, Redis, GCP, Kubernetes, Terraform, BigQuery, Airflow, vLLM, Modal, Ray, and Temporal.

    About Handshake →

    The full posting

    About Handshake

    Handshake was founded on a simple belief that everyone deserves a path to a great career, regardless of where they went to school or who they know. Today, we power 25 million job seekers, 1 million+ employers, and 1,600 educational institutions.

    In 2025, we started Handshake AI and built the fastest-growing AI data business in history. We work directly with frontier AI lab researchers to create evaluations, publish benchmarks, and push the boundary of data. We’ve grown from $0 to ~$1B run rate and pay ~$60M to over 30K individuals every month.

    Why join Handshake now:

    • Shape how every career evolves in the AI economy, at global scale, with impact your friends, family and peers can see and feel
    • Partner hand-in-hand with world-class AI labs, Fortune 500 partners and the world’s top educational institutions
    • Work together with engineers, scientists, operators, and more from Palantir, Meta, Scale AI, and former YC founders
    • Build a massive, fast-growing business with billions in revenue

    About Handshake AI

    Human data is the core infrastructure to AI advancement. Frontier AI labs currently improve model capabilities with various data-intensive post-training techniques. We believe that data spend for AI training will increase by 3-5x in the next few years and continue for much longer as models take on new domains. Handshake AI supports all of the frontier AI labs, working on their most complex data at the largest scale.


    About the Role

    Handshake is hiring a Senior LLM Platform Engineer to join our Data and ML Platform team. This team supports Handshake’s core career marketplace and Handshake AI (HAI) by building the shared data, ML, and LLM infrastructure behind production workflows.


    This infrastructure-heavy role primarily owns our shared LLM control plane: LiteLLM gateways, provider integrations, shared clients, access controls, observability, cost attribution, capacity management, and hosted or self-hosted inference. You’ll also contribute to adjacent platform systems for workflow orchestration, model serving, shared cloud infrastructure, and developer enablement—working closely with Backend Platform, HAI engineering, data science, and FDEs.


    What You’ll Do

    • Build and operate our LiteLLM-based AI gateways and shared LLM clients.
    • Own provider and model onboarding, routing, failover, rate limits, and capacity planning.
  • Build self-service virtual-key, model-access, budget, and credential-management workflows.
  • Establish SLOs, observability, cost attribution, and alerts for production LLM traffic.
  • Safely qualify and roll out new models, providers, SDKs, and gateway configurations.
  • Support hosted and self-hosted inference through a consistent platform interface.
  • Partner with product, AI, and FDE teams to turn recurring delivery problems into paved-platform capabilities.
  • Contribute to the broader Data and ML Platform, including workflow orchestration, model serving, shared cloud infrastructure, and developer tooling.
  • Participate in team on-call and support, improving runbooks, automation, and reliability across owned platform services.
  • What We’re Looking For

    • Strong production software engineering experience in Python, TypeScript, Go, or a similar language.
    • Experience building or operating high-throughput API gateways, proxies, or multi-tenant platform services.
    • Hands-on experience with Kubernetes, Terraform, CI/CD, and production service ownership.
    • Practical experience with LLM provider APIs, including streaming, long-running requests, retries, timeouts, cancellation, and rate limits.
    • Experience with authentication, quotas, credential management, tenant isolation, and auditability.
    • Experience building observability for distributed systems and leading production incident response.
    • Experience with usage metering, cost attribution, capacity planning, or FinOps.
    • Experience with data or ML platform systems such as BigQuery, Airflow, streaming pipelines, model serving, or ML observability.
    • Strong judgment in ambiguous environments and a bias toward simple, reliable systems that scale.

    Bonus Experience

    • LiteLLM, Portkey, or a comparable multi-provider AI gateway.
    • vLLM, Modal, Ray, Triton, PyTorch, or GPU-backed serving.
    • Temporal or another durable-execution system for long-running LLM requests.
    • Evaluation, batch inference, fine-tuning, RL, or other post-training infrastructure.
    • Agent runtimes, sandbox infrastructure, MCP, tool use, or coding-agent infrastructure.

    Our Stack

    Python, TypeScript, Go, LiteLLM, FastAPI, PostgreSQL, Redis, GCP, Kubernetes, Terraform, Spacelift, BigQuery, Airflow, Dataflow/Beam, Datastream, OpenAI, Anthropic, Gemini, OpenRouter, vLLM, Modal, Anyscale/Ray, Datadog, Arize, Temporal, Cloudflare, and Tailscale

    Perks

    Handshake delivers benefits that help you feel supported—and thrive at work and in life.

    The below benefits are for full-time US employees.

    🎯 Ownership: Equity in a fast-growing company

    💰 Financial Wellness: 401(k) match, competitive compensation, financial coaching

    🍼 Family Support: Paid parental leave, fertility benefits, parental coaching

    💝 Wellbeing: Medical, dental, and vision, mental health support, $500 wellness stipend

    📚 Growth: $2,000 learning stipend, ongoing development

    💻 Remote & Office: Internet, commuting, and free lunch/gym in our SF office

    🏝 Time Off: Flexible PTO, 15 holidays + 2 flex days

    🤝 Connection: Team outings & referral bonuses

    Explore our mission, values, and comprehensive US benefits at joinhandshake.com/careers.

    Compensation: $176K - $220K