dottxt · Remote - USA
Staff Rust developer for .txt, owning the performance-critical automata, indexes and parsers that run at every LLM decoding step. The role includes Python bindings and C++/CUDA glue to integrate with an inference engine, plus benchmarking and profiling. Work involves formal grammars, text indexing, and CI/CD tooling.
.txt builds structured generation: we make language models produce output that follows a given format, by deciding at every decoding step which tokens are allowed. We compile a JSON Schema, a regex, a grammar, a list of function definitions or a policy into that decision, fast enough to run inside the decoding loop. This is how .txt builds reliable and safe agents. We're looking for a developer to work on the parsers and compilers at the center of it.
.txt builds structured generation: we make language models produce output that follows a given format, by deciding at every decoding step which tokens are allowed. We compile a JSON Schema, a regex, a grammar, a list of function definitions or a policy into that decision, fast enough to run inside the decoding loop. This is how .txt builds reliable and safe agents. We're looking for a Rust developer to own the part of it that has to be fast: the automata, indexes and parsers that run at every decoding step. You'd turn what the rest of the team writes into production-ready Rust, with the Python bindings and C++/CUDA glue to put it inside an inference engine, and the benchmarks to prove it stays fast.
🧭 The problem matters
Every agent that takes real actions needs a layer that guarantees it can only do what it was asked. The parser and compiler work in this role is what enables this guarantee.
🌐 Remote first
Work from anywhere in the world. We communicate mostly in writing and favor occasional organic discussions over recurring large team meetings.
💸 Competitive compensation and benefits
Market-rate salary plus stock options, health and dental insurance, and a 401(k) for US employees. We'll also get you a GPU if you don't have one.
.txt is a fully remote company with the majority of the team in the US and EU.
For this role, you must be based in the US.
Please provide a 1-page resume in English.
Only apply to one position at a time.
Compensation: $160K - $210K