Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators.

At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there.

A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone.

The Observability team owns the entire stack of Telemetry, Distributed Tracing, and Logs, including instrumentation libraries, data processing pipelines, data storage, and the visualization UI. We provide the vital signs for our software components that subtend to our platform. We believe in user-centric strategy, and we are focused on making an impact for all the teams we support. As a Principal Software Engineer in the Observability team,

You will:

• Work with our business partners to determine the vision and roadmap, and lead the project execution end-to-end.
• Focus especially on novel solutions to monitor AI/ML systems, covering the full AI/ML lifecycle and ecosystem
• Take full ownership of existing observability infrastructure systems, making sure they are scalable, reliable and easy to use, and meanwhile improve the existing infrastructures with new features and functionality.
• Follow and expand our vision to put the Roblox community first and get things done.
• Take the long view to architect our next generation observability platform, ingesting PBs of log and tracing data everyday.
• You will report to the Engineering Manager for Observability.
• This is a Hybrid role located in our San Mateo headquarters. You are required to be in the office at HQ 3 days a week (Tues-Thurs). #LI-Hybrid

You Have:

• 8+ years of working experience and experience in building, maintaining and evolving large scale distributed systems.
• Demonstrated understanding of all the components that are required to build modern, large-scale infrastructures.
• Ownership of end-to-end availability and performance of critical services to reduce operational overhead.
• A love of learning, and a drive to pick up new technologies as the landscape evolves. Previous contributions to the Open Source Community is a big plus.