Systems Engineer, World Model Evaluation - Autonomous Vehicles

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world. Help us measure how accurately autonomous vehicles understand the world! We’re looking for an experienced systems engineer to join NVIDIA’s autonomous-driving systems engineering team and advance our world-model evaluation capabilities, connecting perception and map-fusion performance to driving behavior and safety. How do we know whether the vehicle’s representation of its surroundings is accurate, and which failures do our tests miss? Together, we’ll develop requirements, metrics and evaluations that uncover gaps and guide engineering improvements. You’ll collaborate with our perception, mapping, planning, safety and infrastructure teams to turn real-world failures into reliable evidence for development and release decisions. What you will be doing: • Work with us to translate driving-feature needs and safety analysis into world-model requirements, performance targets and error budgets. • Investigate real-world failure modes and develop metrics, scenarios and tests that expose gaps across operating conditions. • Build and validate evaluators that connect world-model errors to vehicle behavior. • Partner with our data and ground-truth teams to define evaluation datasets and labeling guidelines, addressing ambiguous cases, label quality, coverage, provenance and independence from training data. • Develop reproducible analysis and automated triage using on-road data, replay and closed-loop simulation to distinguish product failures from evaluation and data issues. • Help us turn results into decisions through evaluation tools and dashboards that guide improvements and demonstrate release readiness. What we need to see: • MS or PhD in engineering, computer science, physics, data science or a related field, or equivalent experience. • 8+ years of relevant experience in systems engineering, quantitative systems analysis, verification and validation, data science or experiment design for complex software systems. • Experience translating system needs and failure modes into measurable requirements, test strategies and acceptance criteria. • Experience evaluating perception, map-fusion or comparable systems, including evaluation-data strategies and ground-truth quality. • Strong Python and SQL skills, with experience building reproducible analyses and extracting insights from large datasets. • Experience building Python evaluation pipelines using distributed data-processing frameworks, object storage and SQL-based data platforms. • A foundation in statistical analysis, experiment design, measurement uncertainty and performance-budget allocation. • Attention to detail and ownership: you check assumptions, validate results and follow issues through to resolution. • Ability to build technical alignment across teams and communicate findings, limitations and trade-offs clearly. • Proficiency with SQL and Python or C++ Ways to stand out from the crowd: • Experience evaluating perception, mapping or planning systems in autonomous vehicles, machine learning or computer vision contexts, with the ability to connect subsystem metrics to closed-l