Principal Software Engineer, DevOps

Principal Software Engineer, DevOps Remote, United States ABOUT POSITION: Are you passionate about automation, DevOps, public cloud services, Kubernetes, and observability? As a site reliability engineer at Legion, you will be responsible for building the tools, infrastructure, and services to create a secure, highly scalable, and cost-effective AWS/Kubernetes-based cloud platform. You will be working with everything from infrastructure tooling, automation, build and deployment pipelines, monitoring and logging, containerization, and more! Simply put, the SRE team keeps Legion running for our customers. ROLES AND RESPONSIBILITIES: • Support Legion’s public cloud platform, utilizing multiple cloud services and containerization • Develop infrastructure automation leveraging Terraform, Chef, Jenkins, and Golang. • Create and manage production alerts. Respond to alerts and conduct a root-cause investigation • Develop automated operational runbooks • Support the deployment of Legion’s WFM solution during and off regular office hours • This role involves participation in on-call rotation • Build and operate internal AI agents that reduce SRE toil — incident triage, runbook execution, alert enrichment, capacity and cost analysis — and own their guardrails, rollback, and reliability • Own the platform that lets other engineers build agents safely: sandboxed execution, scoped credentials, tool/MCP integrations, cost controls, and agent observability BASIC QUALIFICATION: • 12+ years experience in SRE, DevOps, or other SaaS operations. • 3+ years of hands-on experience with managing AWS services and cloud infrastructure in AWS utilizing Terraform. AWS Certification preferred • 3+ years experience with containerized cloud solutions utilizing Docker, Kubernetes, or AWS EKS. Familiarity with HELM charts • 5+ years experience with at least one programming language like Go, Python, Bash, Perl • 5+ years experience with one or more Infrastructure automation (Terraform, Ansible, etc.), CI/CD pipelines (GIT, Jenkins, etc.), and configuration management tools (Ansible, Chef, etc). • Hands-on experience with one or more Linux/Unix platforms like RedHat/CentOS/Ubuntu/Amazon Linux. • Hands-on experience building agentic AI systems in production — tool integrations, evaluation, and failure handling — beyond use of AI coding assistants • Bachelors or Masters degree in Computer Science/Engineering or related field OTHER QUALIFICATION: • Track record of introducing AI into an engineering org's SDLC with measurable results, and the judgment to name where it should not be used. • 3+ years of experience with observability tools: Splunk, Nagios, Elasticsearch, Kibana, CloudWatch, and Logstash and ways to scale these systems. • 3+ years of experience in AWS RDS or Aurora MySQL • Demonstrated ability to work with remote teams COMPENSATION & BENEFITS Salary Range: Base Salary Range $220,000 - $255,000 + S tock Equity At Legion, we offer competitive compensation and benefits packages to all employees. As a fully remote employer, pay for positions is determined using local, national, and industry-specific survey data. Our posted salary range is done so in good faith based on national data and may be refined for a candidate's region/town/cost of living. We strive to make competitive offers that allow employees room for future growth. Salaries will be based on the applicant’s location, level of experience, education, and specialized knowledge and skills. Additionally, we consider the external market rate, the amount we have budgeted internally, and the internal equity for the same position within the company. Benefits include, but are not limited to: • $0 monthly premium and other flexible medical, dental, and vision plans effective on