Data Engineer (we have office locations in Cambridge, Leeds and London)

Data Engineer Are you an experienced Data Engineer who enjoys working at scale, solving complex data challenges and building reliable data solutions? Do you want to apply your engineering skills to work that has a meaningful impact on healthcare and research? At Genomics England, we work with some of the most complex clinical and genomic data in the world, helping researchers, clinicians and scientists use that data to advance research and improve patient outcomes. You’ll be joining our Generate Research Data (GRD) Service at an exciting time. GRD works with internal and external partners to generate or onboard new data that enriches the National Genomic Research Library, supporting a varied portfolio across areas such as rare disease and cancer, involving genomic, multi-omic, bespoke clinical data and emerging sequencing technologies. This is an opportunity to tackle challenging engineering problems, optimise data pipelines and build scalable, high-quality data services, helping lay the foundations for scientific discovery and new clinical and research capabilities. We’re looking for an established, hands-on Data Engineer to bring strong technical expertise to this work, improving how large volumes of sensitive healthcare and genomic data are acquired, transformed, stored and delivered securely and efficiently. If you enjoy building robust data solutions, working with complex data at scale and applying your skills to something that genuinely matters, this could be a great opportunity to make a real difference. What you’ll be doing • Designing, building and optimising scalable data pipelines and processing systems, from data acquisition and transformation through to delivery. • Working with large volumes of clinical and genomic data, supporting data lineage, metadata capture, de-identification and integration with reference data. • Building and improving data solutions in AWS, applying cloud-first engineering practices and making effective use of storage, compute and orchestration technologies. • Working with tools such as Python, RDBMS, Prefect, Tableau, Semarchy, Aspera and Globus across data orchestration, visualisation, data management and secure data transfer. • Developing and optimising data models, storage solutions and data products for performance, scalability, security, cost and reliable data delivery. • Improving data quality, testing, automation and observability, helping ensure pipelines and services are reliable, maintainable and fit for purpose. • Working closely with engineering, QA, architecture, product and other specialist teams to deliver well-integrated data services. • Supporting machine learning and data visualisation capabilities by enabling trusted, well-structured data. • Sharing knowledge, promoting good engineering practices and helping strengthen data engineering capability across the chapter and wider organisation. What you’ll bring • Proven hands-on experience designing, building and optimising data pipelines and large-scale processing systems, including ETL and ELT. • Strong practical experience with AWS and cloud-based data engineering, including relevant storage, compute and orchestration technologies. • Strong coding skills using Python, alongside experience with testing, CI/CD and infrastructure as code. • Experience developing data models and delivering reliable data products, with a good understanding of data engineering patterns and practices. • A sound understanding of data quality, data lineage, metadata management and data governance. • Experience working with sensitive data in regulated environments, with a good understanding of security, performance, scalability and compliance considerations. • Experience working with genomic, bioinformatics, clinical or other complex he