Skip to Main Content
Location icon
Richmond

Data Engineer

The National Archives
Office & Professional
Office & Professional
£43,367/Year
Full-time, Entry Level
Company logo image
Description

Location
Richmond, with a combination of onsite and home working. Applicants should be able to regularly travel to our Kew site for a minimum of 60% of their work time.

Hours
Full Time. Requests for part-time working, flexible working and job share will be considered, subject to operational needs.

Salary
£43,367 per annum, plus a £12,563 contribution towards membership of the Civil Service Defined Benefit Pension scheme.

About the Role
Shape the future of the nation’s memory by joining The National Archives as a Data Engineer within our dynamic Digital Archiving team. You will help transform how archival data is managed, structured, and enriched, unlocking its value for public use and discovery. This role offers the opportunity to work with a modern tech stack including Python, SQL, Shell scripting, Talend, XSLT, XML, CSV, JSON, RDF, RDBMS, NoSQL, and graph databases. You will design and build scalable data pipelines, automate data processing, and develop tools for data enrichment and integration. Your work will directly support the preservation and accessibility of the UK’s documentary heritage, including a new Parliamentary Archives project. We foster a collaborative environment where your ideas are valued and your professional growth is supported through ongoing learning opportunities and involvement in an active internal data community.

What You’ll Do
- Design and develop scalable, repeatable data pipelines (ETL/ELT) to process, transform, and load archival data
- Automate data cleansing, validation, standardisation, and enrichment
- Develop and document schemas, ontologies, and models for archival data
- Integrate data from diverse sources and formats to support better discovery and reuse
- Collaborate with product teams, archivists, and developers to deliver practical, data-centric solutions
- Contribute to a culture of openness, quality, and continuous improvement

Requirements

Experience
- Strong experience in accurate, reliable, large-scale analysis and manipulation of complex datasets using relevant programming languages and tools such as Shell scripting, SQL, or XSLT
- Practical knowledge of database technologies including RDBMS, NoSQL, graph databases, or linked data stores
- Excellent analytical skills with a structured and proactive approach to solving technical problems
- Ability to apply a range of techniques to capture, document, and communicate requirements, issues, designs, and solutions
- Strong relationship building and communication skills with an excellent user focus, able to work collaboratively in multidisciplinary teams and explain technical issues clearly to non-technical colleagues
- Ability to work with high accuracy, attention to detail and organisation, both independently and as part of a project team
- Ability to prioritise competing tasks and deliver high-quality work to agreed deadlines

About You
- Passionate about data and eager to learn
- Keen to make a real impact in digital archiving
- Comfortable working in a collaborative, forward-looking team environment
- Willingness to travel regularly to the Kew site and work flexibly as required

Qualifications and Additional Requirements
- SC clearance or willingness to obtain SC clearance is required; candidates must have been resident in the UK for at least the past five years
- Desirable knowledge includes working with different data formats (XML, CSV, JSON, RDF), awareness of archival data value and ethical responsibilities, understanding of probabilistic or uncertain data handling, experience in Agile development environments, and familiarity with archival principles or metadata standards such as EAD, ISAD(G), or Dublin Core

Expiry date: 15/10/2026
Data Engineer
Company:
The National Archives
Salary:
£43,367/Year
Job Type:
Full-time, Entry Level
Location:
Richmond