Location
Elgin Ave., London

Hours
Full Time

Salary
£67,500 per annum

About the Role
If you’re interested in making a difference to people’s lives, HM Treasury offers an exciting opportunity to influence decision making that affects the whole of the UK. Working at the heart of government, you will collaborate across departments to promote responsible public spending and drive strong and sustainable economic growth. Our work ranges from regulating the financial sector, reducing carbon emissions, creating a greener economy, to promoting British trade and supporting jobs and growth nationwide. Based at the Darlington Economic Campus, a cross-government hub, you will work closer to the communities we serve.

As a Lead Data Engineer, you will work on a variety of data engineering projects, maintaining and developing data products used by a wide range of HM Treasury staff. Improving these products will increase productivity across the department. You will work within a team of data professionals supporting a broad portfolio of projects and maintain strong relationships with customers within HM Treasury and beyond.

Key responsibilities include acquiring data sets from multiple sources at varying levels of maturity, exposing data from systems such as APIs, linking data from multiple systems, and delivering streaming services. You will collaborate to identify and plan these services and review specifications. You will maintain and develop data products aligned with HM Treasury’s data strategy, leveraging your expertise in Python and cloud systems to ensure reliability and rapid issue resolution.

You will produce data models, understand appropriate use of different types, and apply industry-recognised data-modelling patterns. You will design, code, and test programs and scripts for data engineering, developing resilient, scalable, and future-proof services to meet user needs. You will also scope and carry out other projects including web app development and data engineering, exploring innovative opportunities to improve organisational performance and influence data architecture.

Promoting best practice in data engineering, including data acquisition, storage, and sharing for modelling and policy development, you will provide technical leadership and development opportunities across HM Treasury’s Data Hub. You will contribute to the growth of the Data Hub through sharing work, pair programming, and contributing process ideas.

Experience
- Strong experience using Python for data engineering and web app development
- Expertise in SQL
- Considerable experience with at least one major Cloud provider (Azure preferred; Google Cloud or AWS acceptable)
- Proven experience designing and building robust back-end systems such as data pipelines, services, or orchestration layers that are scalable, secure, and maintainable
- Experience applying technical governance and controls to complex systems, including logging, monitoring, auditability, access management, and safe data interaction
- Experience successfully implementing a product and managing customer relationships, acting on feedback and applying good product management practices

About you
- Ability to translate organisational or user needs into effective technical solutions, working collaboratively with non-technical colleagues such as policy, analytical, or operational teams
- Ability to provide credible technical leadership and advice, explaining complex concepts clearly, promoting good engineering practice, and supporting others to adopt solutions safely and confidently
- Innovative mindset with the ability to explore new ways of conducting business and organisational processes

Qualifications
- Desirable: Experience making pipelines and data warehousing with Microsoft Fabric
- Desirable: Experience developing apps with Plotly Dash, Streamlit, and/or Chainlit
- Desirable: Experience using LLM and Embedding APIs, with a strong understanding of their operation