Location
Kingston Upon Thames, South West London

Hours
Full Time

Salary
£46,968 per annum

About the Role
The Data Engineer will join the Corporate Data Service, playing a key role in delivering the data strategy. You will lead platform development by building and maintaining the AWS-based data platform that integrates data from multiple systems. Your responsibilities include engineering scalable data pipelines, APIs, and ETL/ELT processes to connect operational systems with data platforms. You will lead complex data engineering projects, managing both internal and external partners. Collaboration is essential as you work closely with data scientists, analysts, and service leaders to develop data products and services that provide continuous insights for staff and residents. Additionally, you will drive data quality by extracting, cleaning, and combining data across the organisation, establishing rigorous standards to ensure data is a trusted asset for decision-making.

This role reports directly to the Head of Data. The position supports hybrid working arrangements, though it is not fully remote. The successful candidate will have the opportunity to grow, learn, and help set the direction of a new and evolving data service that supports ambitious transformation programmes for the Royal Borough of Kingston upon Thames and the London Borough of Sutton. The service plays a vital role in supporting each council’s AI and digital ambitions and aims to promote a data-driven culture at all organisational levels.

Experience
- Proven experience leading complex data engineering projects in an agile environment.
- Strong skills in Python and SQL/NoSQL.
- Significant experience with AWS cloud services such as Redshift, Athena, Lambda, and S3.
- Experience working with complex datasets and automating manual processes to improve efficiency and cost-effectiveness.
- Knowledge of data security, GDPR, and data protection regulations, especially regarding sensitive data.

About You
- Collaborative and adaptable engineer eager to grow within a new data service.
- Passionate about solving complex problems and building efficient, reliable data systems.
- Excellent communicator able to explain technical concepts to diverse audiences and build strong stakeholder relationships.
- Innovative and proactive in learning new technologies and automating processes.
- Committed to fostering a data-driven culture and championing data governance.

Qualifications
While specific qualifications are not detailed, candidates should demonstrate relevant technical expertise, project leadership experience, and a strong understanding of data governance and cloud platforms.