Location
One New Change, London, EC4M 9AF

Hours
Monday to Friday, 09:00-17:30 - Hybrid working (3 days in office per week)

Salary
Negotiable

About the Role
At CDW, we make it happen, together. Trust, connection, and commitment are at the heart of how we work to deliver for our customers. We are coworkers, not just employees, who support one another and bring positive, success-driven attitudes. Join us to bring your best true self and ideas to a team that values diverse perspectives and continuous learning.

As a Senior Data Engineer within the Enterprise Data department, you will lead and carry out data engineering activities focused on data platforms and services. You will manage and guide a team of Data Engineers, designing and developing homogenous data repositories to enable data-led decision making.

Your responsibilities will include ingesting data from multiple sources such as on-premise SQL databases, REST APIs, and Apache Kafka streams; applying cleansing rules to ensure data quality; and modelling data into single source of truth Kimball datasets for Business Intelligence, Machine Learning, Data Science, and AI applications.

You will apply a DevOps approach to software development and support, including building high-quality code, unit and integration testing, CI/CD pipelines, and monitoring business-critical data pipelines to meet time and quality expectations. You will also drive agile ways of working, translating user requirements into technical solutions, and continuously improving processes.

Additional duties include documenting datasets in the data catalogue, ensuring compliance with data governance and legislation such as GDPR, supporting all data platforms for smooth operation, and performing ad-hoc analysis of structured and unstructured data to inform solution design and decision-making.

CDW is committed to fostering an AI-fluent culture, encouraging curiosity, experimentation, and responsible integration of AI technologies to enhance human creativity and decision-making.

Experience
- Minimum 7 years as an Engineer in a Data Field
- Strong Azure data skills including Azure Data Factory V2, Azure Data Lake Storage V2, Azure Databricks, Azure Function Apps & Logic Apps, Azure Stream Analytics, and Azure Resource Manager (Terraform, Azure Portal, Az CLI, Az PowerShell)
- Proficient in PySpark, Delta Lake, Unity Catalog, and Python, including unit and integration testing frameworks such as unittest and pytest
- Solid understanding of software development practices including SOLID principles, code structuring, testing, and IOC
- Experience with repositories and CI/CD pipelines
- Strong knowledge of Kimball data modelling techniques such as star schema and snowflake
- Advanced SQL and data analysis skills
- Excellent written and verbal communication skills
- Proven ability to manage competing pressures and deadlines while maintaining attention to detail and quality
- Passion for technology and its positive impact on business

About You
You are a motivated and experienced data engineering professional who thrives in a collaborative environment. You bring leadership skills to guide and develop your team, a learner’s mindset to adapt to evolving technologies, and a passion for delivering high-quality data solutions. You embrace AI as a partner in innovation and are eager to contribute to a culture of continuous improvement and responsible AI adoption.

Qualifications
Nice to have:
- Experience with Azure DevOps (git, multistage YAML)
- Knowledge of additional languages such as C# and PowerShell
- Infrastructure as Code (IaC) experience with Terraform, ARM, Bicep
- Test Driven Development (TDD)
- Streaming technologies like Azure Stream Analytics and Spark Structured Streaming
- Power BI engineering experience
- Certified SCRUM Developer (CSD)
- Experience with Data Governance tools such as Purview
- Familiarity with Machine Learning and Artificial Intelligence concepts