Location
London

Hours
Full Time

Salary
Negotiable

About the Role
Are you passionate about solving complex data challenges and building innovative data solutions using cutting-edge tools like Microsoft Fabric, Azure, Google, and AWS? This role offers the opportunity to design, build, and optimize data pipelines and storage solutions within Microsoft Fabric, Azure Synapse, Azure Data Factory, and Azure Fabric. You will develop and fine-tune PySpark notebooks to efficiently manage large-scale data workloads and implement, troubleshoot, and enhance ETL/ELT workflows. Managing Data Lakes for seamless access and high performance will be a key responsibility.

Integration of AI/LLM models, Copilot agents, Power Automate flows, and Power Platform solutions into data pipelines and business processes will drive innovation and deliver actionable insights. You will support testing and validation of AI-enabled solutions, document issues, and escalate risks as needed. Building and supporting automation workflows using Power Automate, Power Apps, and related Power Platform capabilities to streamline operations and improve data capture is essential.

Collaboration with business teams, data experts, AI engineers, data analysts, and domain experts will be critical to creating powerful, data-driven solutions. You will also participate in data security, governance, and compliance initiatives within the Azure and Microsoft Fabric ecosystem. The role involves gathering, integrating, and transforming data from multiple sources, including REST APIs, while handling large data volumes reliably.

Continuous learning and knowledge building in cloud platforms, AI, and modern data engineering practices through hands-on work, mentoring, and self-learning are encouraged. This is a fast-paced, collaborative environment where your contributions directly impact business outcomes and your career growth.

Experience
- Solid hands-on Data Engineering experience with proven competency in Cloud Data Tools, especially Microsoft Fabric
- Strong programming skills in Python
- Experience designing, optimizing, and maintaining data pipelines and storage solutions
- Hands-on experience working with APIs, including consuming REST endpoints, handling authentication, parsing JSON responses, and integrating API data into data pipelines
- Experience with Copilot agents, AI tools, Power Automate, and the broader Microsoft Power Platform is highly preferable

About you
- Exceptional problem-solving abilities and expertise in debugging complex data issues
- Genuine excitement for working with data and driving meaningful business outcomes
- Curiosity and passion for understanding how systems are built and operate
- Excellent communication skills and a collaborative, team-oriented mindset

Qualifications
- Solid understanding of data warehousing, modeling, and basic data architecture, either through experience or education
- Relevant certifications, learning paths, or hands-on projects in Microsoft Fabric, Azure Data Engineering, Power BI, Power Automate, Python, or SQL are a plus
- Experience with real-time streaming solutions like Azure Stream Analytics, Kafka, or Event Hubs is advantageous
- Familiarity with Databricks and its integration with Azure Synapse and Microsoft Fabric is beneficial
- Knowledge of Graph Databases and NoSQL technologies is desirable
- Understanding of AI/LLM applications and their integration with data pipelines, Copilot agent workflows, Power Automate flows, and Power Platform-based automation is a bonus