Location
Primarily remote with flexibility to travel to client sites and offices in London, Sheffield, and Bristol.

Hours
Full Time

Salary
Competitive salary offered

About the Role
Methods Analytics (MA) is seeking a Senior Fabric Engineer to join our Public Sector Business unit on a permanent basis. In this role, you will collaborate closely with cross-functional teams to translate complex technical concepts into clear, accessible language for non-technical audiences, aligning data solutions with business needs. You will work with a dynamic delivery team on innovative projects, transforming raw data into powerful insights that influence strategic decisions and drive business transformation.

You will utilise platforms and tools such as Microsoft Fabric, Azure Data Factory, Azure Synapse, Databricks, and Power BI to build robust, scalable, and future-proof end-to-end data solutions. Your responsibilities include designing and implementing efficient ETL and ELT pipelines, developing and maintaining sophisticated data models using dimensional modelling techniques, and ensuring seamless integration and transformation of data from various sources.

Maintaining best practices in data governance, security, and compliance using tools like Azure Purview, Unity Catalog, and Apache Atlas will be essential to uphold data integrity and trust. You will ensure data quality through rigorous QA processes and optimise data queries for performance and cost-efficiency. Additionally, you will develop intuitive and visually compelling Power BI dashboards to provide actionable insights to stakeholders.

Monitoring and tuning solution performance, identifying optimisation opportunities, and staying ahead of industry trends by continuously enhancing your skills and incorporating the latest data engineering tools and methodologies are key aspects of this role. You will play a pivotal role in cultivating a data-driven culture, mentoring team members, and contributing to the continuous improvement of the Engineering Practice.

Experience
- Proficiency in SQL and Python for handling complex data problems.
- Strong understanding of Data Lakehouse architecture principles and implementation.
- Hands-on experience with Spark-based platforms such as Azure Synapse, Databricks, Microsoft Fabric, or on-premise Spark clusters using PySpark or Spark SQL.
- Expertise in building robust ETL and ELT pipelines, primarily in Azure using Azure Data Factory and Spark-based solutions.
- Skilled in writing and optimising cost-effective, high-performing queries.
- Experience developing insightful and interactive Power BI dashboards.
- Proficiency in dimensional modelling techniques for effective data modelling.
- Familiarity with Continuous Integration and Continuous Deployment (CI/CD) environments.
- Ability to translate business requirements into precise technical specifications.
- Strong communication skills to convey complex technical topics clearly to non-technical audiences.
- Commitment to continuous learning and staying current with industry trends, tools, and technologies.

About You
You are a proactive and collaborative professional who thrives in a dynamic environment. You have a passion for data innovation and enjoy mentoring others. You are adaptable, detail-oriented, and committed to delivering high-quality data solutions that drive business success. You are willing to undergo Security Clearance and comply with associated onboarding requirements.

Qualifications
While not mandatory, the following skills and experiences are desirable:
- Exposure to Microsoft Fabric and its capabilities.
- Experience managing high-performance data systems handling large-scale datasets (e.g., billions of records or terabyte-sized databases).
- Knowledge of Delta Tables or Apache Iceberg for efficient data lake management.
- Familiarity with data governance tools such as Azure Purview, Unity Catalog, or Apache Atlas.
- Experience with streaming/event-based technologies like Kafka, Azure Event Hub, and Spark Streaming.
- Understanding of SOLID principles in object-oriented programming.
- Familiarity with Agile development methodologies such as SCRUM.
- Awareness of recent innovations including GenAI, RAG, Microsoft Copilot, and relevant certifications in cloud, data science, AI, and ML.
- Experience working with data tailored for data science, AI, and ML applications.
- Experience working with public sector clients and understanding their specific requirements.

This role requires candidates to have or be willing to obtain Security Clearance, including completion of the Baseline Personnel Security Standard as part of onboarding. Employment may be delayed or rejected if clearance criteria are not met; details will be discussed during the interview process.