Job Description
Data Engineer (Databricks / Microsoft Fabric) - Goldthorpe
Permanent - £55k-£65k
Hybrid (3 days office / 2 WFH)
Early Friday finish (1:30pm)
Our client is building a modern hybrid data platform across Databricks and Microsoft Fabric, replacing legacy data workflows with a scalable, cloud-first architecture. The focus is on delivering reliable, well-modelled data products that support analytics, reporting, and operational decision-making across the business.
This is a hands-on Data Engineering role within an established in-house data team (20+ engineers, analytics engineers, and graduates). You’ll work across ingestion, transformation, and data modelling helping shape how data is delivered and consumed across the organisation.
Key Responsibilities
- Design and build scalable data pipelines using Azure Data Factory and Databricks
- Develop and maintain data workflows within a hybrid Databricks / Microsoft Fabric environment
- Ingest and integrate data from multiple operational systems into a centralised data platform
- Build system-to-system integrations (batch and near real-time where applicable)
- Design and implement data models to support Power BI and analytics workloads
- Contribute to data platform migration and modernisation initiatives
- Support CI/CD processes for data pipelines using Azure DevOps tooling
- Collaborate closely with analytics engineers, BI developers, and business stakeholders
- Use modern development tools (including AI-assisted coding tools where appropriate)
- Ensure data quality, performance, and reliability across the platform
Skills & Experience Required
- Strong experience with Azure Data Factory (ADF) and SQL
- Hands-on experience with Databricks and/or Microsoft Fabric (Lakehouse preferred)
- Strong Power BI experience (data modelling and/or semantic layer exposure ideal)
- Experience building data integrations across multiple source systems
- Solid understanding of data modelling concepts (star schema, dimensional modelling, etc.)
- Experience working in Azure cloud data environments
- Familiarity with CI/CD practices using Azure DevOps / Visual Studio / Git
- Experience on data platform migration or modernisation programmes
- Comfortable working across ingestion, transformation, and reporting layers