Our client, a leading organisation within the technology sector, is seeking a Data Engineer to join its team on a permanent basis. The role will focus on designing and maintaining scalable Azure data platforms, developing robust data pipelines and supporting data-driven solutions across the business.
Key Responsibilities:
- Design, develop and maintain scalable data pipelines and integration solutions using Azure.
- Build and optimise ETL and ELT processes with Azure Data Factory, Databricks and Synapse Analytics.
- Manage and enhance data lakes, data warehouses and storage solutions, including Azure Data Lake Storage.
- Develop and optimise SQL queries, data models and database objects for performance and scalability.
- Ensure data quality, security, governance and compliance with organisational standards.
- Implement CI/CD practices and support deployment automation through Azure DevOps or GitHub.
- Monitor, troubleshoot and resolve data platform and pipeline issues.
- Collaborate with stakeholders, analysts and developers while maintaining technical documentation, data dictionaries and operational procedures.
Job Requirements:
- Experience in Data Engineering, database development or data integration, with hands-on knowledge of Microsoft Azure data services.
- Strong experience with Azure Data Factory, Azure Databricks, Azure Synapse Analytics and Azure Data Lake Storage.
- Advanced SQL development and performance tuning skills, including experience with Azure SQL Database and SQL Server.
- Proficiency in Python, PySpark, Scala and Spark for data processing and distributed computing.
- Understanding of data warehousing concepts, dimensional modelling and ETL/ELT frameworks.
- Knowledge of data quality, data governance, metadata management and data security principles.
- Experience with CI/CD pipelines using Azure DevOps or GitHub, along with an understanding of cloud architecture.
- A bachelor's degree in Computer Science, Information Technology, Data Engineering or a related discipline; Microsoft Azure certifications such as DP-203 or AZ-900 would be advantageous.
Desirable Skills:
- Experience with Microsoft Fabric and Azure Database services.
- Knowledge of big data technologies, streaming solutions and modern data architecture patterns.
- Relevant Microsoft certification, such as Azure Data Engineer Associate, Azure Fundamentals or Azure Database Administrator Associate.
Benefits:
- Permanent opportunity within a forward-thinking technology environment.
- Access to professional development and Microsoft Azure training opportunities.
- Opportunity to work with modern cloud data platforms and large-scale data solutions.
- Collaborative working environment with opportunities to contribute to continuous improvement initiatives.
If you are an experienced Data Engineer with expertise in Azure, Databricks, Spark, SQL, Scala and Python, apply now to develop your career while delivering innovative data solutions.
