Job summary

Azure Data Engineer

Key skills required for this role

Azure Data Engineer

Important

Azure Data Engineer

Job description

Overview

We are seeking a highly skilled Azure Data Engineer to join our growing team. The ideal candidate will have strong experience in Python development, CI/CD automation, and hands-on exposure to Azure data services. This role requires a mix of software engineering discipline and data platform knowledge, with a focus on building scalable, reliable, and observable data solutions in the cloud.

---

Key Responsibilities

• Develop and maintain robust Python-based data engineering solutions.

• Write comprehensive unit and integration tests using Pytest.

• Contribute to CI/CD pipelines and DevOps practices using Azure DevOps or GitLab.

• Automate deployment and monitoring of data workflows and services.

• Query and manipulate data using SQL and optimize performance where required.

• Work with containerized dev environments using VS Code and Dev Containers.

• Implement observability features using OpenTelemetry.

• Collaborate with cross-functional teams to design and build data pipelines and APIs.

• Leverage Azure tools for monitoring, access control, and governance.

---

Core Skills (Essential)

• Strong Python programming skills

• Experience with Pytest for testing

• Exposure to OpenTelemetry for observability/logging

• Experience using Poetry for dependency management

• Comfortable working with VS Code, especially in Dev Containers

• Solid SQL querying skills

• CI/CD experience with tools such as Azure DevOps (ADO) or GitLab

• Knowledge of pipeline automation and orchestration