Job summary

They are a company that provides critical data, network, and communications services to broadcasters, utilities, and other customers in the UK and around the world. you will be required to deliver upon a major transformation project.

Key skills required for this role

Data engineer/ Data/ Data Engineering/ Lead Data Engineer

Important

Lead Data Engineer

Job description

• base salary between £70k - £84k dependent on experience
• 10% Bonus
• 6% pension contribution
• Private Medical
• 25 days annual leave
• Access to our comprehensive flexible benefits including discounts on big brands, wellness and employee assistance programmes, gymflex, buy and sell annual leave, travel and dental insurance
• Work. Life. Smarter. Our commitment to a flexible and hybrid working culture

Key Responsibilities:

• Collaborate with data engineering manager, business analysts, data architects, and other stakeholders to understand business requirements and design the data lakehouse solution.
• Lead and mentor a team of data engineers and developers in building, testing, deploying, and maintaining scalable, reliable, and secure data pipelines and platforms.
• Implement data ingestion, processing, storage, and delivery systems using technologies such as Spark, Databricks, AWS, Kinesis, Kafka, Airflow, Glue, Qlik, Great Expectations, GitHub, CodePipeline, Terraform, and Python.
• Optimize the performance, reliability, and cost-efficiency of the data lakehouse solution.
• Troubleshoot and resolve any data-related issues to ensure data quality and integrity.
• Research and evaluate new technologies and trends in data engineering to propose innovative solutions.

Job Requirements:

• Bachelor's degree or higher in computer science, engineering, mathematics, statistics, or a related field.
• Proven experience in data engineering or a similar role, with significant expertise in Spark, GitHub, CI/CD, Python, and AWS technologies.
• Strong big data development background with experience building scalable, distributed, and fault-tolerant systems using microservices architecture and API strategy development.
• Excellent SQL skills and experience with various relational and non-relational databases.
• Preferably experienced with Databricks, Glue, Kafka, Airflow, Great Expectations, Qlik, Terraform, or related technologies.
• Excellent communication skills (both verbal and written) and the ability to present complex technical concepts clearly.
• Strong problem-solving and analytical thinking skills.
• Ability to work independently and collaboratively in a fast-paced environment.

Benefits:

• Competitive salary
• Opportunity to work on cutting-edge fintech and technology projects
• Professional development and training opportunities
• Supportive and innovative work culture
• Comprehensive benefits package

If you are a skilled Data Lead ready to take on a challenging and rewarding role, we would love to hear from you. Apply now to join our client's progressive team.