Lead Data Engineer

SR2 have just partnered with a UK based consultancy who are urgently looking to hire several Lead Data Engineers. Location: Central London (2 - 3 days a week onsite). Salary: £95,000 - 105,0000 (dependant on experience). Tech / Tools: Python, PySpark, SQL, ELT, Azure DataBricks, Data Factory, Snowflake, CI/CD. Key responsibilities: Lead technical delivery of strategic programmes, taking ownership for designing and building innovative data solutions. Work with the data engineering team to help deliver key projects on time. Create robust, performant data pipelines. Work on messy, complex real-world data challenges. Implement CI/CD practices for data pipelines to improve efficiency and quality of data processing. Demonstrate strong programming / scripting skills in Python. Build robust ETL processes to extract, transform, and load data from diverse sources. Ensure data integrity, security, privacy, and compliance across all data workflows. Continuously monitor system performance and implement strategies to enhance efficiency. You can expect to get involved in variety of projects in the cloud (AWS, Azure, GCP). Support in setting the direction and vision of the Data Engineering team. Ideal background: 6 years in a Data Engineering position. Excellent knowledge of PySpark, Python and SQL fundamentals. Good experience with Azure DataBricks, Data Factory, Snowflake, CI/CD. Ability to work on messy, complex real-world data challenges. Experience working for a consultancy / large organisation would be a big plus. Must have strong client-facing experience. Be comfortable working in a fast-paced environment, working across several different projects. You must be eligible for SC clearance. If interested, please apply with your updated CV and we’ll line up a call to discuss the details. Look forward to hearing from you all

Location: London, GB

Posted Date: 2/2/2025