Lead Data Engineer
| Posting date: | 03 June 2025 |
|---|---|
| Salary: | £60,300 to £70,730 per year |
| Additional salary information: | National Min £60300 - Max £66330 London Min £64300 - Max £70730 New entrants to the Civil Service will start their role on the pay range minimum: £60,300?for national roles. You may be eligible for an additional non-pensionable allowance, pending a Capab |
| Hours: | Full time |
| Closing date: | 16 June 2025 |
| Location: | Manchester |
| Company: | Government Recruitment Service |
| Job type: | Permanent |
| Job reference: | 408946/4 |
Summary
Data Services and Analytics (DSA) is the part of DDaT which leads the build of data products to integrate data from multiple sources, and then deliver products for business intelligence, reporting and data science. DSA has the ambition to be one of the leading providers of insight services in UK Government and is currently growing significantly with over 300 colleagues, providing services to variety of functions within the Home Office.
In this role, you will identify and deliver new data sources and develop ETL processes, collaborate with the Data Acquisition, Analytics and Infrastructure teams to deliver the data strategy through the design and implementation of technology systems.
We value diversity and provide an open, inclusive, and supportive environment to help you do your best work.
The successful candidate will either be located in 2 Ruskin Square – Croydon, Soapworks - Manchester, Vulcan House - Sheffield, regional office. Under Home Office hybrid working practices there is an expectation that you will attend the office for a minimum of 60% of your working hours. Given the nature and responsibilities of this role, this is not suitable for part-time arrangements.
There are three positions to lead a team of data engineers working on complex data pipelines, ingesting and transforming data from/to a variety of sources (email, CVS, ODBC/JDBC, JSON, XML, Excel, Avro, Parquet). Data pipelines are primarily developed in AWS using a variety of tools and languages including AWS S3, AWS Athena, AWS Redshift, AWS Glue, python and java (Docker / Spring).
What you do
As a lead Data Engineer, you will showcase a true passion for data and exhibit expertise in the following areas:
- Manage data sources effectively to improve data quality and make them suitable for analysis.
- Drive and develop new data models and ETL processes, working collaboratively with the analytics team and mapping data to an appropriate matching data model.
- Utilise essential key stakeholder management skills to effectively manage expectations, actively listen and interpret business needs, communicate progress, and navigate challenging conversations, all while fostering a service orientated culture around data.
- Managing the performance of suppliers and the data team to improve capability, as well as creating the roadmap which balances immediate user needs with long-term investment.
- Developing processes to balance data availability, capacity and data archiving, while continually improving processes and efficiency in the acquisition and ingestion of data.
- Identifying data issues in data pipelines and managing their resolution.
- In one of the positions the successful candidate will be responsible for upskilling staff to transition to a new platform. Experience with Oracle is a plus. They must also have leadership experience, including coaching and professional development skills.
Proud member of the Disability Confident employer scheme