Senior Data Engineer
| Posting date: | 22 April 2025 |
|---|---|
| Salary: | £44,720 to £52,130 per year |
| Additional salary information: | New entrants to the Civil Service will start their role on the salary band minimum: £44,720 for National Roles. £48,720 for London Roles. You may be eligible for an additional non-pensionable allowance, pending a Capability and Skills Assessment, with a |
| Hours: | Full time |
| Closing date: | 01 May 2025 |
| Location: | Glasgow |
| Company: | Government Recruitment Service |
| Job type: | Permanent |
| Job reference: | 402110/2 |
Summary
Data Services and Analytics (DSA) is the part of DDaT which leads the build of data products to integrate data from multiple sources, and then deliver products for business intelligence, reporting and data science. DSA has the ambition to be one of the leading providers of insight services in UK Government and is currently growing significantly with over 300 colleagues, providing services to variety of functions within the Home Office.
In this role, you will identify and deliver new data sources and develop ETL processes, collaborate with the Data Acquisition, Analytics and Infrastructure teams to deliver the data strategy through the design and implementation of technology systems. We value diversity and provide an open, inclusive, and supportive environment to help you do your best work.
The successful candidate will either be located in: 2 Ruskin Square – Croydon, 3 Northgate – Glasgow, The Capital - Liverpool, Soapworks – Manchester or Vulcan House regional office Sheffield.
Under Home Office hybrid working practices there is an expectation that you will attend the office for a minimum of 60% of your working hours. Therefore, this role is not suitable for part-time working due to the nature of the role.
The Senior Data Engineer positions in the Data Services and Analytics (DSA) team require support development of complex data pipelines, ingesting and transforming data from/to a variety of sources (email, csv, ODBC/JDBC, JSON, XML, Excel, Avro, Parquet). Data pipelines are primarily developed in AWS using a variety of tools and languages including AWS S3, AWS Athena, AWS Redshift, AWS Glue, python and java (Docker / Spring).
Tasks and responsibilities will include:
- Developing new data models working collaboratively with the analytics team and mapping data to an appropriate target data model.
- Identifying issues in data pipelines and managing their resolution.
- Designing, building and testing data integration solutions that are complex or large scale, through full development, test and deployment lifecycles.
- Continually improving processes and efficiency in the acquisition and ingestion of data.
- Engaging with customers and business analysts to define new features and communicating progress.
- Ensuring the successful and timely delivery of data to customers, Data Analysts and Data Scientists.
Proud member of the Disability Confident employer scheme