Data Engineer
Posting date: | 01 May 2024 |
---|---|
Salary: | £36,585 to £41,834 per year |
Additional salary information: | Plus a £5000 Digital, Data and Technology (DDaT) pay supplement after a 3 months DDaT competency qualifying periodlus |
Hours: | Full time |
Closing date: | 15 May 2024 |
Location: | Glasgow or Dundee |
Remote working: | Hybrid - work remotely up to 3 days per week |
Company: | Scottish Government |
Job type: | Permanent |
Job reference: | ID2024-8809 |
Summary
Salary -£36,585-£41,834 plus a £5000 Digital, Data and Technology (DDaT) pay supplement after a 3 month qualifying period
Location - Dundee or Glasgow
Hours - 37 hours per week
Closing Date - 15th of May 2024 at 23:55
Reference - ID2024-8809
Employment Type - Permanent
Overview
Join our team at Social Security Scotland as a Senior Data Engineer and play a pivotal role in driving our data initiatives. Collaborate closely with a talented team, emphasising effective teamwork to deliver high-quality and consistent results. As a data enthusiast, you will have the opportunity to leverage cutting-edge AWS services to harness the power of data, ensuring its accuracy, reliability, and security. Make an impact by contributing to the design, development, and optimisation of our data infrastructure, enabling us to provide essential services to the people of Scotland.
Social Security Scotland, an Executive Agency of the Scottish Government, is undertaking the largest and most complex IT and digital change programme since devolution. With a lifetime budget of over £300m, Social Security Scotland is delivering a social security system that will support the people of Scotland for decades to come. Due to the demands of this exciting programme of work, the Agency is currently experiencing rapid growth and we require more incredible digital experts to join us to help realise our ambitions.
The Data Engineer role will sit within Social Security Scotland’s Chief Digital Office(CDO), which has a remit to provide data infrastructure and systems to support both the wider social security programme and Social Security Scotland, including:
• Engineering & Cloud Services
• Architecture
• Technologies and Platforms
• Digital Risk and Cyber Protection
• Operational Delivery and Capability
• Service Management & Service Development
We aim to develop within Social Security Scotland, a positive and inclusive culture,which supports our people to flourish, by embedding a working environment where we all treat each other with dignity and respect, and recognise each other’s contributions.
DDaT Pay Supplement
This post attracts a £5000 Digital, Data and Technology (DDaT) pay supplement after a 3 months DDaT competency qualifying period. The payment will be backdated to your start date in the role. Pay supplements are temporary payments designed to address recruitment and retention issues caused by market pressures and are subject to regular review. This post is part of the Scottish Government DDaT profession. As a member of the profession you will join the professional development system, currently BCS Role Model plus.
Main Duties
The data engineer will design and lead the implementation of data flows to connect operational systems, data for analytics and BI systems.
You will:
• Design and implement data architecture, data model, databases, data pipelines and ETL processes.
• Integrate data from various sources and ensuring data consistency, accuracy and quality.
• Perform data transformation and normalisation tasks to make the data usable for analysis and reporting purposes.
• Build and maintain data pipelines to efficiently move and process data between different systems and platforms.
• Tune and optimise data processing systems and queries to ensure efficient and high performance data operations.
• Identify and resolve data-related issues, ensuring system availability, and performing regular maintenance tasks.
• Stay up to date with the latest advancements in data engineering, exploring new tools, frameworks, and technologies to improve data processing efficiency and scalability.
• Implement data flows to connect operational systems, data for analytics and business intelligence (BI) systems.
• Document source-to-target mappings.
• Re-engineer manual data flows to enable scaling and repeatable use.
• Support the build of data streaming systems.
• Write ETL scripts and code to make sure the ETL process performs optimally.
• Build accessible data for analysis.
Further Information
Social Security Scotland are a Disability Confident Employer. We will consider and implement any reasonable adjustments you may require throughout the recruitment process and during the course of your employment, should you be successful in securing a post. If you feel you may require assistance with any part of our recruitment process, please contact us at Recruitment@socialsecurity.gov.scot.