Warning
This job advert has expired and applications have closed.
Data Engineer
| Posting date: | 12 March 2025 |
|---|---|
| Salary: | £427.77 per day |
| Hours: | Full time |
| Closing date: | 11 April 2025 |
| Location: | Westminster, South West London |
| Remote working: | Hybrid - work remotely up to 1 day per week |
| Company: | Raynet Recruitment Ltd |
| Job type: | Temporary |
| Job reference: | RQ1487223 |
Summary
36 Hours a week
Location: Hybrid (with office presence in Westminster, London)
£427.77 a Day / Umbrella Rate
SCREENING QUESTIONS
To be considered for this role, please confirm:
-Do you have extensive experience creating scalable, reusable pipelines built on cloud services?
-Have you worked with Synapse and/or InfluxDB for pipeline development?
-Do you have experience working with data platforms, including IoT data?
-Are you available to start work on 31/03/2025?
About Us
At Westminster City Council, we are committed to delivering innovative and efficient services for our residents, businesses, and visitors. As part of our Smart City operating system, we are expanding our data capabilities to transform service delivery, ensuring we remain at the forefront of digital excellence.
The Role
As a Data Engineer, you will play a pivotal role in shaping how data is harnessed to drive decision-making and enhance services across the council. You will work within a dedicated product team, designing and developing high-quality data solutions that ensure data integrity, accessibility, and scalability.
You will be responsible for building and running data products and services that generate high-quality insights, supporting the council’s mission to use data effectively in service delivery. This is an exciting opportunity to influence how a high-profile local authority utilizes data to benefit its residents and stakeholders.
Key Responsibilities
Develop, optimize, and maintain scalable data pipelines and architectures.
Ensure high data quality and availability, both internally and externally shared datasets.
Build and run data products to provide high-quality insights.
Work with modern data engineering tools and cloud-based technologies, such as Azure Data Factory, Synapse, and Snowflake.
Implement dimensional data models and work with SQL and NoSQL databases, including time-series databases like InfluxDB.
Utilize Python for data pipeline development and visualization.
Deploy applications using Docker and contribute to CI/CD pipelines.
About You
To succeed in this role, you will bring:
? Extensive experience in developing scalable, reusable data pipelines on cloud services.
? Strong cloud data engineering experience, particularly in Azure Data Factory, Synapse, and Snowflake.
? Proficiency in Python, SQL, and NoSQL databases, with a focus on time-series databases (e.g., InfluxDB).
? Knowledge of dimensional modeling and experience deploying applications using Docker.
? Familiarity with CI/CD operating models and best practices in data engineering.
Location: Hybrid (with office presence in Westminster, London)
£427.77 a Day / Umbrella Rate
SCREENING QUESTIONS
To be considered for this role, please confirm:
-Do you have extensive experience creating scalable, reusable pipelines built on cloud services?
-Have you worked with Synapse and/or InfluxDB for pipeline development?
-Do you have experience working with data platforms, including IoT data?
-Are you available to start work on 31/03/2025?
About Us
At Westminster City Council, we are committed to delivering innovative and efficient services for our residents, businesses, and visitors. As part of our Smart City operating system, we are expanding our data capabilities to transform service delivery, ensuring we remain at the forefront of digital excellence.
The Role
As a Data Engineer, you will play a pivotal role in shaping how data is harnessed to drive decision-making and enhance services across the council. You will work within a dedicated product team, designing and developing high-quality data solutions that ensure data integrity, accessibility, and scalability.
You will be responsible for building and running data products and services that generate high-quality insights, supporting the council’s mission to use data effectively in service delivery. This is an exciting opportunity to influence how a high-profile local authority utilizes data to benefit its residents and stakeholders.
Key Responsibilities
Develop, optimize, and maintain scalable data pipelines and architectures.
Ensure high data quality and availability, both internally and externally shared datasets.
Build and run data products to provide high-quality insights.
Work with modern data engineering tools and cloud-based technologies, such as Azure Data Factory, Synapse, and Snowflake.
Implement dimensional data models and work with SQL and NoSQL databases, including time-series databases like InfluxDB.
Utilize Python for data pipeline development and visualization.
Deploy applications using Docker and contribute to CI/CD pipelines.
About You
To succeed in this role, you will bring:
? Extensive experience in developing scalable, reusable data pipelines on cloud services.
? Strong cloud data engineering experience, particularly in Azure Data Factory, Synapse, and Snowflake.
? Proficiency in Python, SQL, and NoSQL databases, with a focus on time-series databases (e.g., InfluxDB).
? Knowledge of dimensional modeling and experience deploying applications using Docker.
? Familiarity with CI/CD operating models and best practices in data engineering.