Data Engineer
| Dyddiad hysbysebu: | 01 Hydref 2025 |
|---|---|
| Cyflog: | Heb ei nodi |
| Gwybodaeth ychwanegol am y cyflog: | £45-50k |
| Oriau: | Llawn Amser |
| Dyddiad cau: | 31 Hydref 2025 |
| Lleoliad: | England |
| Cwmni: | The Compleat Food Group |
| Math o swydd: | Cytundeb |
| Cyfeirnod swydd: | 1353 |
Crynodeb
Job Advert
Job Title: Data Engineer
Location: Hybrid/Remote but with travel to national sites
Salary: £45-50k
Contract: 6-month FTC
About the Role
We are looking for an experienced Data Engineer to play a pivotal role in the deployment of our Trade Promotion Management (TPM)
system – UpClear BluePlanner.
This is a highly data-intensive programme where your expertise will ensure the right data flows seamlessly into and out of the
platform, supporting critical business activities such as forecasting, ROI calculations, accruals, and performance measurement.
If you thrive on building robust data pipelines, integrating complex systems, and enabling data-driven decision-making at scale,
this role is for you.
Key Responsibilities
Data Integration & Connectivity
* Build pipelines to ingest data from multiple sources including ERP (SAP, Oracle), CRM, POS/syndicated data providers (Nielsen,
IRI, Retail Link), and financial systems.
* Integrate with TPM platforms such as Salesforce TPM, SAP TPM, o9, Blacksmith, Eversight, and Anaplan.
Data Transformation & Mapping
* Harmonise product and customer hierarchies across systems.
* Apply business logic for promotion performance such as lift factors, cannibalisation, baseline vs incremental volume, and
accrual/ROI calculations.
Data Modelling & Storage
* Design and optimise data models for promotion master data, actuals vs forecasts, claim reconciliation, and ROI KPIs.
* Ensure data warehouse/lake performance supports reporting dashboards and AI/ML models.
Data Quality & Validation
* Develop validation rules to ensure data integrity (e.g., promotion timelines, duplicates, account-product checks).
* Create monitoring and logging frameworks for errors and mismatches.
Ongoing Maintenance & Enhancements
* Automate pipelines using tools such as Airflow, Azure Data Factory, or Informatica.
* Adapt models and flows as business requirements evolve.
* Collaborate with TPM analysts and business users to refine outputs and troubleshoot issues.
Skills, Experience & Knowledge
Essential
* 5+ years’ experience in a Data Engineering role (FMCG/manufacturing background highly desirable).
* Strong expertise in modern data platforms and cloud technologies (Azure preferred; AWS/GCP also considered).
* Proven hands-on experience with:
* Data lakehouse platforms (Databricks, Snowflake, etc.)
* ETL/ELT tools (dbt, Azure Data Factory, Airflow, Informatica, Talend)
* SQL and programming (Python, Spark)
* Real-time data streaming (Kafka, Azure Event Hub)
* Data quality tools (Great Expectations, dbt tests, custom frameworks)
* Strong understanding of ERP integration (Infor ION, REST/SOAP APIs, flat file interfaces).
* Experience with analytics platforms such as Power BI.
* Knowledge of DevOps, CI/CD, and infrastructure-as-code principles for data pipelines.
Why Join Us?
This is an exciting opportunity to make a real impact in a fast-paced, data-driven environment. You’ll be at the forefront of
shaping how we integrate, manage, and leverage data to drive smarter trade promotion strategies and better business outcomes.
Job Title: Data Engineer
Location: Hybrid/Remote but with travel to national sites
Salary: £45-50k
Contract: 6-month FTC
About the Role
We are looking for an experienced Data Engineer to play a pivotal role in the deployment of our Trade Promotion Management (TPM)
system – UpClear BluePlanner.
This is a highly data-intensive programme where your expertise will ensure the right data flows seamlessly into and out of the
platform, supporting critical business activities such as forecasting, ROI calculations, accruals, and performance measurement.
If you thrive on building robust data pipelines, integrating complex systems, and enabling data-driven decision-making at scale,
this role is for you.
Key Responsibilities
Data Integration & Connectivity
* Build pipelines to ingest data from multiple sources including ERP (SAP, Oracle), CRM, POS/syndicated data providers (Nielsen,
IRI, Retail Link), and financial systems.
* Integrate with TPM platforms such as Salesforce TPM, SAP TPM, o9, Blacksmith, Eversight, and Anaplan.
Data Transformation & Mapping
* Harmonise product and customer hierarchies across systems.
* Apply business logic for promotion performance such as lift factors, cannibalisation, baseline vs incremental volume, and
accrual/ROI calculations.
Data Modelling & Storage
* Design and optimise data models for promotion master data, actuals vs forecasts, claim reconciliation, and ROI KPIs.
* Ensure data warehouse/lake performance supports reporting dashboards and AI/ML models.
Data Quality & Validation
* Develop validation rules to ensure data integrity (e.g., promotion timelines, duplicates, account-product checks).
* Create monitoring and logging frameworks for errors and mismatches.
Ongoing Maintenance & Enhancements
* Automate pipelines using tools such as Airflow, Azure Data Factory, or Informatica.
* Adapt models and flows as business requirements evolve.
* Collaborate with TPM analysts and business users to refine outputs and troubleshoot issues.
Skills, Experience & Knowledge
Essential
* 5+ years’ experience in a Data Engineering role (FMCG/manufacturing background highly desirable).
* Strong expertise in modern data platforms and cloud technologies (Azure preferred; AWS/GCP also considered).
* Proven hands-on experience with:
* Data lakehouse platforms (Databricks, Snowflake, etc.)
* ETL/ELT tools (dbt, Azure Data Factory, Airflow, Informatica, Talend)
* SQL and programming (Python, Spark)
* Real-time data streaming (Kafka, Azure Event Hub)
* Data quality tools (Great Expectations, dbt tests, custom frameworks)
* Strong understanding of ERP integration (Infor ION, REST/SOAP APIs, flat file interfaces).
* Experience with analytics platforms such as Power BI.
* Knowledge of DevOps, CI/CD, and infrastructure-as-code principles for data pipelines.
Why Join Us?
This is an exciting opportunity to make a real impact in a fast-paced, data-driven environment. You’ll be at the forefront of
shaping how we integrate, manage, and leverage data to drive smarter trade promotion strategies and better business outcomes.