Data Engineer - Trade Promotion Management (TPM)
| Posting date: | 24 April 2025 |
|---|---|
| Salary: | Not specified |
| Additional salary information: | £40-45k |
| Hours: | Full time |
| Closing date: | 24 May 2025 |
| Location: | Home-based, NG2 1LW |
| Company: | The Compleat Food Group |
| Job type: | Contract |
| Job reference: | 1040 |
Summary
Job Advert
Data Engineer - Trade Promotion Management (TPM) (12-Month FTC)
Location: Home-based with travel to UK sites
Salary: £40,000 - £45,000 + Benefits
Contract: Initial 12-month Fixed-Term Contract
Hours: Full-time, Monday to Friday
About the Role
We are seeking a Data Engineer to join our team in a key role supporting the deployment of our Trade Promotion Management (TPM)
system, UpClear BluePlanner. This is a data-intensive position where the Data Engineer will play a foundational role in ensuring
the right data flows into and out of the TPM platform, enabling forecasting, ROI calculations, accruals, and more.
You’ll be integral to building and optimizing data pipelines, integrating systems, and ensuring data quality and consistency, with
a focus on the smooth operation of our TPM system to drive business performance.
Key Responsibilities
Data Integration & Connectivity
* Source Data Ingestion: Build pipelines to extract data from systems such as ERP (SAP, Oracle) for shipments, actuals, pricing,
CRM (for customer hierarchies and sales teams), POS/Syndicated Data Providers (e.g., Nielsen, IRI, Retail Link), and Financial
Systems (budgets, accruals).
* Integration Targets: Work with TPM platforms like Salesforce TPM, SAP TPM, o9, Blacksmith, Eversight, Anaplan.
Data Transformation & Mapping
* Data Harmonization: Align product and customer hierarchies across systems and match event-level POS or shipment data to planned
promotions.
* Business Logic Implementation: Apply business calculation logic (e.g., lift factors, cannibalization, baseline vs incremental
volume) and complex accrual and ROI logic, particularly when not natively handled by the TPM system.
Data Modeling & Storage
* Data Warehouse/Lake Setup: Design data models to support promotion master data, actual vs forecasted volume/financials, claim
reconciliation, and KPIs for ROI and effectiveness.
* Performance Optimization: Ensure that queries for reporting dashboards and AI/ML models perform efficiently.
Data Quality & Validation
* Validation Rules: Build checks to validate promotion dates vs shipment timelines, identify duplicate promotions, and ensure
valid account-product combinations.
* Error Handling: Develop monitoring and logging systems for failed data loads or mismatches.
Ongoing Maintenance & Enhancements
* Job Scheduling & Automation: Utilize tools such as Airflow, Azure Data Factory, or Informatica to automate and schedule data
pipelines.
* Change Management: Adapt data models as business rules or TPM system logic evolves.
* User Feedback Loop: Collaborate with TPM analysts and business users to refine data outputs and resolve discrepancies.
Knowledge, Skills and Experience
Essential Experience & Skills:
* 5+ years’ experience in a data engineering role within mid-to-large enterprises (FMCG or manufacturing experience is a plus).
* Strong expertise in modern data platforms and cloud technologies (Azure preferred; AWS/GCP also considered).
* Proven experience with:
* Data lakehouse architectures (e.g., Delta Lake, Snowflake)
* ETL/ELT tools (e.g., dbt, Azure Data Factory, Airflow, Informatica, Talend)
* SQL and programming languages (Python, Spark)
* Real-time data streaming (e.g., Kafka, Azure Event Hub)
* Integration with Planning Tools (ERP, REST/SOAP APIs, flat file interfaces)
* Data Quality Tools (Great Expectations, dbt tests)
* Familiarity with analytics platforms such as Power BI
* Knowledge of DevOps, CI/CD, and infrastructure-as-code for data pipelines
What We Offer:
* Salary: £40,000 - £45,000 + Benefits
* Hybrid Working: Flexibility to work from home with occasional travel to the office or other UK sites.
* Growth Opportunity: An initial 12-month contract with the potential to transition to a permanent position based on performance.
* Collaborative Culture: Work with a dynamic, cross-functional team within a leading food business.
About The Compleat Food Group
We are a forward-thinking company focused on innovation and sustainable practices in the food industry. Join us to contribute to
exciting transformation projects and play a key role in shaping the future of our demand planning and data infrastructure.
What You’ll Get in Return
* Flexible hybrid working with a home base
* Travel to UK sites as part of a collaborative, people-first business
* Opportunity to make a tangible impact in a business investing in transformation
* Competitive salary, benefits, and the potential to move into a permanent role
Why Join Us?
At The Compleat Food Group we’re on a mission to create tasty food that’s better for people and the planet — we call it ‘Food to
Feel Good’.
We pride ourselves on being a business that gives equal emphasis to HOW we operate as well as the financial results we achieve.
Our 5,500 (and growing) fantastic people make this possible. They are passionate about creating delicious products for UK
consumers, leading retailers, and our exciting, market-leading brands, including Wall’s Pastry, Vadasz, Squeaky Bean, and
Unearthed.
Benefits to Include:
* 33 Days annual leave
* 2 Employee Volunteering Days per year
* Online and High-street retailer discount scheme
* Employee well-being and community support groups
* Informal and Formal training opportunities with personalised online LMS platform
* Charity Initiatives and Team events
* 24/7 Access to Grocery Aid (Free Financial, Emotional and Practical Support)
* Physical Wellbeing Benefits – Free on demand exercise hub and various gym discounts.
* Online Wellbeing benefits
* Free Financial wellbeing – mortgage calculators, budget tools, financial aid tools
* Holiday Discounts via Online Retail Discount
The Compleat Food Group are proud to have built an inclusive and respectful culture where our colleagues feel safe, supported and
valued. A place where they can bring their whole selves to work to achieve exceptional results and thrive. We continue to attract
diverse talent into our teams, because we know greater diversity leads to exceptional results and provides a better working life.
That’s why we’re committed to ensuring Fairness, Equity, Inclusivity, and Respect in all that we do.
Recruitment Agencies We have an active and trusted Preferred Supplier List to assist us if required. We do not acknowledge any
speculative CVs or unsolicited candidate introductions from agencies.
Data Engineer - Trade Promotion Management (TPM) (12-Month FTC)
Location: Home-based with travel to UK sites
Salary: £40,000 - £45,000 + Benefits
Contract: Initial 12-month Fixed-Term Contract
Hours: Full-time, Monday to Friday
About the Role
We are seeking a Data Engineer to join our team in a key role supporting the deployment of our Trade Promotion Management (TPM)
system, UpClear BluePlanner. This is a data-intensive position where the Data Engineer will play a foundational role in ensuring
the right data flows into and out of the TPM platform, enabling forecasting, ROI calculations, accruals, and more.
You’ll be integral to building and optimizing data pipelines, integrating systems, and ensuring data quality and consistency, with
a focus on the smooth operation of our TPM system to drive business performance.
Key Responsibilities
Data Integration & Connectivity
* Source Data Ingestion: Build pipelines to extract data from systems such as ERP (SAP, Oracle) for shipments, actuals, pricing,
CRM (for customer hierarchies and sales teams), POS/Syndicated Data Providers (e.g., Nielsen, IRI, Retail Link), and Financial
Systems (budgets, accruals).
* Integration Targets: Work with TPM platforms like Salesforce TPM, SAP TPM, o9, Blacksmith, Eversight, Anaplan.
Data Transformation & Mapping
* Data Harmonization: Align product and customer hierarchies across systems and match event-level POS or shipment data to planned
promotions.
* Business Logic Implementation: Apply business calculation logic (e.g., lift factors, cannibalization, baseline vs incremental
volume) and complex accrual and ROI logic, particularly when not natively handled by the TPM system.
Data Modeling & Storage
* Data Warehouse/Lake Setup: Design data models to support promotion master data, actual vs forecasted volume/financials, claim
reconciliation, and KPIs for ROI and effectiveness.
* Performance Optimization: Ensure that queries for reporting dashboards and AI/ML models perform efficiently.
Data Quality & Validation
* Validation Rules: Build checks to validate promotion dates vs shipment timelines, identify duplicate promotions, and ensure
valid account-product combinations.
* Error Handling: Develop monitoring and logging systems for failed data loads or mismatches.
Ongoing Maintenance & Enhancements
* Job Scheduling & Automation: Utilize tools such as Airflow, Azure Data Factory, or Informatica to automate and schedule data
pipelines.
* Change Management: Adapt data models as business rules or TPM system logic evolves.
* User Feedback Loop: Collaborate with TPM analysts and business users to refine data outputs and resolve discrepancies.
Knowledge, Skills and Experience
Essential Experience & Skills:
* 5+ years’ experience in a data engineering role within mid-to-large enterprises (FMCG or manufacturing experience is a plus).
* Strong expertise in modern data platforms and cloud technologies (Azure preferred; AWS/GCP also considered).
* Proven experience with:
* Data lakehouse architectures (e.g., Delta Lake, Snowflake)
* ETL/ELT tools (e.g., dbt, Azure Data Factory, Airflow, Informatica, Talend)
* SQL and programming languages (Python, Spark)
* Real-time data streaming (e.g., Kafka, Azure Event Hub)
* Integration with Planning Tools (ERP, REST/SOAP APIs, flat file interfaces)
* Data Quality Tools (Great Expectations, dbt tests)
* Familiarity with analytics platforms such as Power BI
* Knowledge of DevOps, CI/CD, and infrastructure-as-code for data pipelines
What We Offer:
* Salary: £40,000 - £45,000 + Benefits
* Hybrid Working: Flexibility to work from home with occasional travel to the office or other UK sites.
* Growth Opportunity: An initial 12-month contract with the potential to transition to a permanent position based on performance.
* Collaborative Culture: Work with a dynamic, cross-functional team within a leading food business.
About The Compleat Food Group
We are a forward-thinking company focused on innovation and sustainable practices in the food industry. Join us to contribute to
exciting transformation projects and play a key role in shaping the future of our demand planning and data infrastructure.
What You’ll Get in Return
* Flexible hybrid working with a home base
* Travel to UK sites as part of a collaborative, people-first business
* Opportunity to make a tangible impact in a business investing in transformation
* Competitive salary, benefits, and the potential to move into a permanent role
Why Join Us?
At The Compleat Food Group we’re on a mission to create tasty food that’s better for people and the planet — we call it ‘Food to
Feel Good’.
We pride ourselves on being a business that gives equal emphasis to HOW we operate as well as the financial results we achieve.
Our 5,500 (and growing) fantastic people make this possible. They are passionate about creating delicious products for UK
consumers, leading retailers, and our exciting, market-leading brands, including Wall’s Pastry, Vadasz, Squeaky Bean, and
Unearthed.
Benefits to Include:
* 33 Days annual leave
* 2 Employee Volunteering Days per year
* Online and High-street retailer discount scheme
* Employee well-being and community support groups
* Informal and Formal training opportunities with personalised online LMS platform
* Charity Initiatives and Team events
* 24/7 Access to Grocery Aid (Free Financial, Emotional and Practical Support)
* Physical Wellbeing Benefits – Free on demand exercise hub and various gym discounts.
* Online Wellbeing benefits
* Free Financial wellbeing – mortgage calculators, budget tools, financial aid tools
* Holiday Discounts via Online Retail Discount
The Compleat Food Group are proud to have built an inclusive and respectful culture where our colleagues feel safe, supported and
valued. A place where they can bring their whole selves to work to achieve exceptional results and thrive. We continue to attract
diverse talent into our teams, because we know greater diversity leads to exceptional results and provides a better working life.
That’s why we’re committed to ensuring Fairness, Equity, Inclusivity, and Respect in all that we do.
Recruitment Agencies We have an active and trusted Preferred Supplier List to assist us if required. We do not acknowledge any
speculative CVs or unsolicited candidate introductions from agencies.