Data Engineer

In
YouGov Shopper
, we believe that constant innovation is the key to improve the pertinence and quality of the data that we receive from our consumer panel members and app users.

Our team's goal is to reduce the associated workload by increasing automation. We achieve this by combining panelist data with a large variety of additional data sources, using creative data science and an increasing usage of LLMs.

As a
Data Engineer
, you will join our cross-functional team of Machine Learning Engineers and Data Scientists to develop new components for our text-matching framework.

You will support data scientists with their day-to-day work, supporting a seamless research-to-production workflow regarding data and code, working closely with our SREs and software engineers to integrate our DS/ML components with our productive data processing pipelines on AWS.

Here's a breakdown of what you'll do (not all of it, just the important stuff):

• Design, build, and maintain ETL/ELT pipelines and data workflows across batch and streaming systems.
• Develop and optimize data models for analytics, reporting, and machine learning use cases.
• Ensure data quality, consistency, and governance across multiple data sources.
• Work on efficient CI/CD pipelines to continuously deploy our new features and models.
• Set up and refine ML and data pipelines. Define model quality and set up a monitoring and alerting system.
• Work closely with software engineers and SREs on the integration of our components.
• Present your achievements to a broader audience, i.e. during agile ceremonies, internal knowledge-sharing events or conferences.
• Contribute to the evolution of our data platform, including architectural improvements and tool selection.

These are the essentials for having an interview:

• 4+ years of experience as a Data Engineer or in a similar role.
• Hands-on experience with cloud platforms for data engineering workloads.
• Experience collaborating with data scientists and supporting ML pipelines.
• Familiarity with DevOps practices (CI/CD, infrastructure as code, containerization with Docker/Kubernetes).
• Working experience with most of our tech-stack.
• Clearly and confidently in English within a business and technical context.
• You think beyo nd the obvious, approaching problems with creativity and innovative solutions.
• You can balance technical complexity with business value, e stimating effort versus impact effectively.
• You're self-driven, eager to learn, and proactive in supporting teammates—whether it's debugging issues, setting up tools, or sharing best practices.
• nice to have skills:
• Good knowledge about using LLMs for research and productive use.
• Experience with streaming platforms (Kafka, Kinesis, or Pub/Sub).
• Experience with working in an agile environment (Scrum, JIRA).
• Good knowledge of machine learning algorithms, preferably in NLP and text recognition.

Tools And Technology used:

• Python best practices and coding standards.
• AWS (Lambda, SageMaker, APIGateway, Bedrock) .
• Docker, Terraform, mlflow .
• git, GitLab (CI/CD, runners).
• MongoDB .
• ELK stack .
• Collaboration & documentation: JIRA, Confluence, Teams, Miro .

Why join YouGov?

Join our global team to help us achieve our social mission: to make millions of people's opinions heard for the benefit of our local, national, and international communities.

Understanding diversity of opinion requires diversity of background. Although our global panel of millions of people worldwide powers our research, our biggest asset is our people. If our research is to be truly representative of what the world thinks, we need people from all walks of life to be part of the team to bring their perspective to the work we do.

Life at YouGov

We are driven by a set of shared values. We are fast, fearless, and innovative. We work diligently to get it right. We are guided by accuracy, ethics, and proven methodologies. We respect and trust each other, bringing these values into everything that we do.

We strive to provide YouGovers with best-in-class benefits to support their physical, financial, and emotional wellbeing. We want our employees to have a sense of belonging and uniqueness in a supportive workplace, so they can bring their full selves to work.

Equal Opportunity Employer

As an Equal Opportunity Employer, qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy, gender identity or expression, and sexual orientation), parental status, national origin, marital status, age, disability, genetic information, HIV status, political affiliation, socioeconomic background, veteran status or any other characteristic protected by law or in line with our responsibilities as a fair and ethic employer. All employment decisions are made based on occupational qualifications, merit, and business need.

Data Privacy

To find out how we collect and use your personal data when you apply for a role at YouGov, please read our privacy notice