Senior Data Engineer

About The Brief

The Brief is the AI agency for modern marketers, our platform powers the entire campaign lifecycle, helping teams create on-brand assets, launch across channels, analyze performance and apply learnings to start again, smarter. Trusted by leading global brands, The Brief removes friction and transforms how marketers move from insight to execution to impact.

You'll be joining a team that's rethinking how modern marketing gets done. Less chaos, more clarity. Less busywork, more breakthrough work. We're building the platform that gives marketers time to be brilliant…. and we're just getting started

What we're looking for

We are seeking a Senior Data Engineer to architect, build, and optimize the data infrastructure that powers our creative automation platform. You will play a key role in shaping our data ecosystem — from designing scalable pipelines to ensuring high data quality and performance across analytics, machine learning, and business systems. Reporting to the Director of Data and working closely with Engineering, Product, and Analytics teams, you will design and maintain modern, cloud-based data solutions that enable faster insights and smarter automation.

The ideal candidate is a hands-on technical expert with deep experience in modern data architectures, distributed systems, and orchestration frameworks. You thrive in complex data environments, love optimizing for reliability and scalability, and can translate business needs into technical solutions that drive measurable impact.

What you'll do

• Design, build, and maintain scalable ETL/ELT pipelines using tools such as NiFi, Talend, Airflow, dbt, and Python to ingest and transform large datasets from multiple sources (product, marketing, and third-party systems).
  
• Architect data models and warehouses in platforms like RedShift, Snowflake, BigQuery, or Databricks to support analytics, experimentation, and AI initiatives.
  
• Work with Product teams to deliver reports using various charting tools such as Looker, MixPanel, Metabase and Amplitude
  
• Optimize data processing performance and reliability for both batch and streaming workloads, ensuring low-latency access to critical insights.
  
• Collaborate cross-functionally with data scientists, analysts, and backend engineers to deliver robust data solutions that enable predictive modeling and advanced analytics.
  
• Implement and enforce data quality, lineage, and governance standards, including compliance with GDPR and CCPA.
  
• Automate data testing, validation, and monitoring to ensure system stability and integrity at scale.
  
• Evaluate and integrate emerging technologies (e.g., Delta Lake, Kafka, or dbt Cloud) to enhance data architecture performance and efficiency.
  
• Support machine learning infrastructure by enabling feature pipelines and model-serving data flows in production environments.
  
• Contribute to CI/CD practices for data workflows, ensuring reproducibility, version control, and deployment automation.
  
• Document and communicate system designs, best practices, and key metrics to technical and non-technical stakeholders.
  
  

What you'll bring

• 7+ years of hands-on experience in data engineering, data architecture, or software engineering, ideally within SaaS, AdTech, or digital product environments.
  
• Expertise in SQL and Python, with strong experience in orchestrating workflows using NiFi, Airflow, dbt, or Prefect.
  
• Proficiency with modern data platforms and cloud environments such as Snowflake, BigQuery, Databricks, or AWS/GCP data stacks.
  
• Proficiency with charting tools such as Looker, MixPanel, Metabase or Amplitude
  
• Experience with streaming and real-time data technologies (e.g., Kafka, Spark Structured Streaming, Flink) a strong plus.
  
• Strong knowledge of data modeling principles, including dimensional modeling and data vault architecture.
  
• Solid understanding of CI/CD, containerization, and infrastructure-as-code (e.g., Terraform, Docker, Kubernetes).
  
• Experience with data observability and quality tools (e.g., Great Expectations, Monte Carlo, Soda Core).
  
• Familiarity with ML and analytics workflows, including feature engineering and data pipelines for AI applications.
  
• Proven ability to balance hands-on technical work with collaboration and mentorship, guiding peers in engineering excellence and operational best practices.
  
• Bachelor's or Master's degree in Computer Science, Data Engineering, or a related technical field.
  

What we offer

• Massive potential: Exponentially growing business in hot AI and adtech space
• Grow with us: Exceptional learning opportunities
• Rewarding your efforts: Competitive salary and stock options
• Thrive & vibe: Dynamic and supportive work environment

Why join us

At The Brief, we're not just a team. We're a community of entrepreneurial thinkers and problem solvers. We're passionate believers in our product and our mission, and together, we bring ideas to life, measuring our success through the impact we create. If you believe you belong here, apply today

Acknowledgement: 

By submitting your application, you acknowledge that we will process your personal information as described in The Brief's Candidate Privacy Notice.