Data Engineering IRC279852

Description
We are building a unified data governance and management framework to ensure consistent standards for data quality, security, and compliance with EU regulations. This initiative will establish a robust data platform that supports advanced analytics, AI/ML innovation, and data-driven decision-making – driving new value across the vehicle lifecycle, enhancing customer experience, and optimizing market operations.

Requirements

• 5+ years of hands-on experience in data engineering with Python and SQL
• Experience with AWS, DWH services (Redshift, Databricks etc.)
• Experience with data analysis work and tool for example PowerBI
• Strong experience with ETL/ELT/orchestration tools (e.g., PySpark, Airflow, Glue)
• Experience with stream processing (e.g., Apache Kafka, Apache Flink, Spark Structured Streaming)
• Drive the design and implementation of data warehouse and data lakes
• Proficient in code versioning (git) and building CI/CD for data projects
• Experience with requirement gathering and documentation.

Job responsibilities

Design, build, and maintain robust data ingestion pipelines from multiple vehicle data sources.

• Develop data transformation workflows and orchestration logic using the platform's tools.
• Ensure data quality and integrity throughout the data lifecycle, from ingestion to consumption.
• Troubleshoot and resolve data pipeline failures and performance bottlenecks.
• Collaborate with business and IT stakeholders to define data requirements and delivery specifications.
• Collaborate with business stakeholders and technical teams to understand and analyse data requirements
• Design and implement complex ETL processes
• Build, maintain and document production-ready data pipelines for data ingestion and transformation
• Ensure data integrity, consistency, and accuracy through robust data quality assurance measures
• Regular reports on the quality and integrity of the ingested data
• Document in detail for data sources, ingestion logic, and data flow from source to destination
• Log resolved issues, including pipeline failures and performance fixes
• Review and support team members, providing guidance and mentorship
• Supervise and contribute to the data-driven strategy for the project, aligning it with business objectives

What we offer

Culture of caring.
At GlobalLogic, we prioritize a culture of caring. Across every region and department, at every level, we consistently put people first. From day one, you'll experience an inclusive culture of acceptance and belonging, where you'll have the chance to build meaningful connections with collaborative teammates, supportive managers, and compassionate leaders.

Learning and development.
We are committed to your continuous learning and development. You'll learn and grow daily in an environment with many opportunities to try new things, sharpen your skills, and advance your career at GlobalLogic. With our Career Navigator tool as just one example, GlobalLogic offers a rich array of programs, training curricula, and hands-on opportunities to grow personally and professionally.

Interesting & meaningful work.
GlobalLogic is known for engineering impact for and with clients around the world. As part of our team, you'll have the chance to work on projects that matter. Each is a unique opportunity to engage your curiosity and creative problem-solving skills as you help clients reimagine what's possible and bring new solutions to market. In the process, you'll have the privilege of working on some of the most cutting-edge and impactful solutions shaping the world today.

Balance and flexibility.
We believe in the importance of balance and flexibility. With many functional career areas, roles, and work arrangements, you can explore ways of achieving the perfect balance between your work and life. Your life extends beyond the office, and we always do our best to help you integrate and balance the best of work and life, having fun along the way

High-trust organization.
We are a high-trust organization where integrity is key. By joining GlobalLogic, you're placing your trust in a safe, reliable, and ethical global company. Integrity and trust are a cornerstone of our value proposition to our employees and clients. You will find truthfulness, candor, and integrity in everything we do.

About GlobalLogic
GlobalLogic, a Hitachi Group Company, is a trusted digital engineering partner to the world's largest and most forward-thinking companies. Since 2000, we've been at the forefront of the digital revolution – helping create some of the most innovative and widely used digital products and experiences. Today we continue to collaborate with clients in transforming businesses and redefining industries through intelligent products, platforms, and services.