SeniorData Engineer

Project description:

Join our Development Center and become a member of our open-minded, progressive and professional team. You will have a chance to grow your technical and soft skills, and build a thorough expertise of the industry of our client. In this role you will be working on projects for one our world famous clients, a large international investment bank.

We are seeking a skilled and motivated Python Developer with strong experience in SQL and Google Cloud Platform (GCP) to join our team.

On top of attractive salary and benefits package, Luxoft will invest into your professional training, and allow you to grow your professional career.

Key Responsibilities:

Develop and maintain Python-based applications and data pipelines.

Data Sourcing: Extract data from diverse repositories including relational databases (Oracle, PostgreSQL), NoSQL stores, file systems, and other structured/unstructured sources.

Data Transformation: Design and implement ETL/ELT workflows to standardize and cleanse data using best practices in data engineering.

Pipeline Development: Build scalable, fault-tolerant data pipelines that support batch and streaming use cases.

Design and implement cloud-native solutions using GCP services such as BigQuery, Cloud Functions, Cloud Storage

Data Format Expertise: Work with various data formats including JSON, CSV, and others.

Optimization & Monitoring: Ensure performance, reliability, and cost-efficiency of data pipelines through continuous monitoring and tuning.

Ensure code quality through unit testing, code reviews, and adherence to best practices

Document technical designs, processes, and configurations

Collaboration: Work closely with data architects, analysts, and business

stakeholders to understand data requirements and deliver high-quality solutions.

Required Skills & Experience:

Proficiency in Python with experience in building scalable applications

Knowledge of microservices and architecture patterns

Strong SQL skills, including query optimization and data modeling

Hands-on experience with GCP services (BigQuery, Cloud Functions, Cloud Storage, etc.)

Familiarity with CI/CD pipelines and version control (Git)

Familiarity with data modeling, schema design, and metadata management.

Understanding of data warehousing concepts and ETL processes