Data Pipeline Engineer
hace 3 semanas
Job Description:We are seeking an experienced Senior Data Pipeline Engineer to design, build, and operate secure, reliable, and cost-efficient data pipelines supporting our Android connected and infotainment experiences.You will lead Python-based ETL/ELT development, Airflow orchestration, and data platform operations across cloud environments, working closely with Android, backend, and product teams.Responsibilities- Build and maintain Airflow 2.X DAGs (TaskFlow, dynamic DAGs, deferrable operators, providers).- Develop robust Python ETL/ELT ingesting from APIs, storage, message buses, and databases.- Operate Airflow on Azure/Kubernetes; support blue/green and canary DAG releases.- Implement data quality testing, monitoring, observability, and lineage.- Design scalable batch and streaming pipelines with strong schema management.- Manage SQL and blob data stores (partitioning, clustering, retention).- Enforce security best practices, IAM, RBAC, secrets management, and data contracts.- Build CI/CD pipelines and IaC (Terraform, Docker, Helm).- Optimize cost/performance and document runbooks and decisions.Qualifications- 8+ years data or backend engineering experience with strong Python skills.- 2+ years Airflow 2.X expertise.- Proven track record building reliable ETL/ELT pipelines (batch + streaming).- Strong SQL and experience with major warehouses (BigQuery, Redshift, Snowflake).- Familiarity with IAM, OAuth/OIDC, secrets management, and monitoring.- Excellent communication and ability to work autonomously.Nice to Have- Terraform, Kubernetes, Docker, Spark/Beam, Kafka/Event Hubs, dbt, Delta Lake, feature stores, automotive/IoT experience.
-
Data Pipeline Engineer
hace 3 semanas
Estado de Jalisco, México Global Connect Technologies A tiempo completoJob Title: Data Pipeline Engineer (Python/Airflow) Location: Guadalajara, MX Job-Type: Full-time Job Description: We are seeking an experienced Senior Data Pipeline Engineer to design, build, and operate secure, reliable, and cost-efficient data pipelines supporting our Android connected and infotainment experiences. You will lead Python-based ETL/ELT...
-
Junior Data Engineer: Pipelines
hace 3 semanas
Ciénega de Flores, México Caterpillar Financial Services Corporation A tiempo completoA global leader in manufacturing is seeking a detail-oriented Junior Data Engineer to join their dynamic team in San Luis Potosí, Mexico. The role involves designing and maintaining data pipelines, integrating data solutions, and ensuring data quality. The ideal candidate will have a Bachelor’s degree in a relevant field and 3-4 years of experience in...
-
Junior Data Engineer: Pipelines
hace 3 semanas
Ciénega de Flores, México Caterpillar Financial Services Corporation A tiempo completoA global leader in manufacturing is seeking a detail-oriented Junior Data Engineer to join their dynamic team in San Luis Potosí, Mexico. The role involves designing and maintaining data pipelines, integrating data solutions, and ensuring data quality. The ideal candidate will have a Bachelor’s degree in a relevant field and 3-4 years of experience in...
-
Data Engineer
hace 20 horas
Ciudad de México NTT Data Services A tiempo completo**Req ID**: 218394 We are currently seeking a Data Engineer - Azure to join our team in CDMX, Ciudad de México (MX-CMX), Mexico (MX). **Must have Skills**: - _4+ Years of overall experience in building data pipelines and ETL using following Technologies Microsoft Azure Cloud Platform, Azure SQL. _ - _SQL knowledge and experience_ **Good to have skills...
-
Data Engineer
hace 20 horas
Ciudad de México NTT Data Services A tiempo completo**Req ID**: We are currently seeking a Data Engineer - Azure to join our team in CDMX, Ciudad de México (MX-CMX), Mexico (MX).**Must have Skills**:- _4+ Years of overall experience in building data pipelines and ETL using following Technologies Microsoft Azure Cloud Platform, Azure SQL. _- _SQL knowledge and experience_**Good to have skills in**:-...
-
Data Engineer — AWS
hace 2 semanas
Ciudad de México NOUS LATAM A tiempo completoA leading data solutions company is looking for a Mid-Level Data Engineer in Mexico City. In this role, you'll design and implement data pipelines, ensuring data quality and reliability while collaborating with various teams. Ideal candidates have 2+ years of experience in a similar role, strong proficiency in Python, and familiarity with AWS services....
-
Junior Data Engineer: Pipelines, Integration
hace 3 semanas
Ciénega de Flores, México Caterpillar Financial Services Corporation A tiempo completoA global technology firm is looking for a motivated Junior Data Engineer to join their team in San Luis Potosí. The successful candidate will develop data pipelines, manage data integration, and ensure data quality. Ideal prospects should have a Bachelor's degree in a relevant field and 3-4 years of experience in data engineering or similar roles. The...
-
Data Engineer
hace 7 días
Ciudad de México HAYS A tiempo completoData Engineer The Data Engineer reports to the ERP Systems Manager and is responsible for leading the design, development, and maintenance of data pipelines and integrations within the SAP S/4HANA environment to enable business capabilities and services across the enterprise. In this role, the Data Engineer will work with business stakeholders to understand...
-
Automation QA Engineer
hace 4 semanas
Ciudad de México Avenga A tiempo completoA leading tech company is seeking an Automation QA Engineer to enhance QA efforts for AI/ML-based products and data platforms. The candidate will build automated tests using Python and SQL, support test plans for ML models, and collaborate with cross-functional teams. The ideal candidate has 3–5+ years in QA Engineering, strong programming skills, and a...
-
Data Pipeline
hace 2 semanas
Ciudad de México, Ciudad de México Global Connect Technologies A tiempo completoResponsibilitiesBuild and maintain Airflow 2.x DAGs (TaskFlow, dynamic DAGs, deferrable operators, providers).Develop robust Python ETL/ELT ingesting from APIs, storage, message buses, and databases.Operate Airflow on Azure/Kubernetes; support blue/green and canary DAG releases.Implement data quality testing, monitoring, observability, and lineage.Design...