Data Pipeline Engineer

hace 3 semanas

Guadalajara, México Global Connect Technologies A tiempo completo

Job Description:

We are seeking an experienced Senior Data Pipeline Engineer to design, build, and operate secure, reliable, and cost-efficient data pipelines supporting our Android connected and infotainment experiences. You will lead Python-based ETL/ELT development, Airflow orchestration, and data platform operations across cloud environments, working closely with Android, backend, and product teams.

Responsibilities

- Build and maintain Airflow 2.x DAGs (TaskFlow, dynamic DAGs, deferrable operators, providers).
- Develop robust Python ETL/ELT ingesting from APIs, storage, message buses, and databases.
- Operate Airflow on Azure/Kubernetes; support blue/green and canary DAG releases.
- Implement data quality testing, monitoring, observability, and lineage.
- Design scalable batch and streaming pipelines with strong schema management.
- Manage SQL and blob data stores (partitioning, clustering, retention).
- Enforce security best practices, IAM, RBAC, secrets management, and data contracts.
- Build CI/CD pipelines and IaC (Terraform, Docker, Helm).
- Optimize cost/performance and document runbooks and decisions.

Qualifications

- 8+ years data or backend engineering experience with strong Python skills.
- 2+ years Airflow 2.x expertise.
- Proven track record building reliable ETL/ELT pipelines (batch + streaming).
- Strong SQL and experience with major warehouses (BigQuery, Redshift, Snowflake).
- Familiarity with IAM, OAuth/OIDC, secrets management, and monitoring.
- Excellent communication and ability to work autonomously.

Nice to Have

- Terraform, Kubernetes, Docker, Spark/Beam, Kafka/Event Hubs, dbt, Delta Lake, feature stores, automotive/IoT experience.

  • Pipeline - Data Engineer

    hace 2 semanas

    Guadalajara, México Global Connect Technologies A tiempo completo

    Job Title: Data Pipeline Engineer (Python/Airflow) Location: Guadalajara, MXJob-Type: Full-timeJob Description:We are seeking an experienced Senior Data Pipeline Engineer to design, build, and operate secure, reliable, and cost-efficient data pipelines supporting our Android connected and infotainment experiences. You will lead Python-based ETL/ELT...

  • Data Pipeline Engineer

    hace 3 semanas

    Guadalajara, México Global Connect Technologies A tiempo completo

    Job Title: Data Pipeline Engineer (Python/Airflow)Location: Guadalajara, MXJob-Type: Full-timeJob Description:We are seeking an experienced Senior Data Pipeline Engineer to design, build, and operate secure, reliable, and cost-efficient data pipelines supporting our Android connected and infotainment experiences. You will lead Python-based ETL/ELT...

  • Data Pipeline Engineer

    hace 2 semanas

    Guadalajara, México Global Connect Technologies A tiempo completo

    Job Title: Data Pipeline Engineer (Python/Airflow)Location: Guadalajara, MXJob-Type: Full-timeJob Description:We are seeking an experienced Senior Data Pipeline Engineer to design, build, and operate secure, reliable, and cost-efficient data pipelines supporting our Android connected and infotainment experiences. You will lead Python-based ETL/ELT...

  • Data Pipeline Engineer

    hace 2 semanas

    Guadalajara, México Global Connect Technologies A tiempo completo

    Job Title: Data Pipeline Engineer (Python/Airflow) Location: Guadalajara, MX Job-Type: Full-time Job Description: We are seeking an experienced Senior Data Pipeline Engineer to design, build, and operate secure, reliable, and cost-efficient data pipelines supporting our Android connected and infotainment experiences. You will lead Python-based ETL/ELT...

  • Pipeline - Data Engineer

    hace 3 semanas

    Guadalajara, México Global Connect Technologies A tiempo completo

    Job Title: Data Pipeline Engineer (Python/Airflow) Location: Guadalajara, MX Job-Type: Full-time Job Description: We are seeking an experienced Senior Data Pipeline Engineer to design, build, and operate secure, reliable, and cost-efficient data pipelines supporting our Android connected and infotainment experiences. You will lead Python-based ETL/ELT...

  • Data Pipeline Engineer

    hace 3 semanas

    Guadalajara, México Global Connect Technologies A tiempo completo

    Job Title: Data Pipeline Engineer (Python/Airflow) Location: Guadalajara, MX Job-Type: Full-time Job Description: We are seeking an experienced Senior Data Pipeline Engineer to design, build, and operate secure, reliable, and cost-efficient data pipelines supporting our Android connected and infotainment experiences. You will lead Python-based ETL/ELT...

  • Data Pipeline Engineer

    hace 3 semanas

    Guadalajara, México Global Connect Technologies A tiempo completo

    Job Title: Data Pipeline Engineer (Python/Airflow) Location: Guadalajara, MX Job-Type: Full-time Job Description: We are seeking an experienced Senior Data Pipeline Engineer to design, build, and operate secure, reliable, and cost-efficient data pipelines supporting our Android connected and infotainment experiences. You will lead Python-based ETL/ELT...

  • Senior Data Pipeline Engineer

    hace 4 semanas

    Guadalajara, México Pentangle Tech Services | P5 Group A tiempo completo

    Job Title: Senior Data Pipeline Engineer (Python/Airflow) Contract | Business Unit: IIX | Remote Role Summary We are seeking a Senior Data Pipeline Engineer to own the design, development, and operation of reliable, secure, and cost-efficient data pipelines using Apache Airflow (2.x) and Python . You will build batch and streaming ingestion, transformations,...

  • Data Pipeline Engineer

    hace 3 semanas

    Guadalajara, México Global Connect Technologies A tiempo completo

    Job Description:We are seeking an experienced Senior Data Pipeline Engineer to design, build, and operate secure, reliable, and cost-efficient data pipelines supporting our Android connected and infotainment experiences. You will lead Python-based ETL/ELT development, Airflow orchestration, and data platform operations across cloud environments, working...

  • Data Pipeline Engineer

    hace 3 semanas

    Guadalajara, México Global Connect Technologies A tiempo completo

    Job Description:We are seeking an experienced Senior Data Pipeline Engineer to design, build, and operate secure, reliable, and cost-efficient data pipelines supporting our Android connected and infotainment experiences. You will lead Python-based ETL/ELT development, Airflow orchestration, and data platform operations across cloud environments, working...