Data Pipeline

hace 1 semana


Ciudad de México, Ciudad de México Global Connect Technologies A tiempo completo

Responsibilities

  • Build and maintain Airflow 2.x DAGs (TaskFlow, dynamic DAGs, deferrable operators, providers).
  • Develop robust Python ETL/ELT ingesting from APIs, storage, message buses, and databases.
  • Operate Airflow on Azure/Kubernetes; support blue/green and canary DAG releases.
  • Implement data quality testing, monitoring, observability, and lineage.
  • Design scalable batch and streaming pipelines with strong schema management.
  • Manage SQL and blob data stores (partitioning, clustering, retention).
  • Enforce security best practices, IAM, RBAC, secrets management, and data contracts.
  • Build CI/CD pipelines and IaC (Terraform, Docker, Helm).
  • Optimize cost/performance and document runbooks and decisions.

Qualifications

  • 8+ years data or backend engineering experience with strong Python skills.
  • 2+ years Airflow 2.x expertise.
  • Proven track record building reliable ETL/ELT pipelines (batch + streaming).
  • Strong SQL and experience with major warehouses (BigQuery, Redshift, Snowflake).
  • Familiarity with IAM, OAuth/OIDC, secrets management, and monitoring.
  • Excellent communication and ability to work autonomously.


  • Ciudad de México, Ciudad de México X-DATA A tiempo completo

    Estamos buscando un/a Data Engineering Architect Sr. en X-Data¿Te emociona diseñar arquitecturas de datos que habiliten analítica avanzada, ciencia de datos e inteligencia artificial? Este rol puede ser para ti.EnX-Data, somos un estudio de analítica que transforma datos en activos. Trabajamos con empresas que quieren dejar de tomar decisiones a ciegas y...

  • Sr. ML Ops Engineer

    hace 4 días


    Ciudad de México, Ciudad de México NTT DATA A tiempo completo

    Develop and implement machine learning models such as recommendation engines, customer segmentation, and predictive analytics to support customer-centric business initiatives. Collaborate with data scientists and engineers to translate business requirements into technical solutions. Write clean, maintainable, and production-quality code primarily in Python,...

  • Senior Data Engineer

    hace 1 semana


    Ciudad de México, Ciudad de México Arkham Technologies A tiempo completo

    About ArkhamArkham is a Data & AI Platform—a suite of powerful tools designed to help you unify your data and use the best Machine Learning and Generative AI models to solve your most complex operational challenges.Today, industry leaders like Circle K, Mexico Infrastructure Partners, and Televisa Editorial rely on our platform to simplify access to data...

  • Senior Data Engineer

    hace 1 semana


    Ciudad de México, Ciudad de México Arkham Technologies A tiempo completo

    About ArkhamArkham is a Data & AI Platform—a suite of powerful tools designed to help you unify your data and use the best Machine Learning and Generative AI models to solve your most complex operational challenges. Today, industry leaders like Circle K, Mexico Infrastructure Partners, and Televisa Editorial rely on our platform to simplify access to data...

  • Big Data Engineer

    hace 20 horas


    Ciudad de México, Ciudad de México Bluehill A tiempo completo

    Profile Summary:We are looking for Big Data Engineers who are ready to take their career to the next level. You will evangelize and build Data Products, simplify critical ML and Analytics products to enrich the customer experience, and simplify marketing operations. You will partner with other data engineering teams and platform teams within AI to lead the...


  • Ciudad de México, Ciudad de México Global Applications Solution A tiempo completo

    Position: Lead/Principal Data Engineer/Data ArchitectClient Domain: Banking InstitutionWork StructureInitial Phase: Mandatory 3 weeks on-site in Mexico City (Santa Fe) for essential client immersion and team onboarding.Ongoing: Following the initial phase, the role transitions to fully remote .Note on Expenses: The client will not cover travel,...


  • Ciudad de México, Ciudad de México Baubap A tiempo completo

    The mission:Design and implement the foundational data architecture that will power our next stage of growth. This role is hybrid: highly strategic in defining long-term standards and architecture, while also hands-on in building the first pipelines, storage layers, and frameworks that make data reliable, scalable, and accessible.Unlike roles limited to...

  • Data Platform Architect

    hace 1 semana


    Ciudad de México, Ciudad de México Baubap A tiempo completo

    The mission:Design and implement the foundational data architecturethat will power our next stage of growth. This role is hybrid: highly strategic in defining long-term standards and architecture, while also hands-on in building the first pipelines, storage layers, and frameworks that make data reliable, scalable, and accessible.Unlike roles limited to...


  • Ciudad de México, Ciudad de México Pipecare Group A tiempo completo

    PIPECARE Group is looking for an experienced Pipeline Integrity Engineer to join our team.By providing technology and service focused solutions to the international arena of the oil and gas industry, the PipeCare Group of companies has been helping our customers ensure the integrity of their pipeline and facility assets for over 20...


  • Ciudad de México, Ciudad de México NTT DATA A tiempo completo

    Develop interactive dashboards and reports using Power BI, leveraging semantic models and DAX. Design and implement end-to-end data solutions using Microsoft Fabric including Data Factory (Dataflows and pipelines), Synapse Analytics (Warehouses, Lakehouses, Notebooks, Real-time Analytics, etc.) and OneLake. Collaborate with data analysts, business users, and...