Data Pipeline
hace 1 semana
Responsibilities
- Build and maintain Airflow 2.x DAGs (TaskFlow, dynamic DAGs, deferrable operators, providers).
- Develop robust Python ETL/ELT ingesting from APIs, storage, message buses, and databases.
- Operate Airflow on Azure/Kubernetes; support blue/green and canary DAG releases.
- Implement data quality testing, monitoring, observability, and lineage.
- Design scalable batch and streaming pipelines with strong schema management.
- Manage SQL and blob data stores (partitioning, clustering, retention).
- Enforce security best practices, IAM, RBAC, secrets management, and data contracts.
- Build CI/CD pipelines and IaC (Terraform, Docker, Helm).
- Optimize cost/performance and document runbooks and decisions.
Qualifications
- 8+ years data or backend engineering experience with strong Python skills.
- 2+ years Airflow 2.x expertise.
- Proven track record building reliable ETL/ELT pipelines (batch + streaming).
- Strong SQL and experience with major warehouses (BigQuery, Redshift, Snowflake).
- Familiarity with IAM, OAuth/OIDC, secrets management, and monitoring.
- Excellent communication and ability to work autonomously.
-
Architect – Data Engineering
hace 1 semana
Ciudad de México, Ciudad de México X-DATA A tiempo completoEstamos buscando un/a Data Engineering Architect Sr. en X-Data¿Te emociona diseñar arquitecturas de datos que habiliten analítica avanzada, ciencia de datos e inteligencia artificial? Este rol puede ser para ti.EnX-Data, somos un estudio de analítica que transforma datos en activos. Trabajamos con empresas que quieren dejar de tomar decisiones a ciegas y...
-
Sr. ML Ops Engineer
hace 4 días
Ciudad de México, Ciudad de México NTT DATA A tiempo completoDevelop and implement machine learning models such as recommendation engines, customer segmentation, and predictive analytics to support customer-centric business initiatives. Collaborate with data scientists and engineers to translate business requirements into technical solutions. Write clean, maintainable, and production-quality code primarily in Python,...
-
Senior Data Engineer
hace 1 semana
Ciudad de México, Ciudad de México Arkham Technologies A tiempo completoAbout ArkhamArkham is a Data & AI Platform—a suite of powerful tools designed to help you unify your data and use the best Machine Learning and Generative AI models to solve your most complex operational challenges.Today, industry leaders like Circle K, Mexico Infrastructure Partners, and Televisa Editorial rely on our platform to simplify access to data...
-
Senior Data Engineer
hace 1 semana
Ciudad de México, Ciudad de México Arkham Technologies A tiempo completoAbout ArkhamArkham is a Data & AI Platform—a suite of powerful tools designed to help you unify your data and use the best Machine Learning and Generative AI models to solve your most complex operational challenges. Today, industry leaders like Circle K, Mexico Infrastructure Partners, and Televisa Editorial rely on our platform to simplify access to data...
-
Big Data Engineer
hace 20 horas
Ciudad de México, Ciudad de México Bluehill A tiempo completoProfile Summary:We are looking for Big Data Engineers who are ready to take their career to the next level. You will evangelize and build Data Products, simplify critical ML and Analytics products to enrich the customer experience, and simplify marketing operations. You will partner with other data engineering teams and platform teams within AI to lead the...
-
Lead Data Engineer/Data Architect
hace 2 semanas
Ciudad de México, Ciudad de México Global Applications Solution A tiempo completoPosition: Lead/Principal Data Engineer/Data ArchitectClient Domain: Banking InstitutionWork StructureInitial Phase: Mandatory 3 weeks on-site in Mexico City (Santa Fe) for essential client immersion and team onboarding.Ongoing: Following the initial phase, the role transitions to fully remote .Note on Expenses: The client will not cover travel,...
-
Data Platform Architect
hace 2 días
Ciudad de México, Ciudad de México Baubap A tiempo completoThe mission:Design and implement the foundational data architecture that will power our next stage of growth. This role is hybrid: highly strategic in defining long-term standards and architecture, while also hands-on in building the first pipelines, storage layers, and frameworks that make data reliable, scalable, and accessible.Unlike roles limited to...
-
Data Platform Architect
hace 1 semana
Ciudad de México, Ciudad de México Baubap A tiempo completoThe mission:Design and implement the foundational data architecturethat will power our next stage of growth. This role is hybrid: highly strategic in defining long-term standards and architecture, while also hands-on in building the first pipelines, storage layers, and frameworks that make data reliable, scalable, and accessible.Unlike roles limited to...
-
Pipeline Integrity Engineer
hace 7 días
Ciudad de México, Ciudad de México Pipecare Group A tiempo completoPIPECARE Group is looking for an experienced Pipeline Integrity Engineer to join our team.By providing technology and service focused solutions to the international arena of the oil and gas industry, the PipeCare Group of companies has been helping our customers ensure the integrity of their pipeline and facility assets for over 20...
-
Software Development Senior Specialist
hace 2 semanas
Ciudad de México, Ciudad de México NTT DATA A tiempo completoDevelop interactive dashboards and reports using Power BI, leveraging semantic models and DAX. Design and implement end-to-end data solutions using Microsoft Fabric including Data Factory (Dataflows and pipelines), Synapse Analytics (Warehouses, Lakehouses, Notebooks, Real-time Analytics, etc.) and OneLake. Collaborate with data analysts, business users, and...