Senior Data Pipeline Engineer
hace 4 semanas
Job Title: Senior Data Pipeline Engineer (Python/Airflow) Contract | Business Unit: IIX | Remote Role Summary We are seeking a Senior Data Pipeline Engineer to own the design, development, and operation of reliable, secure, and cost-efficient data pipelines using Apache Airflow (2.x) and Python . You will build batch and streaming ingestion, transformations, curated datasets, and ensure platform reliability, observability, and security across our cloud environments. You will work closely with Android, backend, and product teams to convert abstract requirements into architecture, tasks, and delivered solutions. Key Responsibilities Build and maintain Airflow DAGs (TaskFlow, dynamic DAGs, deferrable operators, Secrets backend). Develop Python ETL/ELT for APIs, storage, message buses, and databases; create reusable libraries. Operate Airflow on cloud or Kubernetes; support blue/green and canary DAG releases. Implement data quality, unit testing, and CI-based DAG validation. Build event-driven / near-real-time pipelines; manage schemas and compatibility. Design and maintain SQL/NoSQL/Blob storage models with proper partitioning and retention. Implement observability (metrics, logs, alerts), SLAs, and reliability improvements. Apply security best practices: IAM, secrets management, RBAC, PII handling, data contracts. Build CI/CD pipelines, manage IaC (Terraform/Helm), and containerize with Docker. Optimize compute/storage costs and pipeline performance. Collaborate with Android and backend teams; document architecture and runbooks. Required Qualifications 8+ years in data or backend engineering with strong Python expertise. 2+ years hands-on Airflow 2.x experience. Proven ETL/ELT pipeline design (batch + streaming) with testing & monitoring. Strong SQL and data modeling; experience with Snowflake, BigQuery, or Redshift. Understanding of RBAC, OAuth/OIDC, secrets management, and API integrations. Experience operating production systems with monitoring & performance tuning. Excellent communication and ability to work independently. Nice to Have Terraform, CI/CD, Git, Docker, Kubernetes. PySpark or Beam for large-scale processing. Kafka / Event Hubs / PubSub, schema registry, CDC. dbt, Delta Lake, medallion architecture, feature stores. Automotive/IoT telemetry experience. Logistics Contract position; fast-paced, cross-functional work environment. Must be a proactive problem solver with strong attention to detail.
-
Pipeline - Data Engineer
hace 2 semanas
Guadalajara, México Global Connect Technologies A tiempo completoJob Title: Data Pipeline Engineer (Python/Airflow) Location: Guadalajara, MXJob-Type: Full-timeJob Description:We are seeking an experienced Senior Data Pipeline Engineer to design, build, and operate secure, reliable, and cost-efficient data pipelines supporting our Android connected and infotainment experiences. You will lead Python-based ETL/ELT...
-
Data Pipeline Engineer
hace 2 semanas
Guadalajara, México Global Connect Technologies A tiempo completoJob Title: Data Pipeline Engineer (Python/Airflow)Location: Guadalajara, MXJob-Type: Full-timeJob Description:We are seeking an experienced Senior Data Pipeline Engineer to design, build, and operate secure, reliable, and cost-efficient data pipelines supporting our Android connected and infotainment experiences. You will lead Python-based ETL/ELT...
-
Data Pipeline Engineer
hace 2 semanas
Guadalajara, México Global Connect Technologies A tiempo completoJob Title: Data Pipeline Engineer (Python/Airflow)Location: Guadalajara, MXJob-Type: Full-timeJob Description:We are seeking an experienced Senior Data Pipeline Engineer to design, build, and operate secure, reliable, and cost-efficient data pipelines supporting our Android connected and infotainment experiences. You will lead Python-based ETL/ELT...
-
Data Pipeline Engineer
hace 2 semanas
Guadalajara, México Global Connect Technologies A tiempo completoJob Title: Data Pipeline Engineer (Python/Airflow) Location: Guadalajara, MX Job-Type: Full-time Job Description: We are seeking an experienced Senior Data Pipeline Engineer to design, build, and operate secure, reliable, and cost-efficient data pipelines supporting our Android connected and infotainment experiences. You will lead Python-based ETL/ELT...
-
Pipeline - Data Engineer
hace 3 semanas
Guadalajara, México Global Connect Technologies A tiempo completoJob Title: Data Pipeline Engineer (Python/Airflow) Location: Guadalajara, MX Job-Type: Full-time Job Description: We are seeking an experienced Senior Data Pipeline Engineer to design, build, and operate secure, reliable, and cost-efficient data pipelines supporting our Android connected and infotainment experiences. You will lead Python-based ETL/ELT...
-
Data Pipeline Engineer
hace 3 semanas
Guadalajara, México Global Connect Technologies A tiempo completoJob Title: Data Pipeline Engineer (Python/Airflow) Location: Guadalajara, MX Job-Type: Full-time Job Description: We are seeking an experienced Senior Data Pipeline Engineer to design, build, and operate secure, reliable, and cost-efficient data pipelines supporting our Android connected and infotainment experiences. You will lead Python-based ETL/ELT...
-
Data Pipeline Engineer
hace 3 semanas
Guadalajara, México Global Connect Technologies A tiempo completoJob Title: Data Pipeline Engineer (Python/Airflow) Location: Guadalajara, MX Job-Type: Full-time Job Description: We are seeking an experienced Senior Data Pipeline Engineer to design, build, and operate secure, reliable, and cost-efficient data pipelines supporting our Android connected and infotainment experiences. You will lead Python-based ETL/ELT...
-
Senior Data Pipelines Specialist
hace 2 semanas
Guadalajara, México Bebeedataengineer A tiempo completoJob Title: Senior Data EngineerDescriptionWe're looking for a skilled Senior Data Engineer to lead the design, build, and maintenance of our data pipelines.You'll work closely with cross-functional teams to define interfaces and data contracts.Our ideal candidate has strong Python expertise and experience designing reliable ETL/ELT at scale.Familiarity with...
-
Senior Data Engineer
hace 2 semanas
Guadalajara, México Brillio A tiempo completo**Senior Data Engineer - R**********:**Senior Data Engineer****Primary Skills**:- AKS, Event Hub, Azure DevOps, Cosmos DB, Azure Functions**Job requirements**:- Looking for a Data Engineer with Azure Data Stack expertise to design, build, and optimize large-scale data pipelines and analytics solutions.- Key Responsibilities:- Develop and maintain data...
-
Senior Data Pipeline Engineer
hace 1 semana
guadalajara, México Global Connect Technologies A tiempo completoA leading technology company is looking for a Senior Data Pipeline Engineer to design and operate secure data pipelines for Android experiences. This full-time role involves leading Python-based ETL/ELT development and Airflow orchestration, with responsibilities including implementing data quality tests and optimizing performance. Candidates should have...
