Senior Data Engineer
hace 3 semanas
Senior Data Engineer Intugo • Monterrey, Nuevo León, México Descripción del trabajo Our Data Engineering team plays a key role in a technology company that is experiencing exponential growth. The data pipeline processes over 80 billion impressions a day ( >20 TB of data, 220 TB uncompressed). This data is used to generate reports, update budgets, and drive optimization engines while running against extremely tight SLAs and providing real‑time statistics and reports. Job Duties Design, build, and maintain reliable and scalable enterprise‑level distributed transactional data processing systems to support existing and new business initiatives. Optimize jobs to utilize Kafka, Hadoop, Presto, Spark Streaming, and Kubernetes resources in the most efficient way. Monitor and provide transparency into data quality across systems (accuracy, consistency, completeness, etc.). Increase accessibility and effectiveness of data by working with analysts, data scientists, and developers to build/deploy tools and datasets that fit their use cases. Collaborate within a small team with diverse technology backgrounds. Provide mentorship and guidance to junior team members. Technologies We Use Airflow – job scheduling Docker – packaged container image with all dependencies Graphite/Beacon – monitoring data flows Hive – SQL data warehouse layer for data in HDFS Impala – faster SQL layer on top of Hive Kafka – distributed commit log storage Kubernetes – distributed cluster resource manager Presto – fast parallel data warehouse and data federation layer Spark Streaming – near‑time aggregation SQL Server – reliable OLTP RDBMS Sqoop – import/export data to RDBMS Requirements BA/BS degree in Computer Science or related field 5+ years of software engineering experience Fluency in Python; experience in Scala/Java is a huge plus (polyglot programmer preferred) Proficiency in Linux Strong understanding of RDBMS, SQL Passion for engineering and computer science around data Knowledge and exposure to distributed production systems (e.g., Hadoop) is a huge plus Knowledge and exposure to cloud migration is a plus Willingness to participate in a 24×7 on‑call rotation Detalles del puesto Tipo de puesto: Tiempo completo, por tiempo indeterminadoSalario: $70,****** – $80,****** al mesHorario: Lunes a viernes, turno de 8 horasIdioma: Inglés (obligatorio) #J-18808-Ljbffr
-
Senior Data Engineer
hace 3 semanas
Monterrey, México Dmi A tiempo completoSenior Data Engineer Monterrey, Nuevo León, México Descripción del trabajo About DMI:About the Opportunity:DMI, LLC is seeking a Senior Data Engineer to join us. This position requires the resource to be located in Monterrey, Mexico. Duties and Responsibilities Senior Data Engineer for the Central Comptroller Project Knowledge in Data Modeling, Data...
-
Data Engineer Senior Remote
hace 3 semanas
Monterrey, México Training Talent A tiempo completoData Engineer Senior Remote Training Talent•Monterrey, Nuevo León, México Descripción del trabajo Vacante para la empresa Training Talent en Monterrey, Nuevo León: Somos una consultora de servicios de desarrollo de software con integraciones en nube, soluciones IoT y Machine Learning con presencia en Latam y EE. UU. Socios de Microsoft, Amazon,...
-
Senior Data Engineer
hace 6 días
Monterrey, México DMI A tiempo completoAbout DMI:About the Opportunity:DMI, LLC is seeking a **Senior Data Engineer **to join us. This position requires the resource to be located in Monterrey, Mexico.**Duties and** Responsibilities**:- Senior Data Engineer for the Central Comptroller Project Knowledge in Data Modeling, Data Ingestion, and Data VisualizationQualifications:**Education and Years of...
-
Senior Data Engineer: Real-Time Platforms
hace 2 semanas
Monterrey, México Slalom Consulting A tiempo completoSenior Data Engineer: Real-Time Platforms & AI Slalom Consulting • Monterrey, Nuevo León, Mexico Descripción del trabajo A global technology consultancy in Monterrey is seeking a Senior Engineer in Data Engineering to deliver innovative solutions using cloud tools like AWS and Azure. The ideal candidate should have hands‑on experience with big data...
-
Senior Data Engineer: Real-Time Platforms
hace 2 semanas
Monterrey, México Slalom Consulting A tiempo completoSenior Data Engineer: Real-Time Platforms & AI Slalom Consulting • Monterrey, Nuevo León, Mexico Descripción del trabajo A global technology consultancy in Monterrey is seeking a Senior Engineer in Data Engineering to deliver innovative solutions using cloud tools like AWS and Azure. The ideal candidate should have hands‑on experience with big data...
-
Senior Data Engineer
hace 2 semanas
Monterrey, México DataArt A tiempo completoClient: Our client is a huge investment company headquartered in New York City. Project overview: This exciting project's primary objective is to develop a cutting-edge Data Platform to empower business users with insights they need to make data-driven investment decisions. We've already successfully deployed the initial Data Warehouse into...
-
Senior Data Engineer
hace 1 semana
Monterrey, México DataArt A tiempo completoClient: Our client is a leading airline group known for its extensive network and dedication to outstanding customer service. Position overview: We’re looking for a Data Engineer to join the Customer Loyalty team, directly embedded with the business. In this role, you’ll design, build, and manage data pipelines that support business-driven data products....
-
Senior Data Engineer: Real-Time Platforms
hace 4 semanas
Monterrey, México Slalom Consulting A tiempo completoA global technology consultancy in Monterrey is seeking a Senior Engineer in Data Engineering to deliver innovative solutions using cloud tools like AWS and Azure. The ideal candidate should have hands-on experience with big data platforms and programming languages such as Java and Python. You will work collaboratively to address clients' data challenges and...
-
Senior Data Engineer: Real-Time Platforms
hace 4 semanas
Monterrey, México Slalom Consulting A tiempo completoA global technology consultancy in Monterrey is seeking a Senior Engineer in Data Engineering to deliver innovative solutions using cloud tools like AWS and Azure. The ideal candidate should have hands-on experience with big data platforms and programming languages such as Java and Python. You will work collaboratively to address clients' data challenges and...
-
Senior Ai Data Engineer
hace 6 días
Monterrey, México DMI A tiempo completoAbout DMI:About the Opportunity:DMI, LLC is seeking a** Senior AI Data Engineer** to join us. This position requires the resource to be located in Monterrey, Mexico.**Duties and** Responsibilities**:- Data Engineer specializing in Generative Artificial Intelligence, specifically in Azure ChatGPT models or others, with the ability to configure them, set up...
