Senior Data Engineer

hace 2 días

Mexicali, México Intugo A tiempo completo

Our Data Engineering team plays a key role in our technology company that’s experiencing exponential growth. Our data pipeline processes over 80 billion impressions a day ( > 20TB of data, 220 TB uncompressed). This data is used to generate reports, update budgets, and drive our optimization engines. We do all this while running against extremely tight SLAs and provide stats and reports as close to real-time as possible.**Job Duties**:- Design, build and maintain reliable and scalable enterprise level distributed transactional data processing systems for scaling the existing business and supporting new business initiatives- Optimize jobs to utilize Kafka, Hadoop, Presto, Spark Streaming and Kubernetes resources in the most efficient way- Monitor and provide transparency into data quality across systems (accuracy, consistency, completeness, etc)- Increase accessibility and effectiveness of data (work with analysts, data scientists, and developers to build/deploy tools and datasets that fit their use cases)- Collaborate within a small team with diverse technology backgrounds- Provide mentorship and guidance to junior team members**Technologies We Use**:- Airflow - for job scheduling- Docker - Packaged container image with all dependencies- Graphite/Beacon - for monitoring data flows- Hive - SQL data warehouse layer for data in HDFS- Impala- faster SQL layer on top of Hive- Kafka- distributed commit log storage- Kubernetes - Distributed cluster resource manager- Presto - fast parallel data warehouse and data federation layer- Spark Streaming - Near time aggregation- SQL Server - Reliable OLTP RDBMS- Sqoop - Import/Export data to RDBMS**Requirements**:- BA/BS degree in Computer science or related field- 5+ years of software engineering experience- Fluency in Python, Experience in Scala/Java is a huge plus (Polyglot programmer preferred)- Proficiency in Linux- Strong understanding of RDBMS, SQL;- Passion for engineering and computer science around data- Knowledge and exposure to distributed production systems i.e Hadoop is a huge plus- Knowledge and exposure to Cloud migration is a plus- Willingness to participate in 24x7 on-call rotationTipo de puesto: Tiempo completo, Por tiempo indeterminadoSalario: $70,000.00 - $80,000.00 al mesHorario:- Lunes a viernes- Turno de 8 horasIdioma:- Inglés (Obligatorio)

  • Ai Data Engineer: Build Scalable Data Pipelines For Ml

    hace 3 semanas

    Mexicali, México Trimble Inc. A tiempo completo

    A leading technology company in Mexicali is seeking an AI Data Engineer to assist in building and optimizing data pipelines for machine learning applications.The role involves working under senior engineers, contributing to data cleaning, and ensuring data integrity.Ideal candidates should have a Bachelor's degree in a relevant field and foundational...

  • Senior Test Engineer

    hace 4 semanas

    Mexicali, México Barbachano International, Inc. A tiempo completo

    **THE COMPANY**We have been retained by a global leader in high speed and high-density connection systems dedicated to delivering innovative products and services to their customers worldwide. This global leader has sales of nearly $11 billion USD and currently seeks a Senior Test Engineer experienced in Signal Integrity Analysis to join a plant start-up in...

  • Ai Data Engineer For Construction Pipelines

    hace 3 semanas

    Mexicali, México Trimble Inc. A tiempo completo

    A leading technology company in Mexicali is seeking a Data Engineer/Scientist to build and maintain data pipelines essential for AI in construction.This position offers hands-on experience with diverse datasets and cloud environments, under the guidance of senior engineers.Applicants should have a Bachelor's degree in a relevant field and a foundational...

  • Data Engineer

    hace 3 semanas

    Mexicali, México Skyworks A tiempo completo

    If you are looking for a challenging and exciting career in the world of technology, then look no further.Skyworks is an innovator of high performance analog semiconductors whose solutions are powering the wireless networking revolution.At Skyworks, you will find a fast-paced environment with a strong focus on global collaboration, mínimal layers of...

  • Senior Software Engineer

    hace 1 semana

    Mexicali, México Skyworks A tiempo completo

    If you are looking for a challenging and exciting career in the world of technology, then look no further. Skyworks is an innovator of high performance analog semiconductors whose solutions are powering the wireless networking revolution. At Skyworks, you will find a fast-paced environment with a strong focus on global collaboration, mínimal layers of...

  • Data Engineer

    hace 2 semanas

    Mexicali, B.C., México Bhuvi IT Solutions A tiempo completo

    Data EngineerLocation: Mexico (100% Remote)Role Overview:We are seeking an experienced Data Engineer to design, build, and manage scalable data pipelines and data models that support enterprise retail data platforms. The ideal candidate will have strong experience working with Azure-based data solutions and modern data engineering practices.Key...

  • Data Engineer/Scientist

    hace 3 semanas

    Mexicali, México Trimble Inc. A tiempo completo

    Your Title: Data Engineer/ScientistJob Location: Mexicali, MexicoOur Business Segment: Architecture, Engineering, Construction and Owner Segment (AECO)Are you eager to build the data pipelines that power the next generation of AI in construction?This role is a fantastic opportunity to start your career in data engineering for AI, focusing on the essential...

  • Senior Genomics Engineer — AI

    hace 3 semanas

    Mexicali, México J. Craig Venter Institute A tiempo completo

    A pioneering genomics startup in Mexicali seeks a Senior Bioinformatics Engineer to develop advanced genomic platforms and algorithms. You will work on genome assembly, annotation, and AI architectures to drive insights from vast genomic data. The ideal candidate has a Master’s or PhD with over 10 years of experience in bioinformatics and exceptional...

  • Senior Genomics Engineer — AI

    hace 3 semanas

    Mexicali, México J. Craig Venter Institute A tiempo completo

    A pioneering genomics startup in Mexicali seeks a Senior Bioinformatics Engineer to develop advanced genomic platforms and algorithms. You will work on genome assembly, annotation, and AI architectures to drive insights from vast genomic data. The ideal candidate has a Master’s or PhD with over 10 years of experience in bioinformatics and exceptional...

  • Data Architect Senior

    hace 2 semanas

    Mexicali, México Towa A tiempo completo

    **Senior Data Architect****Description**:In our continued expansion, we are seeking a Senior Data Architect with strategic vision and proven experience. This position is key to leading the management, design and implementation of data solutions. If you have a passion for technology and an innovative approach to data architecture, we are waiting for...