Senior Data Engineer

hace 3 semanas


Mexicali, México Intugo A tiempo completo

Our Data Engineering team plays a key role in our technology company that’s experiencing exponential growth. Our data pipeline processes over 80 billion impressions a day ( > 20TB of data, 220 TB uncompressed). This data is used to generate reports, update budgets, and drive our optimization engines. We do all this while running against extremely tight SLAs and provide stats and reports as close to real-time as possible.

**Job Duties**:

- Design, build and maintain reliable and scalable enterprise level distributed transactional data processing systems for scaling the existing business and supporting new business initiatives
- Optimize jobs to utilize Kafka, Hadoop, Presto, Spark Streaming and Kubernetes resources in the most efficient way
- Monitor and provide transparency into data quality across systems (accuracy, consistency, completeness, etc)
- Increase accessibility and effectiveness of data (work with analysts, data scientists, and developers to build/deploy tools and datasets that fit their use cases)
- Collaborate within a small team with diverse technology backgrounds
- Provide mentorship and guidance to junior team members

**Technologies We Use**:

- Airflow - for job scheduling
- Docker - Packaged container image with all dependencies
- Graphite/Beacon - for monitoring data flows
- Hive - SQL data warehouse layer for data in HDFS
- Impala
- faster SQL layer on top of Hive
- Kafka
- distributed commit log storage
- Kubernetes - Distributed cluster resource manager
- Presto - fast parallel data warehouse and data federation layer
- Spark Streaming - Near time aggregation
- SQL Server - Reliable OLTP RDBMS
- Sqoop - Import/Export data to RDBMS

**Requirements**:

- BA/BS degree in Computer science or related field
- 5+ years of software engineering experience
- Fluency in Python, Experience in Scala/Java is a huge plus (Polyglot programmer preferred)
- Proficiency in Linux
- Strong understanding of RDBMS, SQL;
- Passion for engineering and computer science around data
- Knowledge and exposure to distributed production systems i.e Hadoop is a huge plus
- Knowledge and exposure to Cloud migration is a plus
- Willingness to participate in 24x7 on-call rotation

Tipo de puesto: Tiempo completo, Por tiempo indeterminado

Salario: $70,000.00 - $80,000.00 al mes

Horario:

- Lunes a viernes
- Turno de 8 horas

Idioma:

- Inglés (Obligatorio)


  • Senior Test Engineer

    hace 7 meses


    Mexicali, México Barbachano International, Inc. A tiempo completo

    **THE COMPANY** We have been retained by a global leader in high speed and high-density connection systems dedicated to delivering innovative products and services to their customers worldwide. This global leader has sales of nearly $11 billion USD and currently seeks a Senior Test Engineer experienced in Signal Integrity Analysis to join a plant start-up...

  • Data Engineer

    hace 2 semanas


    Mexicali, México Skyworks A tiempo completo

    If you are looking for a challenging and exciting career in the world of technology, then look no further. Skyworks is an innovator of high performance analog semiconductors whose solutions are powering the wireless networking revolution. At Skyworks, you will find a fast-paced environment with a strong focus on global collaboration, mínimal layers of...


  • Mexicali, México Skyworks A tiempo completo

    If you are looking for a challenging and exciting career in the world of technology, then look no further. Skyworks is an innovator of high performance analog semiconductors whose solutions are powering the wireless networking revolution. At Skyworks, you will find a fast-paced environment with a strong focus on global collaboration, mínimal layers of...

  • Data Engineer

    hace 2 días


    Mexicali, México PACCAR A tiempo completo

    **About PACCAR** PACCAR, Inc. is a Fortune 500 company established in 1905 and is recognized as a global leader in the commercial vehicle, financial, and customer service fields. PACCAR is a global technology leader in the design, manufacture, and customer support of high-quality light-, medium - and heavy-duty trucks under its internationally recognized...

  • Data Engineer

    hace 3 semanas


    Mexicali, México PACCAR A tiempo completo

    **About PACCAR** PACCAR, Inc. is a Fortune 500 company established in 1905 and is recognized as a global leader in the commercial vehicle, financial, and customer service fields. PACCAR is a global technology leader in the design, manufacture, and customer support of high-quality light-, medium - and heavy-duty trucks under its internationally recognized...

  • Data Engineer

    hace 4 días


    Mexicali, México PACCAR A tiempo completo

    **Company Information** PACCAR is a Fortune 500 company established in 1905. PACCAR Inc is recognized as a global leader in the commercial vehicle, financial, and customer service fields with internationally recognized brands such as Kenworth, Peterbilt, and DAF trucks. PACCAR is a global technology leader in the design, manufacture and customer support of...

  • Data Architect Senior

    hace 8 meses


    Mexicali, México Towa A tiempo completo

    **Senior Data Architect** **Description**: In our continued expansion, we are seeking a Senior Data Architect with strategic vision and proven experience. This position is key to leading the management, design and implementation of data solutions. If you have a passion for technology and an innovative approach to data architecture, we are waiting for...


  • Mexicali, México NTT DATA A tiempo completo

    **Req ID**: 248889 We are currently seeking a Field Tech Senior Representative to join our team in Mexicali, Baja California (MX-BCN), Mexico (MX). Performs basic configuration of desktop / notebook /printers. - May assist with simple parts replacement and repair on desktops /notebooks/ printers. - Travel may be required *Basic knowledge of Windows...

  • Senior Quality Engineer

    hace 3 semanas


    Mexicali, México OPERADOR DE ALBERGUES A tiempo completo

    The Senior Quality Engineer will be responsible to continue developing the company's Quality System as well oversee its implementation and maintenance. Quality System (Procedures, Work instructions, register, etc.) should be aligned to meet our customer requirements in order to provide them grateful experiences. The Quality Engineer will also provide support...

  • Senior Test Engineer

    hace 2 semanas


    Mexicali, México Skyworks A tiempo completo

    If you are looking for a challenging and exciting career in the world of technology, then look no further. Skyworks is an innovator of high performance analog semiconductors whose solutions are powering the wireless networking revolution. At Skyworks, you will find a fast-paced environment with a strong focus on global collaboration, mínimal layers of...


  • Mexicali, México Web Shop Manager A tiempo completo

    **About Web Shop Manager & PartsLogic** Web Shop Manager is a company dedicated to providing innovative solutions in the automotive parts industry. With a focus on E-Commerce, Search & Discovery, Fitment and vehicle data to create powerful e-commerce experiences with efficiency, accuracy, and customer satisfaction. We aim to enhance the overall experience...

  • Data Engineer

    hace 3 días


    Mexicali, México PACCAR A tiempo completo

    **Company Information** **PACCAR is a Fortune 500 company established in 1905. PACCAR Inc is recognized as a global leader in the commercial vehicle, financial, and customer service fields with internationally recognized brands such as Kenworth, Peterbilt, and DAF trucks. PACCAR is a global technology leader in the design, manufacture and customer support...


  • Mexicali, Baja California, México Safran A tiempo completo

    Job OverviewSafran is seeking a highly skilled Senior Software Engineer to join our team in Mexicali, Baja California Sur, Mexico. This permanent full-time position requires a bachelor's degree and more than 3 years of experience in software development.

  • Test Engineer

    hace 7 días


    Mexicali, México Garrett Advancing Motion A tiempo completo

    Be part of a team that designs, modifies, writes and implements test equipment solutions You will work with Senior engineers to turn requirements into deliverable products An opportunity to be engaged in full product lifecycle, from inception to final product As a test engineer, you are responsible for all aspects related to test engineering which includes...


  • Mexicali, Baja California, México Sensata Technologies, Inc. A tiempo completo

    About the RoleAs a Senior Automation Engineer at Sensata Technologies, Inc., you will be responsible for designing and automating processes to improve efficiency and productivity.Job DescriptionAnalyze and troubleshoot electrical test and automated equipmentContinuously improve processes and reduce cycle timesReduce false rejections in equipment controlled...


  • Mexicali, Baja California, México Zillow A tiempo completo

    At Zillow, we are reimagining real estate to make it easier to unlock life's next chapter. As the most-visited real estate website in the United States, we help movers find and win their home through digital solutions, first-class partners, and easier buying, selling, financing, and renting experiences.As a Senior Software Development Engineer in our Data...


  • Mexicali, Baja California, México Skyworks A tiempo completo

    Company OverviewSkyworks is an innovator of high-performance analog semiconductors powering the wireless networking revolution. Our fast-paced environment prioritizes global collaboration, minimal layers of management, and freedom to contribute meaningfully in a setting that encourages creativity and out-of-the-box thinking.Job DescriptionWe are seeking a...


  • Mexicali, Baja California, México Insulet Corporation A tiempo completo

    Insulet Corporation is a leading developer of innovative medical devices, aiming to improve the lives of hundreds of thousands of patients worldwide.Job Title: Senior Systems Design EngineerRole OverviewWe are seeking an experienced Senior Systems Design Engineer to join our team. This role will be responsible for collaborating with seasoned Systems...


  • Mexicali, Baja California, México Amphenol Tcs De México, S.A. De C.V. A tiempo completo

    About the CompanyAmphenol TCS De México, S.A. De C.V. is a leading company in the industry.Job Title: Senior Quality Process Engineer$73,000 - $93,000 per yearAbout the JobWe are seeking an experienced Senior Quality Process Engineer to join our team at Amphenol TCS De México, S.A. De C.V.The ideal candidate will have a strong background in quality...


  • Mexicali, Baja California, México Web Shop Manager A tiempo completo

    OverviewAs a leading SaaS company in the automotive aftermarket industry, we are seeking a skilled Data Engineer/Analyst to join our team. With over 20 years of experience and a strong presence in the market, we are committed to delivering innovative solutions.Responsibilities:Collecting, analyzing, and interpreting data related to automotive trends,...