Senior Data Engineer
hace 3 semanas
Our Data Engineering team plays a key role in our technology company that’s experiencing exponential growth. Our data pipeline processes over 80 billion impressions a day ( > 20TB of data, 220 TB uncompressed). This data is used to generate reports, update budgets, and drive our optimization engines. We do all this while running against extremely tight SLAs and provide stats and reports as close to real-time as possible.
**Job Duties**:
- Design, build and maintain reliable and scalable enterprise level distributed transactional data processing systems for scaling the existing business and supporting new business initiatives
- Optimize jobs to utilize Kafka, Hadoop, Presto, Spark Streaming and Kubernetes resources in the most efficient way
- Monitor and provide transparency into data quality across systems (accuracy, consistency, completeness, etc)
- Increase accessibility and effectiveness of data (work with analysts, data scientists, and developers to build/deploy tools and datasets that fit their use cases)
- Collaborate within a small team with diverse technology backgrounds
- Provide mentorship and guidance to junior team members
**Technologies We Use**:
- Airflow - for job scheduling
- Docker - Packaged container image with all dependencies
- Graphite/Beacon - for monitoring data flows
- Hive - SQL data warehouse layer for data in HDFS
- Impala
- faster SQL layer on top of Hive
- Kafka
- distributed commit log storage
- Kubernetes - Distributed cluster resource manager
- Presto - fast parallel data warehouse and data federation layer
- Spark Streaming - Near time aggregation
- SQL Server - Reliable OLTP RDBMS
- Sqoop - Import/Export data to RDBMS
**Requirements**:
- BA/BS degree in Computer science or related field
- 5+ years of software engineering experience
- Fluency in Python, Experience in Scala/Java is a huge plus (Polyglot programmer preferred)
- Proficiency in Linux
- Strong understanding of RDBMS, SQL;
- Passion for engineering and computer science around data
- Knowledge and exposure to distributed production systems i.e Hadoop is a huge plus
- Knowledge and exposure to Cloud migration is a plus
- Willingness to participate in 24x7 on-call rotation
Tipo de puesto: Tiempo completo, Por tiempo indeterminado
Salario: $70,000.00 - $80,000.00 al mes
Horario:
- Lunes a viernes
- Turno de 8 horas
Idioma:
- Inglés (Obligatorio)
-
Senior Test Engineer
hace 7 meses
Mexicali, México Barbachano International, Inc. A tiempo completo**THE COMPANY** We have been retained by a global leader in high speed and high-density connection systems dedicated to delivering innovative products and services to their customers worldwide. This global leader has sales of nearly $11 billion USD and currently seeks a Senior Test Engineer experienced in Signal Integrity Analysis to join a plant start-up...
-
Data Engineer
hace 2 semanas
Mexicali, México Skyworks A tiempo completoIf you are looking for a challenging and exciting career in the world of technology, then look no further. Skyworks is an innovator of high performance analog semiconductors whose solutions are powering the wireless networking revolution. At Skyworks, you will find a fast-paced environment with a strong focus on global collaboration, mínimal layers of...
-
Senior Software Engineer
hace 7 meses
Mexicali, México Skyworks A tiempo completoIf you are looking for a challenging and exciting career in the world of technology, then look no further. Skyworks is an innovator of high performance analog semiconductors whose solutions are powering the wireless networking revolution. At Skyworks, you will find a fast-paced environment with a strong focus on global collaboration, mínimal layers of...
-
Data Engineer
hace 2 días
Mexicali, México PACCAR A tiempo completo**About PACCAR** PACCAR, Inc. is a Fortune 500 company established in 1905 and is recognized as a global leader in the commercial vehicle, financial, and customer service fields. PACCAR is a global technology leader in the design, manufacture, and customer support of high-quality light-, medium - and heavy-duty trucks under its internationally recognized...
-
Data Engineer
hace 3 semanas
Mexicali, México PACCAR A tiempo completo**About PACCAR** PACCAR, Inc. is a Fortune 500 company established in 1905 and is recognized as a global leader in the commercial vehicle, financial, and customer service fields. PACCAR is a global technology leader in the design, manufacture, and customer support of high-quality light-, medium - and heavy-duty trucks under its internationally recognized...
-
Data Engineer
hace 4 días
Mexicali, México PACCAR A tiempo completo**Company Information** PACCAR is a Fortune 500 company established in 1905. PACCAR Inc is recognized as a global leader in the commercial vehicle, financial, and customer service fields with internationally recognized brands such as Kenworth, Peterbilt, and DAF trucks. PACCAR is a global technology leader in the design, manufacture and customer support of...
-
Data Architect Senior
hace 8 meses
Mexicali, México Towa A tiempo completo**Senior Data Architect** **Description**: In our continued expansion, we are seeking a Senior Data Architect with strategic vision and proven experience. This position is key to leading the management, design and implementation of data solutions. If you have a passion for technology and an innovative approach to data architecture, we are waiting for...
-
Field Tech Senior Representative
hace 7 meses
Mexicali, México NTT DATA A tiempo completo**Req ID**: 248889 We are currently seeking a Field Tech Senior Representative to join our team in Mexicali, Baja California (MX-BCN), Mexico (MX). Performs basic configuration of desktop / notebook /printers. - May assist with simple parts replacement and repair on desktops /notebooks/ printers. - Travel may be required *Basic knowledge of Windows...
-
Senior Quality Engineer
hace 3 semanas
Mexicali, México OPERADOR DE ALBERGUES A tiempo completoThe Senior Quality Engineer will be responsible to continue developing the company's Quality System as well oversee its implementation and maintenance. Quality System (Procedures, Work instructions, register, etc.) should be aligned to meet our customer requirements in order to provide them grateful experiences. The Quality Engineer will also provide support...
-
Senior Test Engineer
hace 2 semanas
Mexicali, México Skyworks A tiempo completoIf you are looking for a challenging and exciting career in the world of technology, then look no further. Skyworks is an innovator of high performance analog semiconductors whose solutions are powering the wireless networking revolution. At Skyworks, you will find a fast-paced environment with a strong focus on global collaboration, mínimal layers of...
-
Search, Ml/ai, Data Engineer
hace 7 meses
Mexicali, México Web Shop Manager A tiempo completo**About Web Shop Manager & PartsLogic** Web Shop Manager is a company dedicated to providing innovative solutions in the automotive parts industry. With a focus on E-Commerce, Search & Discovery, Fitment and vehicle data to create powerful e-commerce experiences with efficiency, accuracy, and customer satisfaction. We aim to enhance the overall experience...
-
Data Engineer
hace 3 días
Mexicali, México PACCAR A tiempo completo**Company Information** **PACCAR is a Fortune 500 company established in 1905. PACCAR Inc is recognized as a global leader in the commercial vehicle, financial, and customer service fields with internationally recognized brands such as Kenworth, Peterbilt, and DAF trucks. PACCAR is a global technology leader in the design, manufacture and customer support...
-
Senior Software Engineer
hace 6 días
Mexicali, Baja California, México Safran A tiempo completoJob OverviewSafran is seeking a highly skilled Senior Software Engineer to join our team in Mexicali, Baja California Sur, Mexico. This permanent full-time position requires a bachelor's degree and more than 3 years of experience in software development.
-
Test Engineer
hace 7 días
Mexicali, México Garrett Advancing Motion A tiempo completoBe part of a team that designs, modifies, writes and implements test equipment solutions You will work with Senior engineers to turn requirements into deliverable products An opportunity to be engaged in full product lifecycle, from inception to final product As a test engineer, you are responsible for all aspects related to test engineering which includes...
-
Senior Automation Engineer
hace 2 meses
Mexicali, Baja California, México Sensata Technologies, Inc. A tiempo completoAbout the RoleAs a Senior Automation Engineer at Sensata Technologies, Inc., you will be responsible for designing and automating processes to improve efficiency and productivity.Job DescriptionAnalyze and troubleshoot electrical test and automated equipmentContinuously improve processes and reduce cycle timesReduce false rejections in equipment controlled...
-
Highly Skilled Data Engineer for Real Estate Innovation
hace 15 minutos
Mexicali, Baja California, México Zillow A tiempo completoAt Zillow, we are reimagining real estate to make it easier to unlock life's next chapter. As the most-visited real estate website in the United States, we help movers find and win their home through digital solutions, first-class partners, and easier buying, selling, financing, and renting experiences.As a Senior Software Development Engineer in our Data...
-
Senior Analog Semiconductor Engineer
hace 2 meses
Mexicali, Baja California, México Skyworks A tiempo completoCompany OverviewSkyworks is an innovator of high-performance analog semiconductors powering the wireless networking revolution. Our fast-paced environment prioritizes global collaboration, minimal layers of management, and freedom to contribute meaningfully in a setting that encourages creativity and out-of-the-box thinking.Job DescriptionWe are seeking a...
-
Senior Systems Design Engineer
hace 2 meses
Mexicali, Baja California, México Insulet Corporation A tiempo completoInsulet Corporation is a leading developer of innovative medical devices, aiming to improve the lives of hundreds of thousands of patients worldwide.Job Title: Senior Systems Design EngineerRole OverviewWe are seeking an experienced Senior Systems Design Engineer to join our team. This role will be responsible for collaborating with seasoned Systems...
-
Senior Quality Process Engineer
hace 4 semanas
Mexicali, Baja California, México Amphenol Tcs De México, S.A. De C.V. A tiempo completoAbout the CompanyAmphenol TCS De México, S.A. De C.V. is a leading company in the industry.Job Title: Senior Quality Process Engineer$73,000 - $93,000 per yearAbout the JobWe are seeking an experienced Senior Quality Process Engineer to join our team at Amphenol TCS De México, S.A. De C.V.The ideal candidate will have a strong background in quality...
-
Automotive Aftermarket Data Specialist
hace 2 meses
Mexicali, Baja California, México Web Shop Manager A tiempo completoOverviewAs a leading SaaS company in the automotive aftermarket industry, we are seeking a skilled Data Engineer/Analyst to join our team. With over 20 years of experience and a strong presence in the market, we are committed to delivering innovative solutions.Responsibilities:Collecting, analyzing, and interpreting data related to automotive trends,...