Senior Data Engineer
hace 2 semanas
Overview:**SENIOR DATA ENGINEER - ETL****Overview**Appen is the global leader in data for the AI Lifecycle. With over 25 years of experience in data sourcing, data annotation, and model evaluation by humans, we enable organizations to launch the world’s most innovative artificial intelligence systems. Our expertise includes a global crowd of over 1 million skilled contractors who speak over 235 languages, in over 70,000 locations and 170 countries, and the industry’s most advanced AI-assisted data annotation platform. Our products and services give leaders in technology, automotive, financial services, retail, healthcare, and governments the confidence to launch world-class AI products. Founded in 1996, Appen has customers and offices globally.**Responsibilities**- Design, build data models to support structured and unstructured data- Design, build and deploy scalable high-volume data ETL pipelines to move data across systems- Lead the architecture and implementation of batch and real-time data pipelines with instrumentation- Design, build data transformations, metrics and KPI with data governance and data privacy policies- Build centralized data lake, data warehouse and visualizations that support multiple use cases across different products for engineering and enterprise- Technical lead for new and existing product initiatives, assist with definition of product direction- Work with Product team to deliver features on time- Design and develop software and data solutions that help product, engineering and business teams make data-driven decisions- Owning existing processes running in production, problem solving and optimization- Partner with data scientists and machine learning engineers to provide quality data for model development and productionizing machine learning models- Partner with analytics team to build datasets that support visualizations- Conduct design and code reviews to deliver production quality code**Qualifications**- BS or MS in Computer Science or related technical discipline (or equivalent).- Excellent understanding of computer science fundamentals, data structures, and algorithms.- Excellent problem-solving skills.- 6+ years’ work experience in software development area with at least 4+ years’ experience in data warehouse space- 4+ years of experience in custom ETL/ELT design, patterns for efficient data integration, change data capture, implementation, and maintenance- 4+ years of experience in query writing (SQL & NoSQL), schema design, normalized data model and dimensional model- 4+ years of experience in API, Git, CI/CD, AWS Cloud, JAVA or Python language- 2+ years of experience in any MPP databases (AWS Redshift, Snowflake, etc) and RDBMS (PostgreSQL, mySQL)- 1+ year experience using Docker, Kubernetes.- Experience processing variety of data sources: Structured, Unstructured, Semi-Structed, SQL, PubSub, API and Event based in cloud-based infrastructure and data services- Experience in Hadoop, Map/Reduce, SQL, Kafka/Storm, Elastic Search, Airflow, and DBT- Excellent communication and collaboration skills in English- Strong coding skills in Java or Python- Proven results-oriented person with a delivery focus in a high velocity, high quality environment.**#LI-Remote
-
Senior Data Engineer
hace 2 semanas
Desde casa, México CODIGOMX A tiempo completo**Required Technologies**AGILE(Scrum),.Git and Github, Matillion, snowflake, SQL, ETL ProcessRequired LanguagesEnglish - Advanced**Description**We are looking for a data engineer with more than 3 years of experience in the following stack and overall experience of more than 5 years in Data Warehousing- Snowflake- SQL- ETL / ELT toolset- MatillionCurrently...
-
Senior Data Engineer
hace 2 semanas
Desde casa, México CODIGOMX A tiempo completo**Required Technologies** AGILE(Scrum),.Git and Github, Matillion, snowflake, SQL, ETL Process Required Languages English - Advanced **Description** We are looking for a data engineer with more than 3 years of experience in the following stack and overall experience of more than 5 years in Data Warehousing - Snowflake - SQL - ETL / ELT toolset -...
-
Data Engineer Senior
hace 4 semanas
Desde casa, México Max RH A tiempo completoImportante consultora de TI establecida en Cdmx, requiere un **CONSULTOR DATA ENGINEER SENIOR **para importante cliente retail. Integrate con nosotros, si cumples estos requisitos!!!**REQUISITOS TÉCNICOS**:- **Experiência más de 7 años como Data Engineer, especialmente con GCP**:- Experiência en ingeniería de datos, desarrollo de canales de datos...
-
Data Engineer Senior
hace 18 horas
Desde casa, México Max RH A tiempo completoImportante consultora de TI establecida en Cdmx, requiere un **CONSULTOR DATA ENGINEER SENIOR **para importante cliente retail. Integrate con nosotros, si cumples estos requisitos!!! **REQUISITOS TÉCNICOS**: - **Experiência más de 7 años como Data Engineer, especialmente con GCP**: - Experiência en ingeniería de datos, desarrollo de canales de datos...
-
Senior Data Engineer
hace 1 semana
Desde casa, México Podean A tiempo completoPodean is the leading global marketplace marketing agency. We work with progressive brands across the globe to unlock potential on Amazon, Target, Walmart, and other marketplaces. Our services span eCommerce strategy, content creation and optimization, media management, retail operations, data and analytics, consulting, and social commerce. Recent award wins...
-
Senior Data Engineer
hace 2 semanas
Desde casa, México Unosquare A tiempo completoWe are seeking a **Senior level Data Engineer**to lead the design and implementation of a modern AWS lakehouse for a data rich enterprise.**Requirements**:- **Minimum +6 years** building and operating large scale data platforms and ETL pipelines in production.- **Strong hands on experience** with **AWS** data services including **S3 Glue EMR DMS MWAA Athena...
-
Senior Data Engineer
hace 19 horas
Desde casa, México U hi A tiempo completo**Job Title**:Senior Data Engineer / Snowflake & DBT** (Remote)**Compensation**: 80K MXN - 120K MXN per month + benefits above the law.**Experience Summary**:- Experience in Snowflake: 4+ years- Experience in Data Build Tool: 1+ years**Position Overview**: The Senior Data Engineer will be responsible for designing, developing, and maintaining data pipelines...
-
Senior Data Engineer
hace 2 días
Desde casa, México U hi A tiempo completo**Job Title**:Senior Data Engineer / Snowflake & DBT** (Remote) **Compensation**: 80K MXN - 120K MXN per month + benefits above the law. **Experience Summary**: - Experience in Snowflake: 4+ years - Experience in Data Build Tool: 1+ years **Position Overview**: The Senior Data Engineer will be responsible for designing, developing, and maintaining data...
-
Senior Data Engineer
hace 1 semana
Desde casa, México Wizeline A tiempo completo**The Company**:Wizeline is a global digital services company helping mid-size to Fortune 500 companies build, scale, and deliver high-quality digital products and services. We thrive in solving our customer’s challenges through human-centered experiences, digital core modernization, and intelligence everywhere (AI/ML and data). We help them succeed in...
-
Senior Data Engineer
hace 2 semanas
Desde casa, México U hi A tiempo completo**Senior Data Engineer / Snowflake & DBT**:**About the Role**The Senior Data Engineer will be responsible for designing, developing, and maintaining data pipelines and solutions to enable our client to harness the power of the data for further analytics. The engineer will work with modern data technologies, with a strong emphasis on Snowflake and DBT (Data...
