Lead Data Engineer
hace 2 semanas
**Project** Description**:
Luxoft DXC Technology Company is an established company focusing on consulting and implementation of complex projects in the financial industry. At the interface between technology and business, we convince with our know-how, well-founded methodology and pleasure in success. As a reliable partner to our renowned customers, we support them in planning, designing and implementing the desired innovations. Together with the customer, we deliver top performance
For one of our Client in the Insurance Segment, we are searching for a Lead Data Engineer.
**Responsibilities**:
- Demonstrates ownership and teamwork. Leads data product design, code development, production deployment, and production support efforts.
- Coordinates Data product development efforts with other Data Engineers in the squad and helps Product Owner in work assignments. Represents other Data Engineers and provides updates on overall development efforts
- Represents Data product changes in CAB meetings.
- Leads resolution and implementation of all production defects and changes
- Reviews the code developed by other Data Engineers and ensures data engineering best practices are followed
- Actively supports Data products production runs, validates the data products for completeness & accuracy and coordinates with Production support teams
- Ensures implementation of data and IT controls in Data products
- Actively involved in creation of data products including development, testing, deployment, and production support. Required to perform following activities hands-on
- Explore and understand data sets. o Building data pipelines, integrating, and scheduling ETL jobs using CI/CD framework. o Implement required data transformation in the data lake. o Visualize the data set; determine whether the data set has enough information to answer the data product requirements. o Work with IT support to create and visualize the data and data products on the data lake. o Configure required security and data masking to a data set. o Support testing of data acquisition, data set correlation, and / or product development. Investigate; resolve data and interface issues o Work with IT to harden and productionize data products, and business procedures.**Skills**:
Must have
- Master's/ Bachelor's Degree in one of the following: Engineering, Computer Science, Statistical Analytics, Data Science, or Actuarial Science.
- Big Data/Hadoop Technical Lead with extensive experience on the Hadoop platform and related Big Data tools/technologies.
- 5+ Years of experience in Big Data Technologies, 10+ years' experience in Data Warehouse, Business Intelligence, and analytics area. o 3 + Years of experience in Hadoop Eco Systems o 2+ Years of experience in Spark o 1+ years' experience with Microsoft Azure and/or AWS o Any exposure to Mainframe as a source is preferred
- Good knowledge of architecture, design patterns, Source target mappings, ETL Architecture in Hadoop space, data modeling techniques, performance tuning in Hadoop environment.
- Experience with big data tools: Hadoop (CDH), Spark, Kafka, PySpark, python, Impala, Hive, Hue, HDFS and related tools
- Experience in Azure DevOps and CI/CD tools such as Maven, Git/Stash, Jenkins, Docker etc.
- Experience in Tableau data visualization tool is plus
- Advance level knowledge and experience with SQL queries including performance optimization techniques
- Working experience in Shell Scripts, Oozie workflows, scheduling tools (Stone branch or CA7).
- Able to analyze huge volume of data and understand patterns, data quality issues and design solutions to manage volume.
- Experience working in Agile environment
- Ability to modularize the project components, architect the complete project and provide solution architecture.
- Excellent written, verbal, and interpersonal skills, a must as there will be significant collaboration with the business and IT
- Experience with collaborative development workflows (e.g., Microsoft DevOps Tools).
Nice to have**Languages**:
English: C1 Advanced
**Seniority**:
Lead
**Relocation package**:
If needed, we can help you with relocation process.
Vacancy Specialization
BigData Development
Ref Number
VR-95718
-
Lead Azure Data Engineer
hace 7 días
Desde casa, México Datalogics A tiempo completo**Lead Azure Data Engineer (REMOTE)** - **5000 USD - 6000 USD/month**: - **100% remote work**: - Full time - **B2B contract**: - **Direct employment by the company** We’re looking for a **Lead** **Azure Data Engineer **for a specialist supply chain, data and software engineering solutions company with over 380 employees, development centers in the USA...
-
Data Lead Engineer
hace 2 días
Desde casa, México Testing IT A tiempo completo**TESTING IT** Somos una empresa líder en pruebas de software, brindamos servicios en México y Nearshore a EEUU; te invitamos a unirte como** DATA LEAD ENGINEER**, jugará un papel fundamental para brindar servicios de TI excepcionales: **Buscamos a partir de 5-8 años de Experiência en**: **NIVEL DE INGLES CONVERSACIONAL B2-C2/ OBLIGATORIO** Alto...
-
Data Engineer for a U.s.-based, Fast-growing
hace 3 días
Desde casa, México Data Driven Partners A tiempo completoThe Role: Data Engineer - "Data Swiss Army Knife" **Responsibilities**: - Build and maintain ETL pipelines for moving and transforming data between sources. - Design data warehouses and create large-scale real-time analytics systems using big data technologies. - Developmetrics, dashboards, and reports from large datasets using SQL or other query...
-
Data Engineer
hace 4 días
Desde casa, México CODIGOMX A tiempo completo**Data Engineering** A Data Engineer works alongside Data Scientists in the team to develop scalable and production-ready Advanced Analytics and AI software and products. Additionally, they produce different technical tools/services to enable large-scale Machine Learning solutions. This professional beliefs in a non-hierarchical culture of collaboration,...
-
Data Engineer
hace 5 horas
Desde casa, México 117 Human Resources Analytics A tiempo completoBuscamos conectar al Talento Correcto para la posición de: **Data Engineer** - **Tipo de contratación**:Directa / Full Time - **Zona de Trabajo**: Ciudad de México (remoto) **Funciones**: - Diseñar, crear y mantener canalizaciones de datos por lotes o en tiempo real en producción. - Mantener y optimizar la infraestructura de datos necesaria para una...
-
Data Engineer con Azure
hace 3 días
Desde casa, México Talent Accelerator A tiempo completoUna compañía mexicana líder en Software as a Service y Estudios de Mercado está buscando a un Azure Data Engineer. Tu responsabilidad principal será el desarrollo de pipelines para la extracción, transformación y carga de datos **(ETL)** en la nube mediante **Azure**. Esto implica utilizar herramientas como: - Azure SQL Server - Azure Blob Storage -...
-
Data Engineer
hace 7 días
Desde casa, México Bow River Solutions Inc. A tiempo completo**Data Engineer** **About Bow River Solutions** Based in Calgary, Alberta, Bow River Solutions provides Business Intelligence solutions that transform your data into actionable insights. With over 18 years of experience, we have forged partnerships with industry-leading vendors to provide cutting-edge analytics solutions. Our successful projects across...
-
Data Engineer
hace 2 días
Desde casa, México Getecsa A tiempo completoSomos una empresa líder de gestión de capital humano y servicios tecnológicos con más de 15 años en el mercado nacional y Centro América, ofreciendo un valor agregado y solución a los procesos de consultoría de TI, atracción de talento, pruebas de Software y centro de desarrollo. Teniendo siempre la satisfacción de nuestros clientes y el...
-
Azure Data Engineer
hace 3 días
Desde casa, México Talent Accelerator A tiempo completoA leading Mexican company in Software as a Service and Market Research is looking for an Azure Data Engineer. Your main responsibility will be the development of pipelines for data extraction, transformation, and loading **(ETL)** in the cloud using **Azure. **This involves using tools such as: - Azure SQL Server - Azure Blob Storage - Azure Data Lake -...
-
Senior/lead Data Software Engineer
hace 2 días
Desde casa, México AgileEngine A tiempo completoID: 12022 **What you will do** - Collaborate closely with Data Scientists to understand their data requirements, model development needs, and performance optimization goals; - Design, build, and maintain scalable data pipelines and infrastructure to support ML model development and deployment; - Collect, process, and prepare large datasets for analysis,...
-
Data Engineer
hace 4 días
Desde casa, México SINTELTI A tiempo completo**SUMA TU TALENTO Y EXPANDE TU EXPERIENCIA EN NUESTRO EQUIPO.** **SOLICITAMOS: Data engineer (Jr, Mid, Sr).** Ofrecemos: Salario a convenir de acuerdo a aptitudes y experiência Sueldo 100% nominal Excelente ambiente de trabajo Prestaciones superiores Seguro de vida Seguro de gastos medicos Fondo de ahorro Vales de despensa Alto nível de crecimiento y...
-
Azure Data Engineer
hace 2 días
Desde casa, México ENKI S. A. DE C. V A tiempo completo_En ENKI construimos herramientas que analizan el comportamiento de sus clientes y a través de los datos existentes, se toman decisiones rápidas para cumplir con sus objetivos._ Estamos en búsqueda de _**AZURE DATA ENGINEER**_para el sector retail. - ¿Qué buscamos?_ +2 años de experiência en: - Diseño y creación de ETLs/Pipelines con Azure Data...
-
Mid Data Engineer
hace 3 días
Desde casa, México Valce Talent Solutions A tiempo completo**Requirements**: - 3+ years of experience as Data Engineer - B2+ English (fluent) - Ability to write DDL/DML/DQL (any RDBMS) queries - Programming language (Python, Spark, R, etc.) - Any experience with other relational databases, BI reporting and data discovery tools (PowerBI, Tableau, SQL Server, Snowflake, MS Azure) - Any experience building solutions...
-
Azure Data Engineer
hace 3 días
Desde casa, México Datalogics A tiempo completo36 000 USD - 48 000 USD/year - 100% remote work - Full time - B2B contract - Direct employment by the company We’re looking for an Azure Data Engineer for a specialist supply chain, data and software engineering solutions company with over 380 employees, development centers in the USA and India within 3 years of starting operations. **Requirements**: -...
-
Data Engineer
hace 4 días
Desde casa, México Luxoft A tiempo completo**Project** Description**: Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop internal data products and...
-
Sr Data Engineer
hace 7 días
Desde casa, México Ascendion A tiempo completo**Ascendion** is a full-service digital engineering solutions company. We make and manage software platforms and products that power growth and deliver captivating experiences to consumers and employees. Our engineering, cloud, data, experience design, and talent solution capabilities accelerate transformation and impact for enterprise clients. Headquartered...
-
Data Engineer
hace 3 días
Desde casa, México Testing IT Consulting A tiempo completo**TESTING IT **Somos una empresa líder en pruebas de software, brindamos servicios en México y Nearshore a EEUU; te invitamos a unirte como como **DATA ENGINEER**, Estos miembros del equipo trabajarán con el líder que estamos entrevistando para implementar la estrategia. Experiência comprobada Años mínimos de experiência: 5-7 implementaciones y...
-
Data Leader Engineer
hace 2 días
Desde casa, México U hi A tiempo completo**Data Leader Engineer (Snowflake)** **Essential Qualifications** - Must have 6-9 years of experience in Data warehouse, ETL, BI projects - Must have strong hold in Python - Must have experience in Snowflake Data Base. - Must have experience implementing complex stored Procedures and standard DWH and ETL concepts - Proficient in Oracle database, complex...
-
Data Engineer Mexico
hace 7 días
Desde casa, México STXNext A tiempo completo**Hi there!** We are the biggest European Python Powerhouse with over 18 years of experience, and deep commitment to Agile principles. Join a group of 500+ professionals dedicated to helping customers build outstanding products. **Are you the NEXT one?** **Job description** **Core values** We believe that every problem has a solution, often hidden and...
-
Data Engineer
hace 3 días
Desde casa, México sec consultores A tiempo completoDiseño y construcción de modelos ETL y flujos de trabajo de datos. - Trabajar con BigQuery Cloud Data Warehouse y herramientas de big data como Databricks,Hadoop, Spark, Kafla etc. Tipo de puesto: Tiempo completo Sueldo: $40,000.00 - $55,000.00 al mes Horario: - Lunes a viernes - Turno de 10 horas Prestaciones: - Seguro de gastos médicos mayores -...
