Cloud Data Engineer

hace 2 meses

Monterrey, México Intuitive Cloud A tiempo completo

**ROLES & RESPONSIBILITIES**:

- Design, develop, implement, and tune large-scale distributed systems and pipelines that process large volume of data; focusing on scalability, low-latency, and fault-tolerance in every system built
- Developing scalable and re-usable frameworks for ingesting large data from multiple sources.
- Modern Data Orchestration engineering - query tuning, performance tuning, troubleshooting, and debugging big data solutions.
- Provides technical leadership, fosters a team environment, and provides mentorship and feedback to technical resources.
- Deep understanding of ETL/ELT design methodologies, patterns, personas, strategy, and tactics for complex data transformations.
- Data processing/transformation using various technologies such as spark and cloud Services.
- Understand current data engineering pipelines using legacy SAS tools and convert to modern pipelines.

**Data Infrastructure Engineer Strategy Objectives: End to End Strategy**

Define how data is acquired, stored, processed, distributed, and consumed. Collaboration and Shared responsibility across disciplines as partners in delivery for progressing our maturity model in the End-to-End Data practice.
- Understanding and experience with modern cloud data orchestration and engineering for one or more of the following cloud providers - AWS, Azure, GCP.
- Leading multiple engagements to design and develop data logistic patterns to support data solutions using data modeling techniques (such as file based, normalized or denormalized, star schemas, schema on read, Vault data model, graphs) for mixed workloads, such as OLTP, OLAP, streaming using any formats (structured, semi-structured, unstructured).
- Understanding of one or more is a big plus -CI/CD, cloud devops, containers (Kubernetes/Docker, etc.), Python/PySpark/JavaScript.
- Implementing cloud data orchestration and data integration patterns (AWS Glue, Azure Data Factory, Event Hub, Databricks, etc.), storage and processing (Redshift, Azure Synapse, BigQuery, Snowflake)
- Possessing a certification(s) in one of the following is a big plus - AWS/Azure/GCP data engineering, and Migration.

**KEY REQUIREMENTS**:

- 10+ years’ experience as data engineer.
- Must have 5+ Years in implementing data engineering solutions with multiple cloud providers and toolsets.
- This is hands on role building data pipelines using Cloud Native and Partner Solutions. Hands-on technical experience with Data at Scale.
- Must have deep expertise in one of the programming languages for data processes (Python, Scala). Experience with Python, PySpark, Hadoop, Hive and/or Spark to write data pipelines and data processing layers.
- Must have worked with multiple database technologies and patterns. Good SQL experience for writing complex SQL transformation.
- Performance Tuning of Spark SQL running on S3/Data Lake/Delta Lake/ storage and Strong Knowledge on Databricks and Cluster Configurations.
- Nice to have Databricks administration including security and infrastructure features of Databricks.
- Experience with Development Tools for CI/CD, Unit and Integration testing, Automation and Orchestration

Ability to commute/relocate:

- Monterrey, N. L.: Reliably commute or planning to relocate before starting work (required)

**Speak with the employer**
+91 8482711849

  • Data Engineer

    hace 1 mes

    Monterrey, México British American Tobacco A tiempo completo

    **BAT MEXICO IS LOOKING FOR A DATA ENGINEER!** **CAN THIS BE YOUR FUTURE ROLE?** Are you able to work in a multifaceted, fast paced environment? Do you enjoy ambitious work and expansion of abilities? **ACCOUNTABILITIES** - We need to implement data ingestion pipelines from multiple data sources using Databricks and PySpark - Develop Big Data and non-Big...

  • Sdm Eur Data Engineer

    hace 1 mes

    Monterrey, México G&B SOLUTIONS A tiempo completo

    **Resource Description** Data Engineer Knowledge on Data Architecture, Data Engineering, Data Management, Data Quality, Data Ingestion, ETL, DBs, on Cloud. English Fluent Desirable : SAP SD experience, ABAP; Multinational & Multicultural project experience Bachelor Degree and Master desirable **Requirements**: Sr Data Engineer with experience 2+ Data...

  • Data Engineer Sr Consultant

    hace 1 mes

    Monterrey, México Neoris A tiempo completo

    **DATA ENGINEER SR CONSULTANT**: **Date**:Apr 27, 2023 **Location**: MONTERREY, MX **Company**:NEORIS We are **NEORIS**! **As a digital accelerator we help companies step into the future! Currently we are looking for a DATA ENGINEER SR CONSULTANT. **Requirements**: - Google Cloud Platform - Knowledge in ETL tools - Python - SQL (Window Functions, CTE...

  • Senior Gcp Data Engineer

    hace 4 semanas

    Monterrey, México Endava A tiempo completo

    **Responsibilities**: - Working with Endava’s customers to analyze existing systems and prepare plan for migrating databases and data processing systems to cloud - Defining and implementing cloud data strategy including security posture, target operating model, DR strategy and others - Deliver end-to-end data solutions - from early concept and planning,...

  • Consultor Data Architect Engineer Dba Dwh Mty

    hace 1 mes

    Monterrey, México Training Talent A tiempo completo

    **Vacante para la empresa Training Talent en Monterrey, Nuevo León**: **Sobre nosotros** - Somos un grupo de empresas dedicas al sector industrial en especial al sector de parques industriales y otras con fuerte crecimiento en el mercado, desarrollando soluciones innovadoras, tenemos un muy buen ambiente de trabajo y pensamos primero en las personas;...

  • Consultor Data Architect Engineer Dba Dwh Mty

    hace 1 mes

    Monterrey, México Training Talent A tiempo completo

    **Vacante para la empresa Training Talent en Monterrey, Nuevo León**: **Sobre nosotros** - Somos un grupo de empresas dedicas al sector industrial en especial al sector de parques industriales y otras con fuerte crecimiento en el mercado, desarrollando soluciones innovadoras, tenemos un muy buen ambiente de trabajo y pensamos primero en las personas;...

  • Data Engineer

    hace 1 mes

    Monterrey, México Axen A tiempo completo

    Descripción En AXEN IT Consulting estamos creciendo exponencialmente con clientes con grandes proyecciones de crecimiento, Contamos con más de 25 años de experiência en el mercado de servicios de tecnologías de la información, Enfocados en nuestro crecimiento y al mismo tiempo ofreciendo planes de mejora a nuestro talento, Actualmente estamos buscando...

  • Site Reliability Engineer

    hace 4 semanas

    Monterrey, México British American Tobacco A tiempo completo

    **BAT MEXICO IS SEARCHING FOR A SITE RELIABILITY EGINEER (Cloud & Data Center)** **JOB TITLE**:Site Reliability Engineer (Cloud & Data Center) **FUNCTION**:Digital Business Solutions **SUB FUNCTION**: IDT Services **CITY & COUNTRY**:Monterrey, Mexico **ROLE SUMMARY** **What are the key objectives and expectations from this role?** **What is the direct...

  • Data Engineer

    hace 1 mes

    Monterrey, México Neoris A tiempo completo

    **Data Engineer**: **Date**:Nov 8, 2023 **Location**: MONTERREY, MX **Company**:NEORIS En **NEORIS**, acelerador digital que ayuda a las compañías a entrar en el futuro, estamos en búsqueda de Data Engineer , **Principales Responsabilidades**: - Ingesta & Extracción (Data Ingestion) - Integración & Transformación de Datos (Data Pipelines) - Carga...

  • Data Engineer

    hace 1 mes

    Monterrey, México Neoris A tiempo completo

    **Data Engineer - BI Backend Specialist**: **Date**:Jan 2, 2023 **Location**: MONTERREY, MX **Company**:NEORIS We are **NEORIS**! **As a digital accelerator we help companies step into the future! Currently we are looking for a Data Engineer - BI Backend Specialist. **Main Responsabilities**: - Data Ingestion - Data Pipelines - Data...

  • GCP Data Engineer

    hace 1 semana

    Monterrey, Nuevo León, México Atos A tiempo completo

    Eviden, part of the Atos Group, with an annual revenue of circa € 5 billion is a global leader in data-driven, trusted and sustainable digital transformation. As a next generation digital business with worldwide leading positions in digital, cloud, data, advanced computing and security, it brings deep expertise for all industries in more than 47 countries....

  • Data Engineer

    hace 1 mes

    Monterrey, México Neoris A tiempo completo

    **Data Engineer**: **Date**:Nov 8, 2023 **Location**: MONTERREY, MX **Company**:NEORIS En **NEORIS**, acelerador digital que ayuda a las compañías a entrar en el futuro, estamos en búsqueda de Data Engineer , **Requerimientos**: - Carrera en Ing. Sistemas o afín - + 4 Años de experiência como Data Engineer - Inglés intermedio / Avanzado B2 - + 4...

  • Data Engineer Aws Glue

    hace 1 mes

    Monterrey, México Neoris A tiempo completo

    **Data Engineer AWS Glue**: **Date**:Apr 3, 2023 **Location**: MONTERREY, MX **Company**:NEORIS **NEORIS **es un Acelerador Digital que ayuda a las compañías a entrar en el futuro. Combinamos un profundo conocimiento de industria con el más alto expertise tecnológico en el mercado para crear soluciones personalizadas que permiten superar los desafíos...

  • Data Engineer, Airlines

    hace 4 días

    Monterrey, México DataArt A tiempo completo

    Responsibilities Collection of large volumes and varied data sets Work directly with the team of Data Scientists and ML Engineers creating data pipelines robust and resilient that allow feeding the Data Products Collection of interactions with real ML models for their subsequent retraining Collaborate in the design, implementation, and production of...

  • GCP Data Engineer

    hace 1 semana

    Monterrey, México Atos A tiempo completo

    Eviden, part of the Atos Group, with an annual revenue of circa € 5 billion is a global leader in data-driven, trusted and sustainable digital transformation. As a next generation digital business with worldwide leading positions in digital, cloud, data, advanced computing and security, it brings deep expertise for all industries in more than 47 countries....

  • Cloud Data Tech Lead

    hace 4 semanas

    Monterrey, México Connectingology A tiempo completo

    Description **Main activities**: Create and maintain optimal data pipeline architecture, Assemble large, complex data sets that meet functional / non-functional business requirements. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, etc. Build analytics tools that utilize the data pipeline...

  • Data Engineer

    hace 1 mes

    Monterrey, México DataArt A tiempo completo

    Project overview: The Advanced Analytics management team is a transformational team whose objective is to generate measurable value that lasts over time across all areas of the company. To achieve this, custom data products are created based on analytical models, mostly from ML but being able to use a broader spectrum of techniques; either by delivering new...

  • (Latam) ️ Senior Data Center and Cloud Engineer

    hace 4 semanas

    Monterrey, México Prometeo Talent A tiempo completo

    **About us**: **Antelope Consulting is an IT consultancy and outsourcing firm based in the UK**. It has been providing **IT and database solutions** since 2004 predominantly in the financial marketplace. Put simply, Antelope Consulting can piece together all the elements for you. By using its **significant experience in this area**, we can significantly...

  • Data Engineer Hana

    hace 1 mes

    Monterrey, México Neoris A tiempo completo

    **Data Engineer Hana**: **Date**:Jan 6, 2023 **Location**: MONTERREY, MX **Company**:NEORIS En **NEORIS**, acelerador digital que ayuda a las compañías a entrar en el futuro, estamos en búsqueda de Data Engineer Hana , **Requerimientos**: - + 4 años MS SQL Developer (Stored Procedures, Triggers, Complex Database Scripting). - + 4 años Data...

  • Data Engineer Experienced

    hace 4 semanas

    Monterrey, México Neoris A tiempo completo

    **Data Engineer Experienced**: **Date**:May 9, 2023 **Location**: MONTERREY, MX **Company**:NEORIS We are **NEORIS**! **As a digital accelerator we help companies step into the future! Currently we are looking for a Data Engineer. **Main activities**: - Propose new ideas on data domain - Hands on data technology **Requirements**: - Knowledge Data...