Cloud Data Engineer
hace 2 semanas
As a Sr. Cloud Data Infrastructure Engineer with Intuitive, you will be responsible for building or converting legacy data pipelines from legacy environments to modern cloud environments to help the analytics and data science initiatives across our enterprise customers. You will be working closely with SMEs in Data Engineering and Cloud Engineering, to create solutions and extend Intuitive's DataOps Engineering Projects and Initiatives. The Sr. Cloud Data Infrastructure Engineer will be a central critical role for establishing the DataOps/DataX data logistics and management for building data pipelines, enforcing best practices, ownership for building complex and performant Data Lake Environments, work closely with Cloud Infrastructure Architects and DevSecOps automation teams. The Sr. Cloud Data Infrastructure Engineer is the main point of contact for all things related to DataLake formation and data at scale. In this role, we expect our DataOps leaders to be obsessed with data and providing insights to help our end customers.
**ROLES & RESPONSIBILITIES**:
- Design, develop, implement, and tune large-scale distributed systems and pipelines that process large volume of data; focusing on scalability, low-latency, and fault-tolerance in every system built.
- Developing scalable and re-usable frameworks for ingesting large data from multiple sources.
- Modern Data Orchestration engineering - query tuning, performance tuning, troubleshooting, and debugging big data solutions.
- Provides technical leadership, fosters a team environment, and provides mentorship and feedback to technical resources.
- Deep understanding of ETL/ELT design methodologies, patterns, personas, strategy, and tactics for complex data transformations.
- Data processing/transformation using various technologies such as spark and cloud Services.
- Understand current data engineering pipelines using legacy SAS tools and convert to modern pipelines.
**Data Infrastructure Engineer Strategy Objectives: End to End Strategy**
Define how data is acquired, stored, processed, distributed, and consumed. Collaboration and Shared responsibility across disciplines as partners in delivery for progressing our maturity model in the End-to-End Data practice.
- Understanding and experience with modern cloud data orchestration and engineering for one or more of the following cloud providers - AWS, Azure, GCP.
- Leading multiple engagements to design and develop data logistic patterns to support data solutions using data modeling techniques (such as file based, normalized or denormalized, star schemas, schema on read, Vault data model, graphs) for mixed workloads, such as OLTP, OLAP, streaming using any formats (structured, semi-structured, unstructured).
- Understanding of one or more is a big plus -CI/CD, cloud devops, containers (Kubernetes/Docker, etc.), Python/PySpark/JavaScript.
- Implementing cloud data orchestration and data integration patterns (AWS Glue, Azure Data Factory, Event Hub, Databricks, etc.), storage and processing (Redshift, Azure Synapse, BigQuery, Snowflake)
- Possessing a certification(s) in one of the following is a big plus - AWS/Azure/GCP data engineering, and Migration.
**KEY REQUIREMENTS**:
- 10+ years’ experience as data engineer.
- Must have 5+ Years in implementing data engineering solutions with multiple cloud providers and toolsets.
- This is hands on role building data pipelines using Cloud Native and Partner Solutions. Hands-on technical experience with Data at Scale.
- Must have deep expertise in one of the programming languages for data processes (Python, Scala). Experience with Python, PySpark, Hadoop, Hive and/or Spark to write data pipelines and data processing layers.
- Must have worked with multiple database technologies and patterns. Good SQL experience for writing complex SQL transformation.
- Performance Tuning of Spark SQL running on S3/Data Lake/Delta Lake/ storage and Strong Knowledge on Databricks and Cluster Configurations.
- Nice to have Databricks administration including security and infrastructure features of Databricks.
Experience with Development Tools for CI/CD, Unit and Integration testing, Automation and Orchestration
**Salary**: $50,000.00 - $75,000.00 per month
**Experience**:
- Data Engineer: 10 years (required)
- Databricks: 4 years (required)
- AWS/ Azure/ GCP: 3 years (required)
- redshift/ Bigquery/ Snowflake): 5 years (required)
-
Cloud Security Engineer
hace 2 semanas
Desde casa, México NTT DATA A tiempo completo**Req ID**: 259235 We are currently seeking a Cloud Security Engineer to join our team in Remote, México (MX-MEX), Mexico (MX). - Assist Network Services team in configuring Azure AD security controls for corporate IT infrastructure. - Design and conduct vulnerability analysis to uncover security risks; Document outcome and help design security mechanisms...
-
Cloud Engineer
hace 2 meses
Desde casa, México Think Future Technologies México A tiempo completoTitle**:Cloud Engineer** Experience: 2+ years Location: Mexico/Remote Engagement Type: Full-Time Skills: ETL | Javascript | SQL | APIs | CTC - BigQuery | Google Cloud Workflow | Google Cloud Functions **Job Summary**: We are looking for a Cloud Engineer with expertise in Google Cloud services to join our team. This role will be critical in ingesting...
-
Cloud Engineer
hace 2 meses
Desde casa, México INAVANT SA de CV A tiempo completoEn INAVANT somos expertos en tecnologías para la administración de contenidos, gestión de proyectos, gestión de cliente, colaboración, aplicaciones WEB y soluciones en la nube. Estamos en búsqueda de un **Cloud Engineer** **Competencias académicas**: Licenciatura / Ingeniería en informática, Ciencias de la computación, Ciencia de Datos, Ingeniero...
-
Cloud Engineer
hace 7 horas
Desde casa, México INAVANT SA de CV A tiempo completoEn INAVANT somos expertos en tecnologías para la administración de contenidos, gestión de proyectos, gestión de cliente, colaboración, aplicaciones WEB y soluciones en la nube. Estamos en búsqueda de un **Cloud Engineer** **Competencias académicas**: Licenciatura / Ingeniería en informática, Ciencias de la computación, Ciencia de Datos, Ingeniero...
-
Data Engineer
hace 2 semanas
Desde casa, México Estrategia tecnológica A tiempo completo**¡Te estamos buscando!** **Data Engineer** - 3 o más años en Data Engineer. - Fuerte experiência en **Python.**: - Fuerte experiência en **Cloud Dataflow.**: - Conocimiento o experiência en Airflow. - Conocimiento o experiência en Docker y Kubernetes. - Kubeflow (deseable). - **Inglés avanzado conversacional.** **Ofrecemos**: - **100%...
-
Cloud Operations Engineer
hace 4 semanas
Desde casa, México Consultoria Aguilar A tiempo completoCloud Operations Engineer / Site Reliability Engineer (SRE) Job Description: Cloud Operations Engineer / Site Reliability Engineer (SRE) About the Company: Datascore.ai, through its EngageIQ platform, specializes in enhancing lead generation and engagement. The company leverages advanced data science and AI to score and enrich leads, optimizing outreach...
-
Data Engineer
hace 1 semana
Desde casa, México Cantera Digital A tiempo completoCantera Digital está en búsqueda de un Perfil en **Data Engineer**, ¡Únete a nuestro equipo! **Requisitos**: - Inglés avanzado fluido (C1/C2) **CONOCIMIENTOS Y EXPERIENCIA ESPECÍFICOS NECESARIOS**: - Critical thinking and decision making - DA/DBA - Data Architecture (Data Design, Index Design, Referential Integrity) - DA/DBA - DB Create/Modify (DB...
-
Data Engineer
hace 1 semana
Desde casa, México SailPoint A tiempo completoResponsibilities - The Data Engineer will primarily work in DBT modeling with our site and activity data to provide accessibility to our most important data - The Data Engineer will also support the movement and modeling of new data sources in DBT - Collaborate with software engineers and analysts in data collection and data usage to model analytics tables...
-
Cloud Engineer
hace 2 meses
Desde casa, México merican Inc A tiempo completo**Cloud Engineer** **Remote** **Responsibilities**: - Cloud Infrastructure Design and Implementation: - Automation and Orchestration: - Security and Compliance: - Monitoring and Optimization: - Collaboration and Documentation: - Troubleshooting and Support: - Stay Current with Cloud Technologies: **Job Type**: Contract **Salary**: $170.00 - $255.00...
-
Azure Data Engineer
hace 2 meses
Desde casa, México Talent Accelerator A tiempo completoA leading Mexican company in Software as a Service and Market Research is looking for an Azure Data Engineer. Your main responsibility will be the development of pipelines for data extraction, transformation, and loading **(ETL)** in the cloud using **Azure. **This involves using tools such as: - Azure SQL Server - Azure Blob Storage - Azure Data Lake -...
-
Data Engineer Senior
hace 5 días
Desde casa, México Max RH A tiempo completoImportante consultora de TI establecida en Cdmx, requiere un **CONSULTOR DATA ENGINEER SENIOR **para importante cliente retail. Integrate con nosotros, si cumples estos requisitos!!! **REQUISITOS TÉCNICOS**: - **Experiência más de 7 años como Data Engineer, especialmente con GCP**: - Experiência en ingeniería de datos, desarrollo de canales de datos...
-
Data Engineer Transformation
hace 2 semanas
Desde casa, México INAVANT SA de CV A tiempo completoEn INAVANT somos expertos en tecnologías para la administración de contenidos, gestión de proyectos, gestión de cliente, colaboración, aplicaciones WEB y soluciones en la nube. Estamos en búsqueda de un **Data Engineer Transformation** **Competencias académicas**: Licenciatura / Ingeniería en informática, Ciencias de la computación, Ciencia de...
-
Data Engineer
hace 2 semanas
Desde casa, México Accolite Digital A tiempo completoJoin a team of the top 1%. We believe in attracting and retaining the brightest technical minds from diverse backgrounds and nationalities to come together and create an enriched pool of global talent. Recognized as one of North America's fastest-growing companies, we aim to attract people who are passionate about technology and creating a real impact while...
-
Azure Data Engineer
hace 2 meses
Desde casa, México Talent Accelerator A tiempo completoA leading Mexican company in Software as a Service and Market Research is looking for an Azure Data Engineer. Your main responsibility will be the development of pipelines for data extraction, transformation, and loading **(ETL)** in the cloud using **Azure. **This involves using tools such as: - Azure SQL Server - Azure Blob Storage - Azure Data Lake -...
-
Data Engineer
hace 3 semanas
Desde casa, México Technocore360 A tiempo completo**Title**: Data Engineer **Location**: mexico Remote **Duration**: Long Term Contract **Description**: - Work with business and product partners to understand their objectives and implement solutions to support their goals. - Build traveller data products that form the foundation of personalization efforts at EG across user acquisition, marketing...
-
Senior Cloud Engineer
hace 2 meses
Desde casa, México BUSINESS EXCELLENCE ´PROFESSIONAL CONSULTING A tiempo completo**Senior Cloud Engineer (REMOTE)**: - At least 10 years in leadership positions with extensive experience in manufacturing industry. - Bachelor degree in engineering. - Advanced english level. - **Architecture Design**: Develop cloud architecture solutions that meet the organization's requirements for scalability, reliability, security, and performance. -...
-
Senior Cloud Engineer
hace 2 días
Desde casa, México BUSINESS EXCELLENCE ´PROFESSIONAL CONSULTING A tiempo completo**Senior Cloud Engineer (REMOTE)**: - At least 10 years in leadership positions with extensive experience in manufacturing industry. - Bachelor degree in engineering. - Advanced english level. - **Architecture Design**: Develop cloud architecture solutions that meet the organization's requirements for scalability, reliability, security, and performance. -...
-
Data Engineer Ingesta
hace 2 semanas
Desde casa, México INAVANT SA de CV A tiempo completoEn INAVANT somos expertos en tecnologías para la administración de contenidos, gestión de proyectos, gestión de cliente, colaboración, aplicaciones WEB y soluciones en la nube. Estamos en búsqueda de un **Data Engineer: Ingesta** **Competencias académicas**: Licenciatura / Ingeniería en informática, Ciencias de la computación, Ciencia de Datos,...
-
Senior Data Engineer
hace 4 semanas
Desde casa, México CODIGOMX A tiempo completoWe ar hiring a Senior Data Engineer **Required Technologies** AGILE(Scrum) **Required Languages** English - Advanced **Description** We are looking for a data engineer with more than 3 years of experience in the following stack and overall experience more than 5 years in Data Warehousing - Snowflake - SQL - ETL / ELT toolset Currently seeking a Senior...
-
Data Engineer
hace 2 semanas
Desde casa, México CODIGOMX A tiempo completo**Data Engineer** Years of Experience:5 years **Required Technologies**:C#,.net, PostgreSQL, API, Azure Required Languages: English - Advanced **About the role** We are seeking to expand our data reporting capabilities by improving our ability to store, process, compute, and rapidly retrieve many different views of our existing datasets. To that end, we...
