Cloud Data Engineer
hace 1 semana
As a Sr. Cloud Data Infrastructure Engineer with Intuitive, you will be responsible for building or converting legacy data pipelines from legacy environments to modern cloud environments to help the analytics and data science initiatives across our enterprise customers. You will be working closely with SMEs in Data Engineering and Cloud Engineering, to create solutions and extend Intuitive's DataOps Engineering Projects and Initiatives. The Sr. Cloud Data Infrastructure Engineer will be a central critical role for establishing the DataOps/DataX data logistics and management for building data pipelines, enforcing best practices, ownership for building complex and performant Data Lake Environments, work closely with Cloud Infrastructure Architects and DevSecOps automation teams. The Sr. Cloud Data Infrastructure Engineer is the main point of contact for all things related to DataLake formation and data at scale. In this role, we expect our DataOps leaders to be obsessed with data and providing insights to help our end customers.
**ROLES & RESPONSIBILITIES**:
- Design, develop, implement, and tune large-scale distributed systems and pipelines that process large volume of data; focusing on scalability, low-latency, and fault-tolerance in every system built.
- Developing scalable and re-usable frameworks for ingesting large data from multiple sources.
- Modern Data Orchestration engineering - query tuning, performance tuning, troubleshooting, and debugging big data solutions.
- Provides technical leadership, fosters a team environment, and provides mentorship and feedback to technical resources.
- Deep understanding of ETL/ELT design methodologies, patterns, personas, strategy, and tactics for complex data transformations.
- Data processing/transformation using various technologies such as spark and cloud Services.
- Understand current data engineering pipelines using legacy SAS tools and convert to modern pipelines.
**Data Infrastructure Engineer Strategy Objectives: End to End Strategy**
Define how data is acquired, stored, processed, distributed, and consumed. Collaboration and Shared responsibility across disciplines as partners in delivery for progressing our maturity model in the End-to-End Data practice.
- Understanding and experience with modern cloud data orchestration and engineering for one or more of the following cloud providers - AWS, Azure, GCP.
- Leading multiple engagements to design and develop data logistic patterns to support data solutions using data modeling techniques (such as file based, normalized or denormalized, star schemas, schema on read, Vault data model, graphs) for mixed workloads, such as OLTP, OLAP, streaming using any formats (structured, semi-structured, unstructured).
- Understanding of one or more is a big plus -CI/CD, cloud devops, containers (Kubernetes/Docker, etc.), Python/PySpark/JavaScript.
- Implementing cloud data orchestration and data integration patterns (AWS Glue, Azure Data Factory, Event Hub, Databricks, etc.), storage and processing (Redshift, Azure Synapse, BigQuery, Snowflake)
- Possessing a certification(s) in one of the following is a big plus - AWS/Azure/GCP data engineering, and Migration.
**KEY REQUIREMENTS**:
- 10+ years’ experience as data engineer.
- Must have 5+ Years in implementing data engineering solutions with multiple cloud providers and toolsets.
- This is hands on role building data pipelines using Cloud Native and Partner Solutions. Hands-on technical experience with Data at Scale.
- Must have deep expertise in one of the programming languages for data processes (Python, Scala). Experience with Python, PySpark, Hadoop, Hive and/or Spark to write data pipelines and data processing layers.
- Must have worked with multiple database technologies and patterns. Good SQL experience for writing complex SQL transformation.
- Performance Tuning of Spark SQL running on S3/Data Lake/Delta Lake/ storage and Strong Knowledge on Databricks and Cluster Configurations.
- Nice to have Databricks administration including security and infrastructure features of Databricks.
Experience with Development Tools for CI/CD, Unit and Integration testing, Automation and Orchestration
**Salary**: $50,000.00 - $75,000.00 per month
**Experience**:
- Data Engineer: 10 years (required)
- Databricks: 4 years (required)
- AWS/ Azure/ GCP: 3 years (required)
- redshift/ Bigquery/ Snowflake): 5 years (required)
-
Cloud Security Engineer
hace 7 días
Desde casa, México NTT DATA A tiempo completo**Req ID**: 259235 We are currently seeking a Cloud Security Engineer to join our team in Remote, México (MX-MEX), Mexico (MX). - Assist Network Services team in configuring Azure AD security controls for corporate IT infrastructure. - Design and conduct vulnerability analysis to uncover security risks; Document outcome and help design security mechanisms...
-
Cloud Engineer
hace 2 semanas
Desde casa, México Think Future Technologies México A tiempo completoTitle**:Cloud Engineer** Experience: 2+ years Location: Mexico/Remote Engagement Type: Full-Time Skills: ETL | Javascript | SQL | APIs | CTC - BigQuery | Google Cloud Workflow | Google Cloud Functions **Job Summary**: We are looking for a Cloud Engineer with expertise in Google Cloud services to join our team. This role will be critical in ingesting...
-
Lead Cloud Data Engineer
hace 2 semanas
Desde casa, México EPAM Systems A tiempo completoWe are looking to add a highly skilled and motivated **Lead Cloud Data Engineer** with strong backend development skills and Cloud platform experience (AWS/GCP) to our team. As a vital team member, you will be charged with designing, implementing, and maintaining our data-centric, Cloud-hosted backend infrastructure and services. You will be pivotal in...
-
Senior Cloud Data Engineer
hace 2 semanas
Desde casa, México EPAM Systems A tiempo completoWe are seeking a highly skilled and motivated **Senior Cloud Data Engineer** with a strong backend development focus and experience in Cloud platforms (AWS/GCP). As a member of our team, you will be responsible for the design, implementation, and maintenance of our data-centric, Cloud-hosted backend infrastructure and services. You will play a critical role...
-
Data Engineer
hace 3 días
Desde casa, México Cantera Digital A tiempo completoCantera Digital está en búsqueda de un Perfil en **Data Engineer**, ¡Únete a nuestro equipo! **Requisitos**: - Inglés avanzado fluido (C1/C2) **CONOCIMIENTOS Y EXPERIENCIA ESPECÍFICOS NECESARIOS**: - Critical thinking and decision making - DA/DBA - Data Architecture (Data Design, Index Design, Referential Integrity) - DA/DBA - DB Create/Modify (DB...
-
Data Engineer Transformation
hace 2 semanas
Desde casa, México INAVANT SA de CV A tiempo completoEn INAVANT somos expertos en tecnologías para la administración de contenidos, gestión de proyectos, gestión de cliente, colaboración, aplicaciones WEB y soluciones en la nube. Estamos en búsqueda de un **Data Engineer Transformation** **Competencias académicas**: Licenciatura / Ingeniería en informática, Ciencias de la computación, Ciencia de...
-
Data Engineer
hace 2 semanas
Desde casa, México Accolite Digital A tiempo completoJoin a team of the top 1%. We believe in attracting and retaining the brightest technical minds from diverse backgrounds and nationalities to come together and create an enriched pool of global talent. Recognized as one of North America's fastest-growing companies, we aim to attract people who are passionate about technology and creating a real impact while...
-
Data Engineer
hace 2 semanas
Desde casa, México Technocore360 A tiempo completo**Title**: Data Engineer **Location**: mexico Remote **Duration**: Long Term Contract **Description**: - Work with business and product partners to understand their objectives and implement solutions to support their goals. - Build traveller data products that form the foundation of personalization efforts at EG across user acquisition, marketing...
-
Data Engineer
hace 4 semanas
Desde casa, México SITIOS Y DOMINIOS, SA DE CV A tiempo completoTo work in a **6 months** (posible extension) **remote** project we are looking for a **bilingual Data Engineer** **Requirments** - 5+ years of hands-on experience in working with SQL, Python, object-oriented scripting languages (e.g. Java, C++, etc..) in building data pipelines and processes. Proficiency in SQL programming, including the ability to create...
-
Data Engineer Ingesta
hace 2 semanas
Desde casa, México INAVANT SA de CV A tiempo completoEn INAVANT somos expertos en tecnologías para la administración de contenidos, gestión de proyectos, gestión de cliente, colaboración, aplicaciones WEB y soluciones en la nube. Estamos en búsqueda de un **Data Engineer: Ingesta** **Competencias académicas**: Licenciatura / Ingeniería en informática, Ciencias de la computación, Ciencia de Datos,...
-
Data Engineer
hace 1 semana
Desde casa, México CODIGOMX A tiempo completo**Data Engineer** Years of Experience:5 years **Required Technologies**:C#,.net, PostgreSQL, API, Azure Required Languages: English - Advanced **About the role** We are seeking to expand our data reporting capabilities by improving our ability to store, process, compute, and rapidly retrieve many different views of our existing datasets. To that end, we...
-
Data Engineer
hace 1 semana
Desde casa, México Wise Athena A tiempo completoAre you a curious problem-solver who loves to work with data? If you're ready for exciting challenges and you want to build impactful solutions, we have the perfect opportunity for you! Wise Athena is looking for a Data Engineer to join our team. **Responsibilities**: - Develop and optimize data pipelines - Build maintainable data models - Continuously...
-
Senior Data Engineer
hace 2 semanas
Desde casa, México CODIGOMX A tiempo completo**Required Technologies** AGILE(Scrum),.Git and Github, Matillion, snowflake, SQL, ETL Process Required Languages English - Advanced **Description** We are looking for a data engineer with more than 3 years of experience in the following stack and overall experience of more than 5 years in Data Warehousing - Snowflake - SQL - ETL / ELT toolset -...
-
Data Software Engineer
hace 4 semanas
Desde casa, México EPAM Systems, Inc. A tiempo completoWe are seeking a dedicated **Data Software Engineer** to join our team. **Responsibilities** - Develop and maintain scalable data pipelines - Transform and provision ingested data effectively - Automate data transfer processes from Azure/GCP to external suppliers - Ensure data integrity, quality, and maintenance are upheld - Build new API integrations to...
-
Google Cloud Data Engineer
hace 5 días
Desde casa, México MSNS HR Technologies A tiempo completo**Role: GCP Data Engineer** **Location: GDL or Mexico City, Remote/Hybrid** **Duration: Fulltime/Permanent** **Languages: English Mandatory** **Openings: 5+ positions** **Responsibilities**: Strong technical SME in GCP components - BigQuery, DataFlow, BigTable, GCS, DataForm, Python Scripting, EventHub, Kafka, Data Lakes, SQL, or SPARK and SCALA...
-
Salesforce Data Cloud Developer
hace 7 días
Desde casa, México EPAM Systems, Inc. A tiempo completo**Responsibilities** - Create and Manage Data Sources: Set up and configure data sources within Salesforce Data Cloud for effective data management - Develop Data Ingestion Processes: Build and maintain robust Data Cloud ingestion pipelines to integrate data from various sources into Data Cloud - Perform Data Harmonization: Ensure data consistency and...
-
Senior Data Engineer
hace 1 semana
Desde casa, México Wizeline A tiempo completo**The Company**: Wizeline is a global digital services company helping mid-size to Fortune 500 companies build, scale, and deliver high-quality digital products and services. We thrive in solving our customer’s challenges through human-centered experiences, digital core modernization, and intelligence everywhere (AI/ML and data). We help them succeed in...
-
Aws Cloud Optimization Engineer
hace 6 días
Desde casa, México EPAM Systems A tiempo completo**DESCRIPTION**: We are seeking a skilled and dynamic **AWS Cloud Optimization Engineer **who excels in core cloud services architecture and cost mechanics. If you have a passion for maximizing efficiency and driving cost savings, this opportunity is perfect for you. EPAM is a leading global provider of digital platform engineering and development services....
-
Cloud Security Engineer
hace 1 semana
Desde casa, México Hashmap A tiempo completo**Req ID**:259235 We are currently seeking a Cloud Security Engineer to join our team in Remote, México (MX-MEX), Mexico (MX). - Assist Network Services team in configuring Azure AD security controls for corporate IT infrastructure. - Design and conduct vulnerability analysis to uncover security risks; Document outcome and help design security mechanisms...
-
Cloud Network Engineer
hace 1 semana
Desde casa, México RED AMIGO DAL S.A.P.I. of C.V. S.O.F.O.M. E.N.R A tiempo completo**What´s Konfio?** A financial technology company dedicated to supporting the small and medium-sized companies in Mexico, developing and offering financial solutions to solve their main problems, and seeking to be the best ally of entrepreneurs with dreams and ambitions to create value, consolidate their well-being and contribute to the...