Empleos actuales relacionados con Data Engineer Mid - Zapopan - Derevo
-
Sr Data Engineer
hace 1 semana
Zapopan, México Ryscode A tiempo completoDescriptionLooking for a Sr. Data Engineer located in GUADALAJARA, México or willing to relocate for a full-time on-site work scheme.Required TechnologiesPython, AWS, Kafka, snowflakeGood English communicationGDL Position: ON-SITETipo de puesto: Tiempo completoSueldo: $60,000.00 - $68,400.00 al mesBeneficios:- Caja de ahorro- Seguro de gastos médicos-...
-
Data Scientist Mid
hace 1 semana
Zapopan, México Derevo A tiempo completo¿Tienes experiência en la plataforma Azure, Python y Azure Functions? ¿Has trabajado con el uso de APIs y bases de datos tanto en entornos en la nube como locales? Además, ¿cuentas con experiência en el manejo de OpenAI y en la ingeniería de prompts? ¡Entonces, esta vacante está diseñada para ti! Continúa leyendo para conocer más detalles. En...
-
Data Integration Engineer
hace 4 semanas
Zapopan, México Auto Partes Y Más A tiempo completoEstamos buscando un Data Integration Engineer para unirse a nuestro equipo en Auto Partes y Más.En esta posición, serás responsable de diseñar, desarrollar y mantener soluciones de integración de datos que nos permitan optimizar y automatizar los procesos de gestión de inventarios y ventas.Tu trabajo será crucial para garantizar la precisión y la...
-
Data Engineer- Onsite
hace 4 semanas
Zapopan, México Gsb Solutions A tiempo completoImportant IT company At the Latin American level, growth requires:**Data Engineer****Job description**:- Advanced Google Cloud development skills.- Experience with Google Cloud FHIR data stores.**Schedule**: 9:00 am a 6:00 pm.**Job type**: Onsite.**Location**:Av.Acueducto **** Piso 14, Puerta de Hierro, ***** Zapopan, Jal.**Salary**: Open- Salary according...
-
Data Engineer- Onsite
hace 5 días
Zapopan, México GSB Solutions A tiempo completoImportant IT company At the Latin American level, growth requires: **Data Engineer** **Job description**: - Advanced Google Cloud development skills. - Experience with Google Cloud FHIR data stores. **Schedule**: 9:00 am a 6:00 pm. **Job type**: Onsite. **Location**:Av. Acueducto 4851 Piso 14, Puerta de Hierro, 45116 Zapopan, Jal. **Salary**: Open -...
-
Data Engineer Jr
hace 5 días
Zapopan, México Derevo A tiempo completo¡¡Buscamos tu talento!! ✋ **DATA ENGINEER JR** En **Derevo** buscamos empoderar a las empresas y a las personas para liberar el valor de los datos en las organizaciones, a través de la implementación de procesos y plataformas de analítica con un enfoque que cubre el ciclo completo que necesitan llevar a cabo para lograrlo. Derevo inicio en 2010 con...
-
Data Engineer Jr
hace 4 semanas
Zapopan, México Derevo A tiempo completo¡¡Buscamos tu talento!!?**DATA ENGINEER JR**En **Derevo** buscamos empoderar a las empresas y a las personas para liberar el valor de los datos en las organizaciones, a través de la implementación de procesos y plataformas de analítica con un enfoque que cubre el ciclo completo que necesitan llevar a cabo para lograrlo.Derevo inicio en **** con una idea...
-
Sr. Data Analytics Engineer
hace 3 semanas
Zapopan, México Oracle A tiempo completo**Data Analytics Engineer**Why Oracle NetSuite Global Business Unit (NSGBU)?One word — transformation.At Oracle NetSuite Global Business Unit (NSGBU) we believe the cloud is here to stay and so do our 20,000+ customers. We believe businesses should not be bogged down by the overhead of bulky data centers and expensive personnel to run it all. Businesses...
-
Consultor Data Science Mid
hace 4 semanas
Zapopan, México Derevo A tiempo completo¿Tienes experiência en la creación de modelos de Machine Learning en Azure Machine Learning Designer?¡Entonces, esta vacante está diseñada para ti!Sigue leyendo para conocer más detalles.En Derevo buscamos empoderar a las empresas y a las personas para liberar el valor de los datos en las organizaciones, a través de la implementación de procesos y...
-
Consultor Data Science Mid
hace 4 semanas
Zapopan, México Derevo A tiempo completo¿Tienes experiência en la creación de modelos de Machine Learning en Azure Machine Learning Designer? ¡Entonces, esta vacante está diseñada para ti! Sigue leyendo para conocer más detalles.En Derevo buscamos empoderar a las empresas y a las personas para liberar el valor de los datos en las organizaciones, a través de la implementación de procesos y...
Data Engineer Mid
hace 3 semanas
We are looking for your talent ✋
**Data Engineer Mid**
** **The desired profile should have at least 3 years hands-on experience in designing, establishing, and maintaining data management and storing systems. Skilled in collecting, processing, cleaning, and deploying large datasets, understanding ER data models, and integrating with multiple data sources. Efficient in analyzing, communicating, and proposing different ways of building Data Warehouses, Data Lakes, End-to-End Pipelines, and Big Data solutions to clients, either in batch or streaming strategies.
It will be very important that you have the following skills/experience:
**English B2 or higher**
**Technical Proficiencies**:
- SQL:
Data Definition Language, Data Manipulation Language, Intermediate/advanced queries for analytical purpose, Subqueries, CTEs, Data types, Joins with business rules applied, Grouping and Aggregates for business metrics, Indexing and optimizing queries for efficient ETL process, Stored Procedures for transforming and preparing data, SSMS, DBeaver
- Python:
Experience in object-oriented programming, Management and processing datasets, Use of variables, lists, dictionaries and tuples, Conditional and iterating functions, Optimization of memory consumption, Structures and data types, Data ingestion through various structured and semi-structured data sources, Knowledge of libraries such as pandas, numpy, sqlalchemy, Must have good practices when writing code
- Databricks / Pyspark:
Intermediate knowledge in
Understanding of narrow and wide transformations, actions, and lazy evaluations
How DataFrames are transformed, executed, and optimized in Spark
Use DataFrame API to explore, preprocess, join, and ingest data in Spark
Use Delta Lake to improve the quality and performance of data pipelines
Use SQL and Python to write production data pipelines to extract, transform, and load data into
tables and views in the Lakehouse
Understand the most common performance problems associated with data ingestion and how to
mitigate them
Monitor Spark UI: Jobs, Stages, Tasks, Storage, Environment, Executors, and Execution Plans
Configure a Spark cluster for maximum performance given specific job requirements
Configure Databricks to access Blob, ADL, SAS, user tokens, Secret Scopes and Azure Key Vault
Configure governance solutions through Unity Catalog and Delta Sharing
Use Delta Live Tables to manage an end-to-end pipeline with unit and integrations test
- Azure:
Intermediate knowledge in
Azure Storage Account:
Provision Azure Blob Storage or Azure Data Lake instances
Build efficient file systems for storing data into folders with static or parametrized names, considering possible security rules and risks
Experience identifying use cases for open-source file formats like parquet, AVRO, ORC
Understanding optimized column-oriented file formats vs optimized row-oriented file formats
Implementing security configurations through Access Keys, SAS, AAD, RBAC, ACLs
Azure Data Factory:
Provision Azure Data Factory instances
Use Azure IR, Self-Hosted IR, Azure-SSIS to establish connections to distinct data sources
Use of Copy or Polybase activities for loading data
Build efficient and optimized ADF Pipelines using linked services, datasets, parameters, triggers, data movement activities, data transformation activities, control flow activities and mapping data flows
Build Incremental and Re-Processing Loads
** What benefits will you have?**
WELLNESS: We will promote your integral wellbeing through personal, professional and economic balance. Our legal and additional benefits will help you achieve it.
LET'S RELEASE YOUR POWER: You will have the opportunity to specialize in a comprehensive manner in different areas and technologies, thus achieving an interdisciplinary development. We will push you to take on new challenges and surpass yourself.
WE CREATE NEW THINGS: We like to think outside the box. You will have the space, confidence and freedom to create and the training required to achieve it.
WE GROW TOGETHER: You will participate in cutting-edge, multinational technology projects with foreign teams.
**Where will you do it?**
We are a great team working in a remote scheme, we are flexible and structured; providing the necessary equipment to work with and internal communication tools that facilitate our operation and that of our clients.
If you meet most of the requirements and you are interested in the profile do not hesitate to apply, our Talent team will contact you
Become derevian & develop your superpower
