Snowflake Data Engineer
hace 1 día
Become derevian & develop your superpowerDerevoScience, art & human power applied to your information.We are a consulting firm specialized in data discovery projects adding meaninig to your data through our disruptive methodology which combines elements of design thinking + user experience with technological platforms for information analytics.**Snowflake Data Engineer****Summary**:The desired profile should have hands-on experience in designing, establishing, and maintaining data management and storing systems. Skilled in collecting, processing, cleaning, and deploying large datasets, understanding ER data models, and integrating with multiple data sources. Efficient in analyzing, communicating, and proposing different ways of building Data Warehouses, Data Lakes, End-to-End Pipelines, and Big Data solutions to clients, either in batch or streaming strategies.**Technical Proficiencies**:- SQL:Data Definition Language, Data Manipulation Language, Intermediate/advanced queries for analytical purpose, Subqueries, CTEs, Data types, Joins with business rules applied, Grouping and Aggregates for business metrics, Indexing and optimizing queries for efficient ETL process, Stored Procedures for transforming and preparing data, SSMS, DBeaver- Azure:Intermediate/Advanced knowledge inAzure Storage Account:Provision Azure Blob Storage or Azure Data Lake instancesBuild efficient file systems for storing data into folders with static or parametrized names, considering possible security rules and risksExperience identifying use cases for open-source file formats like parquet, AVRO, ORCUnderstanding optimized column-oriented file formats vs optimized row-oriented file formatsImplementing security configurations through Access Keys, SAS, AAD, RBAC, ACLsAzure Data Factory:Provision Azure Data Factory instancesUse Azure IR, Self-Hosted IR, Azure-SSIS to establish connections to distinct data sourcesUse of Copy or Polybase activities for loading dataBuild efficient and optimized ADF Pipelines using linked services, datasets, parameters, triggers, data movement activities, data transformation activities, control flow activities and mapping data flowsBuild Incremental and Re-Processing Loads- Snowflake:Use of staging, bronze, silver and gold layers. Load structured and semi-structured data with Copy command in Batch, Micro-Batch and Continuous strategiesExperience with working and querying parquet filesOptimizing the Data Warehouse: Scaling up, Scaling down, Caching and Clusterization. Monitoring and analyzing query execution plans, query profiles, query statistics and implementing clustering keys to optimize response times and credit consumptionTransform data with ANSI SQL or Snowpark. Continuous transformations with Streams and Tasks. Enhanced extensibility with Functions and Stored ProceduresUnderstanding of star and snowflake schemas, Watermark date columns, Slowly changing dimensions, ACID compliance and big data massively parallel processing architecturesTypes of Temporary, Transient and Permanent TablesUse of Zero-Copy Cloning. Cloning tables, schemas and dataSecurity Role Access ControlScheduling tasks using CRONLa contratación es inmediata, los beneficios que ofrecemos son superiores a los de ley, esquema 100% nominal, trabajo 100% remoto, trabajamos con diferentes clientes internacionales y nacionales por lo que los proyectos son muy interesantes para el desarrollo profesional, adicional apoyamos en certificaciones de nuestros colaboradores para continuar con el crecimiento.
-
Snowflake Data Engineer
hace 3 días
Guadalajara, México Derevo A tiempo completoBecome derevian & develop your superpower! Derevo Science, art & human power applied to your information. We are a consulting firm specialized in data discovery projects adding meaninig to your data through our disruptive methodology which combines elements of design thinking + user experience with technological platforms for information...
-
Senior Data Engineer
hace 1 semana
Guadalajara, México NTT DATA A tiempo completo**Req ID**: 276766 We are currently seeking a Senior Data Engineer to join our team in Guadalajara, Jalisco (MX-JAL), Mexico (MX). - Senior Data Engineer- Adhering to service operations and activities in accordance with the mission and goals of the organization - Adhering service operations and activities in accordance with the mission and goals of the data...
-
Data Analyst
hace 3 semanas
Guadalajara, México Softtek A tiempo completoRole:- Data Analyst - Snowflake**Requirements**:- Experience with AWS, S3, Snowflake and SQL.- SSIS, Data Factory.**Responsibilities**:- Data loading, migration from Azure Synapse to Snowflake, support to create new data models.Required Languages:- Very good conversational EnglishAbout Softtek:We offer benefits above the provided by law!Thank you for...
-
Data Engineer
hace 2 semanas
Guadalajara, México NTT DATA A tiempo completo**Req ID**: We are currently seeking a Data Engineer to join our team in GDL, Jalisco (MX-JAL), Mexico (MX).**Data Engineer (Based in Guadalajara)****Data Engineers**are responsible for designing, building, and maintaining the systems and processes that collect, store, and analyze data. They are responsible for gathering data from various sources and...
-
Data Engineer
hace 2 días
Guadalajara, México NTT DATA, Inc. A tiempo completoNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in GDL, Jalisco (MX-JAL), Mexico (MX).Data Engineer (Based in Guadalajara)Data Engineers are responsible...
-
Data Engineer
hace 18 horas
Guadalajara, México NTT DATA, Inc. A tiempo completoNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in GDL, Jalisco (MX-JAL), Mexico (MX).Data Engineer (Based in Guadalajara)Data Engineers are responsible...
-
Master Data Support Engineer
hace 1 semana
Guadalajara, México NTT DATA A tiempo completo**Req ID**: 276759 We are currently seeking a Master Data Support Engineer to join our team in Guadalajara, Jalisco (MX-JAL), Mexico (MX). **Job Description - Master Data Support Engineer** - Adhering to service operations and activities in accordance with the mission and goals of the organization - Work with operations leads and other service owners across...
-
Data Engineer
hace 3 días
Guadalajara, Jalisco, México TERATIC A tiempo completo----Descripción del rol----Buscamos un *Data Engineer con más de 5 años de experiencia, especializado en **AWS, para diseñar e implementar **soluciones de datos escalables y seguras*.El rol trabaja con stacks modernos de datos, desde *streaming y data lakes hasta analítica*, colaborando con equipos multifuncionales y liderando decisiones técnicas...
-
Data Engineer
hace 5 días
Guadalajara, Jalisco, México NTT DATA A tiempo completoReq ID: 353702NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (AWS) to join our team in Guadalajara, México (MX-MEX), Mexico (MX). "Job Duties: Key Responsibilities:...
-
Data Engineer On-site
hace 2 semanas
Guadalajara, México NTT DATA A tiempo completo**Req ID**: We are currently seeking a Data Engineer On-site (GDL) to join our team in GDL, Jalisco (MX-JAL), Mexico (MX).**Data Engineer****On-site position (GDL)**Data Engineers are responsible for designing, building, and maintaining the systems and processes that collect, store, and analyze data. They are responsible for gathering data from various...