AWS Data Engineer, Investment Management Solution

hace 2 semanas


Monterrey, México DataArt A tiempo completo

Responsibilities

Build and support event-driven solutions using the Cloudera Data Platform (PaaS) Develop, test and maintain event-driven data architecture Develop data set processes for data modelling, mining, and production Recommend ways to improve data reliability, efficiency, and quality Implement large data migration efforts to modern architectures Document data flows, including system integrations and design patterns

Requirements

3-5 years of hands-on experience with AWS Services such as S3, Glue, Lambda, RDS, Eventbridge, and other supporting AWS Serverless components Solid experience working with Python (in building Spark applications using Python) Good knowledge of IAM principles of least access in AWS Good understanding of Infrastructure-as-code and hands-on experience with AWS Cloudformation Experience designing and developing ELT/ETL pipelines using Apache Spark and AWS Glue Streaming Experience working on Cloudera Data Platform (CDP) Good Knowledge of UC4, Apache Airflow and Apache Nifi Experience and understanding of standard SQL database products (Postgres, MySQL, SQL Server), and strong SQL and RDBMS knowledge Experience working within a set of data architecture principles Good knowledge of database design such as star Schema (Facts and Dimensions) and Data Lake Principles Basic understanding of AWS DevOps and CICD methodologies, being comfortable in automating Unit and Integration Test cases for Data Pipelines Knowledge of Batch and Streaming processes Experience working in projects based on Agile methodology Good spoken English

Nice to have

Experience working with Scala (in building Spark applications using Scala) Hands-on experience with AWS Codebuild and Codepipeline NoSQL knowledge Experience in Finance (Investment Management sector) Useful links

  • Monterrey, México Neoris A tiempo completo

    **AWS Solution Arquitect**: **Date**:Nov 27, 2023 **Location**: MONTERREY, MX **Company**:NEORIS **Principales Responsabilidades**: NEORIS es un Acelerador Digital que ayuda a las compañías a entrar en el futuro. Combinamos un profundo conocimiento de industria con el más alto expertise tecnológico en el mercado para crear soluciones personalizadas...

  • Senior AWS Data Engineer

    hace 4 semanas


    Monterrey, N.L., México Inflection Point A tiempo completo

    Why is Perficient the best option? Inflection Point by Perficient is a leading global digital consultancy and has a presence around the globe transforming and connecting the most prominent brands with their customers. At Inflection Point by Perficient, we seek to grow alongside professionals promoting agile cultures and values as we challenge, champion, and...

  • Engineer Aws

    hace 1 mes


    Monterrey, México Neoris A tiempo completo

    **Engineer AWS**: **Date**:Mar 21, 2023 **Location**: MONTERREY, MX **Company**:NEORIS We are **NEORIS**! **As a digital accelerator we help companies step into the future! Currently we are looking for a Engineer AWS. **Requirements**: - Basic AWS knowledge - Basic Terraform Knowledge - Basic MS Intune knowledge - Basic Okta knowledge - Intermediate...

  • Aws Solution Architect

    hace 4 semanas


    Monterrey, México NORTHWARE SA DE CV A tiempo completo

    **AWS Solution Architect EXPERIENCIA EN**: - Desarrollar el diseño técnico de AWS, el liderazgo intelectual, los planos de arquitectura y la documentación detallada. Cree una lista de materiales, incluidos los servicios en la nube necesarios (como AWS LZ, AWS Organization, Account Factory, VPC, etc.) y las herramientas. - Diseñar, configurar y supervisar...

  • Data Engineer

    hace 7 días


    Monterrey, México Neoris A tiempo completo

    **Data Engineer**: **Date**:Jun 9, 2023 **Location**: MONTERREY, MX **Company**:NEORIS We are **NEORIS**! **As a digital accelerator we help companies step into the future! Currently we are looking for a Data Engineer. **Main responsabilities**: - Understand and support to Deliver Global technical Data architectures. - Propose new ideas on data...

  • Aws Solution Architect

    hace 4 semanas


    Monterrey, México Northware Software Development A tiempo completo

    **Descripción del puesto**: **AWS Solution Architect** **_EXPERIENCIA EN:_** - Desarrollar el diseño técnico de AWS, el liderazgo intelectual, los planos de arquitectura y la documentación detallada. Cree una lista de materiales, incluidos los servicios en la nube necesarios (como AWS LZ, AWS Organization, Account Factory, VPC, etc.) y las...

  • Data Engineer

    hace 1 mes


    Monterrey, México British American Tobacco A tiempo completo

    **BAT MEXICO IS LOOKING FOR A DATA ENGINEER!** **JOB TITLE: DATA ENGINEER** **FUNCTION: Information Technology - Digital Business Solutions (DBS)** **CITY & COUNTRY: MONTERREY, MEXICO** **ROLE SUMMARY!** **Reports to**: Director, DBS **ACCOUNTABILITIES** - We need to implement data ingestion pipelines from multiple data sources using Databricks and...

  • Data Engineer Experienced

    hace 4 semanas


    Monterrey, México Neoris A tiempo completo

    **Data Engineer Experienced**: **Date**:Apr 20, 2023 **Location**: MONTERREY, MX **Company**:NEORIS En **NEORIS**, acelerador digital que ayuda a las compañías a entrar en el futuro, estamos en búsqueda de Data Engineer Experienced , **Principales Responsabilidades**: - Ingesta (Data Ingestion) - Toma de requerimientos de negocio para generar...

  • Data Engineer Sr

    hace 1 mes


    Monterrey, México Neoris A tiempo completo

    **Data Engineer Sr**: **Date**:Jul 10, 2023 **Location**: MONTERREY, MX **Company**:NEORIS We are **NEORIS**! **As a digital accelerator we help companies step into the future! Currently we are looking for a Data Engineer Sr. **Main responsabilities**: - Understand and support to Deliver Global technical Data architectures - Propose new ideas on data...

  • Senior Data Engineer

    hace 3 semanas


    Monterrey, N.L., México Inflection Point A tiempo completo

    Why is Perficient the best option? Inflection Point by Perficient is a leading global digital consultancy and has a presence around the globe transforming and connecting the most prominent brands with their customers. At Inflection Point by Perficient, we seek to grow alongside professionals promoting agile cultures and values as we challenge, champion, and...

  • Sr Data Engineer

    hace 1 mes


    Monterrey, México Neoris A tiempo completo

    **Sr Data Engineer**: **Date**:Nov 27, 2023 **Location**: MONTERREY, MX **Company**:NEORIS **Principales Responsabilidades**: - Factibilidad (Revisar Fuentes de Datos, Dueños Datos, Limpieza, Integración y Transformación de Datos como preprocesamiento) - Hacer un modelo base, validación de resultados (Análisis de los Datos, Procesamiento de los...


  • Monterrey, México Divelement Web Services A tiempo completo

    Job Summary: We are seeking a talented and experienced Data Science Engineer to join our data team. As a Data Science Engineer, you will be responsible for leveraging your expertise in data analysis, machine learning, and software engineering to develop innovative data-driven solutions. You will collaborate with cross-functional teams to extract insights...

  • Data Management Manager

    hace 4 semanas


    Monterrey, México AutoZone A tiempo completo

    Job Title Data Management Manager Position Purpose To be the business partner of the business analysis areas, defining the guidelines for data management and reporting, with a corporate governance approach. Responsible for aligning corporate tools for proper use in Mexico, accelerating the adoption of new analytical platforms implemented in the US....

  • Data Engineer

    hace 4 semanas


    Monterrey, México Bond A tiempo completo

    **Bond** es una empresa que conecta oportunidades con talento joven. Estamos buscando a un **Data Engineer **para una de nuestras empresas aliadas, **Danu Consulting.** **RESPONSABILIDADES** - Implementer distintos procesos de ETL para mover bases de datos a la nube - Identification y documentación de procesos de data - Programar y almacenar queries en...

  • Cloud Data Engineer

    hace 1 mes


    Monterrey, México Intuitive Cloud A tiempo completo

    **ROLES & RESPONSIBILITIES**: - Design, develop, implement, and tune large-scale distributed systems and pipelines that process large volume of data; focusing on scalability, low-latency, and fault-tolerance in every system built - Developing scalable and re-usable frameworks for ingesting large data from multiple sources. - Modern Data Orchestration...


  • Monterrey, México DataArt A tiempo completo

    Project overview: Our project aims to develop a large language model (LLM) using AWS and OpenSearch to process files containing details on clinical trials, including results, contraindications, and other relevant data. The primary goal is to train the LLM with this data to generate hypotheses that will aid in research. We have a dedicated team for the LLM...

  • DevOps Aws Engineer

    hace 1 mes


    Monterrey, México DataArt A tiempo completo

    Client: Our client is a cybersecurity company that offers various services (such as penetration testing, monitoring, security assessments, etc.) and operates worldwide. They have recently acquired various other companies and are in the process of unifying tools and processes among their recently bought business units. Position overview: A key role of the...

  • Senior Cloud Engineer

    hace 2 semanas


    Monterrey, N.L., México Inflection Point A tiempo completo

    Perficient is a leading global digital consultancy and has a presence around the globe transforming and connecting the most prominent brands with their customers. At Perficient, we seek to grow alongside professionals promoting agile cultures and values as we challenge, champion, and celebrate our people for us to build a great future together. Job Summary...

  • Data Engineer Lead

    hace 4 semanas


    Monterrey, N.L., México Inflection Point A tiempo completo

    Why is Perficient the best option? Inflection Point by Perficient is a leading global digital consultancy and has a presence around the globe transforming and connecting the most prominent brands with their customers. At Inflection Point by Perficient, we seek to grow alongside professionals promoting agile cultures and values as we challenge, champion, and...

  • Experienced Data Engineer

    hace 4 semanas


    Monterrey, México Neoris A tiempo completo

    **Experienced Data Engineer**: **Date**:Mar 23, 2023 **Location**: MONTERREY, MX **Company**:NEORIS We are **NEORIS**! **As a digital accelerator we help companies step into the future! Currently we are looking for a Experienced Data Engineer. **Requirements**: - SQL - Azure - Data Integration - Data Migration - Support Data Warehouse on Azure - Data...