FBS - Elasticsearch Data Engineer (Medallion Architecture)

hace 2 semanas


Ciudad de México, Ciudad de México Capgemini A tiempo completo

Our Client is one of the United States' largest insurers, providing a wide range of insurance and financial services products with gross written premiums well over US$25 Billion (P&C). They proudly serve more than 10 million U.S. households with more than 19 million individual policies across all 50 states through the efforts of over 48,000 exclusive and independent agents and nearly 18,500 employees. Finally, our Client is part of one the largest Insurance Groups in the world.

The Data Engineer will architect, develop, and maintain scalable data pipelines within a medallion architecture (bronze, silver/base vault, business vault, gold layers). This role is key in enabling high-quality, business-ready datasets by leveraging modern data engineering technologies and orchestration practices.

Role Responsibilities:


• Design, build, and manage end-to-end data pipelines across the medallion architecture—specifically the bronze, silver (base vault with DBT and orchestration tools, business vault), and gold layers.


• Ingest and process raw data using Spark and Amazon EMR for scalable, distributed computation.


• Develop and automate data transformations for the base vault using DBT (Data Build Tool) to standardize and model data efficiently.

Requirements
  • At least 5 years of experience as an Elasticsearch Data Engineer - ELK (Elasticsearch, Logstash, and Kibana) stack Expert knowledge)
  • Java Spring Boot 
  • IBM ACE Programming
  • BS in Computer Science, Data Engineering (Big Data, AWS certification), Data Modeling or similar
  • Full English Fluency

Skills & Competencies

  •  Strong understanding of data modeling, governance, and best practices in modern data architectures.
  •  Excellent analytical, problem-solving, and communication skills.

Software / Tool Skills

  • Elasticsearch - cluster optimization, query development, data modeling, performance tuning  & administration (4-6 Years) (Must)
  • Deep experience with Spark, Python and ETLs and Amazon EMR (Must)
  •  Hands-on experience with DBT for data transformation and modeling.
  •  Apache Airflow, AWS Step Functions, or similar. (Must)
  • Expert knowledge of Amazon S3 and Apache Iceberg for data storage and management.
  • Experience with Kubernetes for container orchestration.
  • Experience with Dremio, Looker, or equivalent business view/semantic layer technologies
  • AWS Cloud – Intermediate, AWS Lambda (Must) , Step Functions, IAM, SNS, API Gateway, VPC, Transit Gateway, Intermediate (3-4 Years)
  • JSON - Intermediate (4-6 Years)
  • Jenkins – Data Pipeline Intermediate (4-6 Years) PLUS
  • CloudWatch - Intermediate (4-6 Years) PLUS
Benefits

This position comes with competitive compensation and benefits package:

  1. Competitive salary and performance-based bonuses
  2. Comprehensive benefits package
  3. Career development and training opportunities
  4. Flexible work arrangements (remote and/or office-based)
  5. Dynamic and inclusive work culture within a globally renowned group
  6. Private Health Insurance
  7. Pension Plan
  8. Paid Time Off
  9. Training & Development

About Capgemini

Capgemini is a global leader in partnering with companies to transform and manage their business by harnessing the power of technology. The Group is guided everyday by its purpose of unleashing human energy through technology for an inclusive and sustainable future. It is a responsible and diverse organization of over 340,000 team members in more than 50 countries. With its strong 55-year heritage and deep industry expertise, Capgemini is trusted by its clients to address the entire breadth of their business needs, from strategy and design to operations, fueled by the fast evolving and innovative world of cloud, data, AI, connectivity, software, digital engineering and platforms. The Group €22.5 billion in revenues in 2023.



  • Ciudad de México, Ciudad de México Capgemini A tiempo completo

    Our Client is one of the United States' largest insurers, providing a wide range of insurance and financial services products with gross written premiums well over US$25 Billion (P&C). They proudly serve more than 10 million U.S. households with more than 19 million individual policies across all 50 states through the efforts of over 48,000 exclusive and...

  • Data Engineer Sr

    hace 5 días


    Ciudad de México, Ciudad de México Global Tree Consultores A tiempo completo

    En Global Tree buscamos un Data Engineer Sr para proyectos de alto impacto en entornos Cloud y arquitecturas de datos a gran escala.Requisitos clave:BigQuery, Cloud Storage, Dataflow, Data Studio Lakehouse Architecture & Medallion StrategyCI/CD, CDC, MLOps, AIOps, backup & restorePipelines de datos (SAP S/4HANA, ECC, On-Prem)GCP como plataforma principal+5...

  • FBS Sr Data Engineer

    hace 5 días


    Ciudad de México, Ciudad de México Capgemini A tiempo completo

    FBS – Farmer Business Services is part of Farmers operations with the purpose of building a global approach to identifying, recruiting, hiring, and retaining top talent. By combining international reach with US expertise, we build diverse and high-performing teams that are equipped to thrive in today's competitive marketplace. We believe that the...


  • Ciudad de México, Ciudad de México Reclutamiento It A tiempo completo

    Esta vacante viene de la bolsa de empleo Reclutamiento IT busca Sr Data Engineer Snowflake Cloud Bilingue en Gustavo A. Madero, Ciudad de MéxicoSobre nosotrosCon base en Redwood City, California E.E.U.U. Creamos productos premium especializados en decoración, a través de diversas plataformas ecommerce alrededor del mundo como eBay, Amazon, AliExpress,...

  • Azure Data Engineer

    hace 5 días


    Ciudad de México, Ciudad de México Softtek A tiempo completo

    · Rol: Azure Data Engineer (Data Factyory/Databricks)· Descripción del puesto:4 años de experiencia como Cloud Data EngineerDominio de Desarrollo con Python (avanzado), SQL (avanzado), PySparkExperiencia en servicios de datos en Azure Experiencia en Databricks y Data Factory Experiencia en modelado de DatosExperiencia en creación ETL...


  • Ciudad de México, Ciudad de México Workana A tiempo completo

    Remote Preferred time zone overlap: US ET & CT Experience: +5 yearsAbout the RoleWe are looking for a Senior Data Analytics Engineer with strong experience in Data Engineering, focused on AWS and Snowflake. This role combines hands-on technical execution with direct client interaction to deliver scalable, reliable, and high-quality data solutions using...

  • Lead Data Engineer

    hace 2 semanas


    Ciudad de México, Ciudad de México LaPieza A tiempo completo

    We are looking for a Lead Data Engineer (GCP)to join our team and spearhead the next generation of data platforms on Google Cloud for the Americas, shaping how analytics and data engineering power business decisions at scale. Role PurposeLead the design, development, and evolution of the data ecosystem for the Americas region on Google Cloud Platform (GCP)....

  • FBS AWS Data Engineer

    hace 4 días


    Ciudad de México, Ciudad de México Capgemini A tiempo completo

    FBS - Farmer Business Services is part of Farmers operations with the purpose of building a global approach to identifying, recruiting, hiring, and retaining top talent. By combining international reach with US expertise, we build diverse and high-performing teams that are equipped to thrive in today's competitive marketplace.We believe that the foundation...

  • Data Engineer

    hace 2 semanas


    Ciudad de México, Ciudad de México Siemens A tiempo completo

    We are seeking a Senior Data Engineer with strong SQL expertise and analytics architecture experience to design, build, and maintain scalable data solutions on Azure. This role focuses on data modeling, analytical database design, and performance optimization, ensuring data is reliable, accessible, and ready for reporting and business insights.This is a...

  • Senior Data Engineer

    hace 4 días


    Ciudad de México, Ciudad de México Motivus A tiempo completo

    About Motivus: At Motivus, we believe in unlocking human potential through innovative, cutting-edge solutions. With over 1,600 team members across 5 countries, we provide a full spectrum of software and digital services. Our teams are dedicated to driving sustainability, pushing the boundaries of technology, and building the next generation of world-class...