FBS - Elasticsearch Data Engineer (Medallion Architecture)

hace 17 horas


Ciudad de México, Ciudad de México Capgemini A tiempo completo

Our Client is one of the United States' largest insurers, providing a wide range of insurance and financial services products with gross written premiums well over US$25 Billion (P&C). They proudly serve more than 10 million U.S. households with more than 19 million individual policies across all 50 states through the efforts of over 48,000 exclusive and independent agents and nearly 18,500 employees. Finally, our Client is part of one the largest Insurance Groups in the world.

The Data Engineer will architect, develop, and maintain scalable data pipelines within a medallion architecture (bronze, silver/base vault, business vault, gold layers). This role is key in enabling high-quality, business-ready datasets by leveraging modern data engineering technologies and orchestration practices.

Role Responsibilities:


• Design, build, and manage end-to-end data pipelines across the medallion architecture—specifically the bronze, silver (base vault with DBT and orchestration tools, business vault), and gold layers.


• Ingest and process raw data using Spark and Amazon EMR for scalable, distributed computation.


• Develop and automate data transformations for the base vault using DBT (Data Build Tool) to standardize and model data efficiently.

Requirements
  • At least 5 years of experience as an Elasticsearch Data Engineer - ELK (Elasticsearch, Logstash, and Kibana) stack Expert knowledge)
  • Java Spring Boot 
  • IBM ACE Programming
  • BS in Computer Science, Data Engineering (Big Data, AWS certification), Data Modeling or similar
  • Full English Fluency

Skills & Competencies

  •  Strong understanding of data modeling, governance, and best practices in modern data architectures.
  •  Excellent analytical, problem-solving, and communication skills.

Software / Tool Skills

  • Elasticsearch - cluster optimization, query development, data modeling, performance tuning  & administration (4-6 Years) (Must)
  • Deep experience with Spark, Python and ETLs and Amazon EMR (Must)
  •  Hands-on experience with DBT for data transformation and modeling.
  •  Apache Airflow, AWS Step Functions, or similar. (Must)
  • Expert knowledge of Amazon S3 and Apache Iceberg for data storage and management.
  • Experience with Kubernetes for container orchestration.
  • Experience with Dremio, Looker, or equivalent business view/semantic layer technologies
  • AWS Cloud – Intermediate, AWS Lambda (Must) , Step Functions, IAM, SNS, API Gateway, VPC, Transit Gateway, Intermediate (3-4 Years)
  • JSON - Intermediate (4-6 Years)
  • Jenkins – Data Pipeline Intermediate (4-6 Years) PLUS
  • CloudWatch - Intermediate (4-6 Years) PLUS
Benefits

This position comes with competitive compensation and benefits package:

  1. Competitive salary and performance-based bonuses
  2. Comprehensive benefits package
  3. Career development and training opportunities
  4. Flexible work arrangements (remote and/or office-based)
  5. Dynamic and inclusive work culture within a globally renowned group
  6. Private Health Insurance
  7. Pension Plan
  8. Paid Time Off
  9. Training & Development

About Capgemini

Capgemini is a global leader in partnering with companies to transform and manage their business by harnessing the power of technology. The Group is guided everyday by its purpose of unleashing human energy through technology for an inclusive and sustainable future. It is a responsible and diverse organization of over 340,000 team members in more than 50 countries. With its strong 55-year heritage and deep industry expertise, Capgemini is trusted by its clients to address the entire breadth of their business needs, from strategy and design to operations, fueled by the fast evolving and innovative world of cloud, data, AI, connectivity, software, digital engineering and platforms. The Group €22.5 billion in revenues in 2023.


  • data engineer

    hace 19 horas


    Ciudad de México, Ciudad de México Atos A tiempo completo

    About Atos GroupAtos Group is a global leader in digital transformation with c. 70,000 employees and annual revenue of c. € 10 billion, operating in 67 countries under two brands — Atos for services and Eviden for products. European number one in cybersecurity, cloud and high-performance computing, Atos Group is committed to a secure and decarbonized...

  • FBS Data Engineer

    hace 16 horas


    Ciudad de México, Ciudad de México Capgemini A tiempo completo

    Our Client is one of the United States' largest insurers, providing a wide range of insurance and financial services products with gross written premium well over US$25 Billion (P&C). They proudly serve more than 10 million U.S. households with more than 19 million individual policies across all 50 states through the efforts of over 48,000 exclusive and...


  • Ciudad de México, Ciudad de México Global Applications Solution A tiempo completo

    Position: Lead/Principal Data Engineer/Data ArchitectClient Domain: Banking InstitutionWork StructureInitial Phase: Mandatory 3 weeks on-site in Mexico City (Santa Fe) for essential client immersion and team onboarding.Ongoing: Following the initial phase, the role transitions to fully remote .Note on Expenses: The client will not cover travel,...

  • FBS AWS Data Engineer

    hace 17 horas


    Ciudad de México, Ciudad de México Capgemini A tiempo completo

    Our Client is one of the United States' largest insurers, providing a wide range of insurance and financial services products with gross written premiums well over US$25 Billion (P&C). They proudly serve more than 10 million U.S. households with more than 19 million individual policies across all 50 states through the efforts of over 48,000 exclusive and...

  • FBS Data Engineer-ETL

    hace 17 horas


    Ciudad de México, Ciudad de México Capgemini A tiempo completo

    Our client is one of the United States' largest insurers, providing a wide range of insurance and financial services products with gross written premiums well over US$25 Billion (P&C). They proudly serve more than 10 million U.S. households with more than 19 million individual policies across all 50 states through the efforts of over 48,000 exclusive and...

  • Senior Data Engineer

    hace 1 semana


    Ciudad de México, Ciudad de México Arkham Technologies A tiempo completo

    About ArkhamArkham is a Data & AI Platform—a suite of powerful tools designed to help you unify your data and use the best Machine Learning and Generative AI models to solve your most complex operational challenges. Today, industry leaders like Circle K, Mexico Infrastructure Partners, and Televisa Editorial rely on our platform to simplify access to data...

  • Senior Data Engineer

    hace 1 semana


    Ciudad de México, Ciudad de México Arkham Technologies A tiempo completo

    About ArkhamArkham is a Data & AI Platform—a suite of powerful tools designed to help you unify your data and use the best Machine Learning and Generative AI models to solve your most complex operational challenges.Today, industry leaders like Circle K, Mexico Infrastructure Partners, and Televisa Editorial rely on our platform to simplify access to data...

  • GCP Data Engineer

    hace 18 horas


    Ciudad de México, Ciudad de México Insight Global A tiempo completo

    ResponsibilitiesDesign and build production data engineering solutions on Google Cloud Platform (GCP) using services such as BigQuery, Dataflow, DataForm, Astronomer, Data Fusion, DataProc, Cloud Composer/Air Flow, Cloud SQL, Compute Engine, Cloud Functions, Cloud Run, Artifact Registry, GCP APIs, Cloud Build, App Engine, and real-time data streaming...

  • Data Engineer

    hace 17 horas


    Ciudad de México, Ciudad de México Ford Motor A tiempo completo

    DescriptionAs a GCP Data Engineer, you will integrate data from various sources into novel data products. You will build upon existing analytical data, including merging historical data from legacy platforms with data ingested from new platforms. You will also analyze and manipulate large datasets, activating data assets to enable enterprise platforms and...

  • Lead, Data Engineer

    hace 1 semana


    Ciudad de México, Ciudad de México Boldr A tiempo completo

    A LITTLE BIT ABOUT BoldrBoldr is the first global B-Corp dedicated to delivering world-class Client experiences while creating access to dignified, meaningful work in communities around the world.We are a global team, united by our desire to connect diverse people with common values for boldr impact. We employ just over a thousand team members across five...