Gcp Data Engineer

hace 2 semanas

Aguascalientes, México Capgemini A tiempo completo

**RH**:Raul García

**Position**:GCP Data Engineer

**Location**:Aguascalientes, Mexico

**Industry - Sector**:MALS

**What you’ll do?**
- Build, maintain, and optimize end-to-end ETL pipelines using Google Cloud Dataflow, Apache Beam, Cloud Composer, and Cloud Functions.
- Automate data ingestion, transformation, and integration processes from multiple sources (structured and unstructured data) into cloud-based data platforms.
- Design and implement scalable cloud-based data architectures using services like Google BigQuery, Google Cloud Storage (GCS), Cloud Pub/Sub, and Cloud Dataproc.
- Architect data solutions that are reliable, performant, and cost-effective for large-scale data processing and storage needs.
- Build and manage data lakes using Google Cloud Storage and ensure data is properly ingested, stored, and processed in an organized and secure manner.
- Implement Google BigQuery data warehouses, optimize data models for performance, and ensure they are scalable to handle large datasets.
- Leverage Google Cloud Dataflow or Apache Beam to transform data into formats suitable for reporting and machine learning models.
- Integrate diverse data sources such as relational databases, NoSQL databases, APIs, and flat files into the data pipeline architecture.
- Automate the deployment of data pipelines, processes, and infrastructure using Google Cloud Deployment Manager, Terraform, or Cloud Composer.
- Design and manage CI/CD pipelines for efficient deployment of data engineering solutions.
- Implement best practices for data governance, ensuring data privacy and compliance with security standards (e.g., encryption, data masking, and access control).
- Manage permissions and security with Google IAM, and ensure that sensitive data is securely handled and stored.
- Continuously monitor the performance of data pipelines and storage solutions, identifying opportunities for optimization and cost reduction.
- Troubleshoot and resolve data integration and pipeline issues to ensure smooth and efficient data processing.
- Collaborate with cross-functional teams (data scientists, analysts, business stakeholders) to understand data requirements and deliver high-quality data solutions.
- Provide support for data-related questions, troubleshooting, and assist with data visualization and reporting tasks.
- Document data engineering processes, including pipeline architectures, configurations, and best practices.
- Prepare and deliver regular updates on data engineering projects and their progress.

**What you’ll bring**:

- Expertise in Google Cloud BigQuery, Google Cloud Storage (GCS), Cloud Dataflow, Cloud Pub/Sub, Google Cloud Dataproc, Cloud Composer, Cloud Functions, and Cloud Bigtable.
- Experience in building ETL pipelines using Cloud Dataflow, Apache Beam, Google Cloud
- Ability to integrate structured and unstructured data sources into cloud-based systems.
- Strong experience working with Google BigQuery for building and managing data warehouses and running optimized analytical queries.
- Expertise in data ingestion, transformation, and integration using GCP tools, including Google Cloud Pub/Sub, Cloud Dataflow, and BigQuery.
- Proficiency in Python, SQL, and JavaScript for data engineering tasks, scripting, and automation.
- Experience with Apache Spark and PySpark is a plus for handling large-scale data processing.
- Experience with Google Cloud Deployment Manager, Terraform, or Cloud Composer to automate infrastructure and data pipelines.
- Strong understanding of Google IAM, data encryption, and secure data access practices.
- Proficiency in Git for version control and collaborative development.

**Soft skills**:
Work Underpressure, Quality at work, Results Oriented

**What can YOU expect in a career with Capgemini?**
- Working in a team environment, Consultants will focus on the analysis, design and development of technology-based solutions for Capgemini’s clients.
- You will work alongside technical, functional and industry specialists to assist with the development, implementation and integration of innovative system solutions including methods, techniques and tools.
- You will contribute to client satisfaction by providing timely and responsive value-added services and work products.
- Capgemini offers a competitive compensation and benefits package.
- Headquartered in Paris, France, Capgemini has a presence of more than 340 thousand professionals in Mexico distributed among 3 sites located in Mexico City, Monterrey and Aguascalientes. A deeply multicultural organization.
- Capgemini has developed its own way of working, the Collaborative Business ExperienceTM, and draws on Rightshore, its worldwide delivery model.

**You will love this job because**
- Capgemini focuses on giving each new hire a YOU-nique experience through our recruitment process and on-boarding program, as well as by helping you to build your own career and professional skills foundation.
- Capgemini provides a collaborative environm

  • Data Engineer

    hace 2 días

    Aguascalientes, México Capgemini A tiempo completo

    RRHH: Fernando Cortés Puesto: Data Engineer Nível de experiência: Senior Nível de educación: Educación Superior Ubicación: AGS Práctica: I&D Conocimientos y experiência necesaria: - Responsable del soporte de desarrollo, el mantenimiento y la implementación de un módulo de proyecto complejo. - Debe tener una buena experiência en la...

  • Digital Engineering Sr. Engineer

    hace 7 meses

    Aguascalientes, México NTT DATA A tiempo completo

    **Req ID**: 265954 We are currently seeking a Digital Engineering Sr. Engineer to join our team in Aguascalientes, Aguascalientes (MX-AGU), Mexico (MX). Key responsibilities: - Integrate and manage APIs using Mulesoft or Apigee, ensuring seamless communication between different systems. - Collaborate with cross-functional teams to gather and refine...

  • Senior Data Engineer for Cloud Services

    hace 4 semanas

    Aguascalientes, Aguascalientes, México Capgemini A tiempo completo

    Company Overview">Capgemini is a global leader in consulting, technology services and digital transformation. With over 340 thousand professionals in more than 40 countries, we help our clients transform their businesses through innovative technologies.Salary Range$90,000 - $120,000 per year, depending on experience.Job DescriptionWe are seeking a Senior...

  • Cloud Data Engineer Lead

    hace 20 horas

    Aguascalientes, Aguascalientes, México Capgemini A tiempo completo

    **Job Summary**We are seeking an experienced Cloud Data Engineer Lead to join our team at Capgemini Mexico. This role will involve designing, building, and maintaining scalable data pipelines, as well as implementing cloud-based data architectures using Azure.**About the Role**The ideal candidate will have in-depth experience with Azure Data Factory, Azure...

  • Cloud Data Engineer

    hace 20 horas

    Aguascalientes, Aguascalientes, México Capgemini A tiempo completo

    Job SummaryWe are seeking an experienced Cloud Data Engineer to join our team at Capgemini in Aguascalientes, Mexico. The successful candidate will be responsible for designing, developing, and delivering scalable big data solutions using Google Cloud Platform technologies.

  • Data Engineer Leader for Scalable Data Solutions

    hace 2 semanas

    Aguascalientes, Aguascalientes, México Capgemini A tiempo completo

    About the JobWe are seeking a highly skilled Data Engineer to lead the design and implementation of scalable data solutions on AWS. This is an exciting opportunity to work with a talented team of professionals in a collaborative environment.ResponsibilitiesDesign and implement end-to-end ETL pipelines using AWS Glue, AWS Lambda, and Amazon Kinesis.Buid and...

  • Aws Data Engineer

    hace 2 semanas

    Aguascalientes, México Capgemini A tiempo completo

    **RH**:Raul García **Position**:AWS Data Engineer **Location**:Aguascalientes, Mexico **Industry - Sector**:MALS **What you’ll do?** - Build and maintain end-to-end ETL pipelines on AWS using services like AWS Glue, AWS Lambda, Amazon Kinesis, and Amazon Redshift. - Implement batch and real-time data processing workflows to integrate data from...

  • Big Data Solutions Engineer

    hace 4 semanas

    Aguascalientes, Aguascalientes, México Zillow A tiempo completo

    About the RoleWe are seeking a skilled Senior Software Development Engineer, Big Data to join our team at Zillow Group's Data Management division. This is an exciting opportunity to contribute to the design and development of mission-critical ETL pipelines, data products, and analytics solutions.In this role, you will work closely with business stakeholders,...

  • Fullstack Aws Data Engineer

    hace 2 semanas

    Aguascalientes, México Capgemini A tiempo completo

    **RH**:Raul García **Position**:Fullstack Azure Data Engineer **Location**:Aguascalientes, Mexico **Industry - Sector**:MALS **What you’ll do?** - Build, optimize, and maintain scalable data pipelines to process large datasets from various sources using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics. - Implement ETL (Extract,...

  • Senior Data Platform Engineer

    hace 2 meses

    Aguascalientes, Aguascalientes, México Capgemini A tiempo completo

    **Job Summary**We are seeking a highly skilled Senior Data Platform Engineer to design and implement cloud-based data warehousing and governance architecture with a Lakehouse paradigm.**Key Responsibilities:**Design and implement Azure cloud-based Data Warehousing and Governance architecture with Lakehouse paradigm.Integrate technical functionality, ensuring...

  • Senior Software Engineer, Big Data

    hace 3 semanas

    Aguascalientes, México Zillow A tiempo completo

    About the teamZillow’s Customer Linking and Identity Platform team is part of the Data Engineering organization and works closely with multiple product and analytics organizations. You will contribute to the design and implementation of data engineering solutions that support AI, Marketing, and Data Science teams in their effort to improve Zillow’s...

  • Snowflake Data Engineer with ETL Expertise

    hace 1 mes

    Aguascalientes, Aguascalientes, México Capgemini A tiempo completo

    **Company Overview**: At Capgemini, we're committed to delivering innovative solutions that drive business growth. With a presence in over 340 thousand professionals across Mexico, our multicultural organization fosters a collaborative environment where you can thrive.**Salary:** $120,000 - $180,000 per annum**Job Description**: As a Snowflake Data Engineer,...

  • Principal Consultant – Pyspark/Python Data Engineer

    hace 3 meses

    Aguascalientes, México Genpact A tiempo completo

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...

  • Data Engineering Lead for Analytics

    hace 3 semanas

    Aguascalientes, Aguascalientes, México Zillow A tiempo completo

    Zillow is reimagining real estate to make it easier to unlock life's next chapter.OverviewWe are seeking a highly skilled Data Engineering Lead for our Analytics team. As a key member of our engineering organization, you will play a critical role in developing and maintaining the data infrastructure that supports our analytics workflows.The successful...

  • Azure Data Factory + ETL Engineer

    hace 2 meses

    Aguascalientes, Aguascalientes, México Getecsa A tiempo completo

    About Us:At Getecsa, we strive to provide top-notch services that cater to the needs of our clients. Our team of experts is dedicated to delivering high-quality solutions that meet and exceed expectations.Job Description:We are currently seeking an Azure Data Factory + ETL Senior to join our team. The ideal candidate will have a strong background in MS Azure...

  • Test Engineer

    hace 7 meses

    Aguascalientes, México Flex A tiempo completo

    Flex, a Fortune global 500 company, is the diversified manufacturing partner of choice that helps market-leading brands design, build and deliver innovative products that improve the world. We believe in the power of diversity and inclusion and cultivate a workplace culture of belonging that views uniqueness as a competitive edge and builds a community that...

  • Simulation Engineer

    hace 4 meses

    Aguascalientes, México Flex LTD A tiempo completo

    Flex is the diversified manufacturing partner of choice that helps market-leading brands design, build and deliver innovative products that improve the world. We believe in the power of diversity and inclusion and cultivate a workplace culture of belonging that views uniqueness as a competitive edge and builds a community that enables our people to push the...

  • AWS Cloud Engineer

    hace 20 horas

    Aguascalientes, Aguascalientes, México Capgemini A tiempo completo

    Job DescriptionWe are seeking an experienced AWS Cloud Engineer to join our team at Capgemini in Mexico. As a key member of our data engineering group, you will be responsible for designing, implementing, and maintaining scalable and high-performance data solutions on the AWS Cloud.About the RoleDesign and implement end-to-end ETL pipelines on AWS using...

  • Quality Engineer

    hace 7 meses

    Aguascalientes, México Flex A tiempo completo

    Flex, a Fortune global 500 company, is the diversified manufacturing partner of choice that helps market-leading brands design, build and deliver innovative products that improve the world. We believe in the power of diversity and inclusion and cultivate a workplace culture of belonging that views uniqueness as a competitive edge and builds a community that...

  • Principal Consultant

    hace 3 meses

    Aguascalientes, México Genpact A tiempo completo

    **Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose - the relentless pursuit of a world that works better for people - we...