Data Engineer Gcp

hace 1 semana

Ciudad de México Sequoia Connect A tiempo completo

Our client represents the connected world, offering innovative and customer-centric information technology services and solutions, enabling Enterprises, Associates and the Society to Rise. Our client is a USD 4.0 billion company with 107,100+ professionals across 90 countries, helping over 800 global customers including Fortune 500 companies.

Its innovation platforms and reusable assets connect across a number of technologies to deliver tangible business value to its stakeholders. Our client is also amongst the Fab 50 companies in Asia as per the Forbes 2014 List.

Our client is part of the USD 16.9 billion Group that employs more than 200,000 people in over 100 countries. The Group operates in the key industries that drive economic growth, enjoying a leadership position in tractors, utility vehicles, information technology, after-market and vacation ownership.

We are currently searching for a **Data engineer GCP**:
**Responsibilities**:

- Design and build production data engineering solutions to deliver data pipeline patterns using following Google Cloud Platform (GCP) services:

- In-depth understanding of Google's product technology and underlying architectures
- BigQuery - Warehouse/ data marts - Through understanding of Big Query internals to write efficient queries for ELT needs, creation of views/materialized views, creation of reusable store procedures etc.
- DataFlow (Apache Beam) - reusable Flex templates/ data processing frameworks using Java for both batch and stream needs.
- Pub/Sub, Kafka, Confluent Kafka - Real time streaming of database changes or events.
- Experience of designing, building, and deploying production-level data pipelines using Kafka; Strong experience working on Event Driven Architecture
- Strong knowledge of the Kafka Connect framework, with experience using several connector types HTTP REST proxy, JMS, File, SFTP, JDBC etc.
- Experience in handling huge volumes of streaming messages from Kafka
- Cloud Composer (Apache Airflow) - to build, monitor and orchestrating the pipeline
- Knowledge on BigTable
- Cloud SQL, Compute Engine, Cloud Function, Cloud Run and App Engine, Cloud Storage
- Experience with open-source distributed storage and processing utilities in the Apache Hadoop family.
- Extensive knowledge on processing various file formats orc, Avro, csv, json, xml etc.
- Knowledge/experience in any ETL tools like DataStage/Informatica - Ability to understand existing on-premises ETL workflows and redesign them in GCP.
- Experience and expertise on Terraform to deploy the GCP’s in CI/CD.
- Knowledge/ Experience on connecting to on-prem API’s from google cloud.

**Language**:

- English Advance.

If you meet these qualifications and are pursuing new challenges that focus on delivering innovative solutions that increase business value, we’d like to talk with you today. Come be a part of the action at Sequoia Connect.

Keywords:
ELT, BigQuery, SQL, JMS

  • Gcp Data Engineer

    hace 2 semanas

    Ciudad de México Atos A tiempo completo

    **GCP Data Engineer**:- Publication Date: Sep 20, 2024- Ref. No: - Location: Mexico City, Mexico city, MX, 06600Eviden, part of the Atos Group, with an annual revenue of circa € 5 billion is a global leader in data-driven, trusted and sustainable digital transformation. As a next generation digital business with worldwide leading positions in digital,...

  • GCP Data Engineer

    hace 3 días

    Ciudad de México, Ciudad de México Insight Global A tiempo completo

    ResponsibilitiesDesign and build production data engineering solutions on Google Cloud Platform (GCP) using services such as BigQuery, Dataflow, DataForm, Astronomer, Data Fusion, DataProc, Cloud Composer/Air Flow, Cloud SQL, Compute Engine, Cloud Functions, Cloud Run, Artifact Registry, GCP APIs, Cloud Build, App Engine, and real-time data streaming...

  • Gcp Data Engineer

    hace 2 semanas

    Ciudad de México Viseo A tiempo completo

    **VISEO** es una empresa global de consultoría digital y empresarial que ayuda a sus clientes en sus viajes de transformación utilizando tecnología avanzada y experiência en el sector. Nuestro objetivo es hacer realidad la estrategia digital de nuestros clientes, permitiéndoles ser más productivos, innovadores y competitivos.Operamos en más de 20...

  • Gcp Data Engineer

    hace 3 días

    Ciudad de México The Ksquare Group A tiempo completo

    Mexico City, MX Full-time Remote **Job Summary**: **Key Responsibilities**: Design, develop, and deploy batch and streaming data pipelines using BigQuery, DataFlow, DataProc, Cloud Composer, and Pub/Sub Build robust ETL/ELT workflows in Python, SQL, or Spark that deliver clean, reliable data to consumers Implement data quality checks, logging, and alerting...

  • Data Engineer Gcp

    hace 2 días

    Ciudad de México Praxis A tiempo completo

    **Job Title**: Data Engineer **Location**: 100% Remote (potential for hybrid in Mexico City, Lago Alberto 319 **Overview**: Join the Ordering, Billing, Pricing & Finance (OBF) team at Google Cloud Systems, where you will play a crucial role in ensuring precise data delivery, optimizing pipelines, and resolving issues related to ordering, billing, and...

  • Data Engineer Gcp

    hace 7 horas

    Ciudad de México Praxis A tiempo completo

    **Job Title**: Data Engineer**Location**: 100% Remote (potential for hybrid in Mexico City, Lago Alberto 319**Overview**:Join the Ordering, Billing, Pricing & Finance (OBF) team at Google Cloud Systems, where you will play a crucial role in ensuring precise data delivery, optimizing pipelines, and resolving issues related to ordering, billing, and pricing in...

  • Cloud Engineer- Gcp

    hace 6 días

    México NTT DATA A tiempo completo

    **Req ID**: 307878 We are currently seeking a Cloud Engineer - GCP to join our team in Mexico, México (MX-MEX), Mexico (MX). **Job Title / Role: GCP & GKE Staff Engineer** **Job Description**: Primary Skill: Cloud-Infrastructure-Google Cloud Platform Minimum work experience: 8+ yrs Total Experience: 8+ Years **Mandatory Skills**: **Technical...

  • Data Engineer

    hace 2 semanas

    Ciudad de México Recursos On Site A tiempo completo

    Importante empresa Fintech busca tu talento para unirte a su equipo de trabajo:"Data Engineer"**Escolaridad**: Ingeniería en Sistemas, Informática o afín.**Experiência**: 3 años**Inglés**: intermedio conversacional **INDISPENSABLE**Lugar a laborar Santa Fé, Ciudad de México**(esquema Híbrido) 3 días en casa, 2 presenciales****Funciones que deberá...

  • Gcp Terraform Engineer

    hace 3 semanas

    Ciudad de México Atos A tiempo completo

    **GCP Terraform Engineer**:- Publication Date: Oct 8, 2024- Ref. No: - Location: Mexico City, Mexico city, MX, 06600Eviden, part of the Atos Group, with an annual revenue of circa € 5 billion is a global leader in data-driven, trusted and sustainable digital transformation. As a next generation digital business with worldwide leading positions in digital,...

  • Gcp Data Engineer

    hace 2 semanas

    Ciudad de México VISEO - Spain A tiempo completo

    **VISEO** es una empresa global de consultoría digital y empresarial que ayuda a sus clientes en sus viajes de transformación utilizando tecnología avanzada y experiência en el sector. Nuestro objetivo es hacer realidad la estrategia digital de nuestros clientes, permitiéndoles ser más productivos, innovadores y competitivos.Operamos en más de 20...