Big Data Engineer

hace 2 semanas


Guadalajara, México Intugo Call Center A tiempo completo

Intugo in Partnership with a leading company in the technology industry are looking for a **Data Engineer** with a diverse background in data integration to join the Data Services team. Some data are small, some data are very large (1 trillion+ rows), some data are structured, and some data are not. Our data comes in all kinds of sizes, shapes and formats. Traditional RDBMS like PostgreSQL, Oracle, SQL Server, MPPs like StarRocks, Vertica, Snowflake, Google BigQuery, and unstructured, key-value like MongoDB, and Elasticsearch, to name a few.

We are looking for individuals who can design and solve any data problems using different types of databases and technologies supported within our team. We use MPP databases to analyze billions of rows in seconds. We use Spark and Iceberg, batch or streaming to process whatever the data needs are. We also use Trino to connect all different types of data without moving them around.

Besides a competitive compensation package, you’ll be working with a great group of technologists interested in finding the right database to use and the right technology for the job in a culture that encourages innovation. If you’re ready to step up and take on some new technical challenges at a well-respected company, this is a unique opportunity for you.

**Responsibilities**:

- Implement ETL/ELT processes using various tools and programming languages (Scala, Python) against our MPP databases StarRocks, Vertica and Snowflake.
- Work with the Hadoop team and optimize Hive and Iceberg tables.
- Contribute to the existing Data Lake and Data Warehouse imitative using Hive, Spark, Iceberg, Presto/Trino.
- Analyze business requirements, design and implement required data models.

**Qualifications: (must have)**
- BA/BS in Computer Science or related field.
- 1+ years of experience with MPP databases such as StarRocks, Vertica, Snowflake.
- 3+ years of experience with RDBMS databases such as Oracle, MSSQL or PostgreSQL.
- Programming background with Scala, Python, Java or C/C++.
- Strong in any of the Linux distributions, RHEL, CentOS or Fedora.
- Experience working in both OLAP and OLTP environments.
- Experience working on-prem, not just cloud environments.

**Desired: (nice to have)**
- Experience with Elasticsearch or ELK stack.
- Working knowledge of streaming technologies such as Kafka.
- Working knowledge of orchestration tools such as Oozie and Airflow.
- Experience with Spark. PySpark, SparkSQL, Spark Streaming, etc.
- Experience using ETL tools such as Informatica, Talend and/or Pentaho.
- Understanding of Healthcare data.
- Data Analyst or Business Intelligence would be a plus.

**Benefits**
- Income of MXN 65,000 monthly, before tax
- Law and higher benefits
- 100% payroll scheme

**Location in Zapopan, near plaza del sol (locations)**

**Send your resume**:
**Salary**: $50,000.00 - $65,000.00 per month

Work Location: In person


  • Big Data QA Engineer

    hace 7 días


    Guadalajara, México Dresden Partners A tiempo completo

    **Descripción**: Dresden Partners experts in web technology, UX / UI, mobile and software development, with near-shore staffing services, international tech and specialized local tech sourcing. We are looking for talent for the position: Big Data QA Engineer Education: Bachelor of Computer Systems or related career Experience: 5+...

  • Big Data Engineer

    hace 9 horas


    Guadalajara, México Grid Dynamics A tiempo completo

    We are seeking a strong Big Data Engineer with good technical expertise The world's largest American retail chain sells supplying tools, construction products, and services with over 90 distribution centers throughout the United States to serve over 2,000 stores. As of 2020, this company is ranked in the Fortune 500 rankings of the largest United States...


  • Guadalajara, México EPAM Systems A tiempo completo

    EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most...

  • Master Data Support Engineer

    Encontrado en: beBee S MX - hace 3 semanas


    Guadalajara, México NTT Data A tiempo completo

    Date: Apr 1, 2024 Location: Guadalajara, JAL, MX #job-location.job-location-inline { display: inline; } Company: NTT DATA Services Req ID: 276759 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking...


  • Guadalajara, México Grid Dynamics A tiempo completo

    Our customer is one of the world's largest technology companies based in Silicon Valley with operations all over the world. On this project, we are working with bleeding-edge big data technologies to develop a high-performance data analytics platform, which handles petabytes of data. We are looking for an enthusiastic and technology-proficient Big Data...

  • Senior Data Engineer

    Encontrado en: beBee S MX - hace 4 semanas


    Guadalajara, México NTT DATA Services A tiempo completo

    Req ID: 276766  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Data Engineer to join our team in Guadalajara, Jalisco (MX-JAL), Mexico (MX). Senior...

  • Data Engineer

    hace 2 días


    Guadalajara, México Capital Empresarial Horizonte A tiempo completo

    **Capital Empresarial Horizonte Empresa Mexicana especialista en Recursos Humanos y Tecnologías de la Información Solicita**: **Data Engineer (Hibrido)** **Perfil** **Escolaridad**: Ingeniería en Sistemas, Informática o afín. **Nível de inglés: inglés Conversacional INDISPENSABLE** **Experiência**: 3 años de experiência. Lugar a laborar: CDMX...

  • Master Data Support Engineer

    Encontrado en: beBee S MX - hace 4 semanas


    Guadalajara, México NTT DATA Services A tiempo completo

    Req ID: 276759  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Master Data Support Engineer to join our team in Guadalajara, Jalisco (MX-JAL), Mexico...

  • Senior Data Engineer- Snowflake

    Encontrado en: beBee S MX - hace 3 semanas


    Guadalajara, México NTT DATA Services A tiempo completo

    Req ID: 276766  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Data Engineer- Snowflake to join our team in Guadalajara, Jalisco (MX-JAL), Mexico...

  • Big Data Leader

    hace 1 día


    Guadalajara, México U hi A tiempo completo

    **Big Data Leader** SQL Knowledge, with have databricks and pyspark : Offshore - Databricks, PySpark and Python project development work experience is a must - Expertise in Bigdata Eco systems like HDFS and Spark - Experience in GitHuB repository - Data Warehouse/Data Marts/Data Modelling/Analytics experience is a must - Able to convert the SQL stored...

  • Cloud Data Engineer

    hace 6 días


    Guadalajara, México Nortal A tiempo completo

    Overview: **Nortal **is looking for an experienced **Cloud Data Engineer** for our client -a professional services organization based in Vancouver, specializing in the convergence of business strategy and technological implementations. Client’s core expertise lies in Big Data, Cloud Technology, and Analytics, including Advanced Analytics in AI and machine...


  • Guadalajara, México Bhuvi IT Solutions A tiempo completo

    As Principal Data Engineer, you have a solid understanding of both the business and the technical aspects of data engineering in relation to digital media and advertisement. You will lead data engineering initiatives within established scope, while simultaneously planning for and managing unknown future requirements in a dynamic...

  • Data Engineer

    hace 6 días


    Guadalajara, México Zigatta LLC A tiempo completo

    **Data Scientist**: - Guadalajara, México / Remote - Full time - Position 22-00014 - Published 1 year ago We love using data and AI to help our clients build a better future. As a Data Scientist at Zigatta, you will help transform our clients’ data into tangible business and social value by analyzing information, communicating outcomes, and...

  • Desarrollador Big Data

    Encontrado en: Talent MX C2 - hace 2 semanas


    Guadalajara, México Dresden Partners A tiempo completo

    Descripción Dresden Partners expertos en tecnología mobile, aplicaciones web, servicios near-shore staffing, tech international y local tech sourcing; está en busca de: Desarrollador Big Data Requisitos: + años de experiencia Experiencia en JEE, Rest, SOPA, JSP Conocimientos en Python, Scala, Spark Experiencia con alguna sollucion en la nube...

  • Data Engineer

    hace 1 día


    Guadalajara, México Horizonte Empresarial A tiempo completo

    **Capital Empresarial Horizonte Empresa Mexicana especialista en Recursos Humanos y Tecnologías de la Información Solicita**: **Data Engineer** **Hibrido** **Perfil** **Escolaridad**: Ingeniería en Sistemas, Informática o afín. **Nível de inglés: inglés Conversacional INDISPENSABLE** **Experiência**: 3 años de experiência. Lugar a laborar:...


  • Guadalajara, México DISCO A tiempo completo

    **Your Impact**: ***: **What You'll Work On**: - Highly scalable and finely crafted data pipelines - Business Intelligence and Data Analytics capabilities to drive low-latency Key Performance Indicator generation; - Custom connectors to extract critical data from third party systems for ingestion into the Enterprise Data Warehouse; - Event bus and event...


  • Guadalajara, México Themesoft technologies A tiempo completo

    **Role: Senior Healthcare Data Engineer** **Location: Remote** Job description: - Overall 10+ in IT Experience. - Minimum of 8+ years of experience in Healthcare Domain - Minimum of 10+ years of experience in Data Engineering. - Required technical skills: Python, PySpark, SQL, AWS - Required Domain: - Extensive data analysis skills and Good communication...

  • Sr. DevSecOps Engineer

    Encontrado en: beBee S MX - hace 4 semanas


    Guadalajara, México NTT DATA Services A tiempo completo

    Req ID: 276471  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr. DevSecOps Engineer to join our team in Guadalajara, Jalisco (MX-JAL), Mexico (MX). Job...

  • Data Engineer

    hace 10 horas


    Guadalajara, México Urrly A tiempo completo

    **We're scouting for a Data Engineer!****: **Here's the deal**: - Dive into database designs, making them top-notch. - Whip up reports that spotlight insights from our data warehouse. - Tackle data loads, cleanup, and spreadsheet gymnastics. - Bridge data sources with simple integrations. **Skills you need**: - Solid chops in **PostgreSQL**. Bonus points...

  • Data Engineer

    hace 2 días


    Guadalajara, México amdocs A tiempo completo

    **Job ID**: 176086 **Required Travel** :Minimal **Managerial - No** **Location**: :reqLocation **Who are we?**: **In one sentence**: This role is ideal for an experienced data engineer who has a keen interest in working with large data sets to design and develop client facing platforms for Media & Advertising industry. **What will your job look like?**: -...