Sr. Big Data Engoneer

hace 3 semanas

Zapopan, México Intugo A tiempo completo

**Position Summary**:Our team is looking for a **Sr. Data Engineer** with a diverse background in data integration to join the Data Services team.Some data are small, some data are very large (1 trillion+ rows), some data is structured, some data is not.Our data comes in all kinds of sizes, shapes and formats.Traditional RDBMS like PostgreSQL, Oracle, SQL Server, MPPs like StarRocks, Vertica, Snowflake, Google BigQuery, and unstructured, key-value like MongoDB, Elasticsearch, to name a few.We are looking for individuals who can design and solve any data problems using different types of databases and technologies supported within our team.We use MPP databases to analyze billions of rows in seconds.We use Spark and Iceberg, batch or streaming to process whatever the data needs are.We also use Trino to connect all different types of data without moving them around.Besides a competitive compensation package, you’ll be working with a great group of technologists interested in finding the right database to use, the right technology for the job in a culture that encourages innovation.If you’re ready to step up and take on some new technical challenges at a well-respected company, this is a unique opportunity for you.**Responsibilities**:- Implement ETL/ELT processes using various tools and programming languages (Scala, Python) against our MPP databases StarRocks, Vertica and Snowflake- As Data Engineers, not only are we developers, but we also maintain and administrate our MPP ecosystem. We will tune and maximize our hardware potential from OS, network and storage levels- Work with the Hadoop team and optimize Hive and Iceberg tables- Running POC between different table formats- Contribute to the existing Data Lake and Data Warehouse imitative using Hive, Spark, Iceberg, Presto/Trino- Analyze business requirements, design and implement required data models**Qualifications: (must have)**- BA/BS in Computer Science or in related field- 2+ years of experience with MPP databases such as StarRocks, Vertica, Snowflake- 5+ years of experience with RDBMS databases such as Oracle, MSSQL or PostgreSQL- 2+ years of experience managing or developing in the Hadoop ecosystem- Programming background with Scala, Python, Java or C/C++- Experience with Elasticsearch or ELK stack- Working knowledge of streaming technologies such as Kafka- Strong in any of the Linux distributions, RHEL,CentOS or Fedora- Deep knowledge shell scripting, scheduling, and monitoring processes on Linux- Experience working in both OLAP and OLTP environments- Experience working on-prem, not just cloud environments**Desired: (nice to have)**- Working knowledge of data unification and setup using Presto/Trino- Working knowledge of orchestration tools such Oozie and Airflow- Experience with Spark. PySpark, SparkSQL, Spark Streaming, etc- Experience using ETL tools such as Informatica, Talend and/or Pentaho- Understanding of Healthcare data- Data Analyst or Business Intelligence would be a plusTipo de puesto: Tiempo completo, Por tiempo indeterminadoSalario: $55,000.00 - $60,000.00 al mesHorario:- Lunes a viernesExperiência:- Oracle: 5 años (Obligatorio)- MSSQL: 5 años (Obligatorio)- PostgreSQL: 5 años (Obligatorio)- Fedora: 5 años (Obligatorio)- Python: 5 años (Obligatorio)- CentOS: 5 años (Obligatorio)Idioma:- Inglés (Obligatorio)Lugar de trabajo: remoto híbrido en 45050, Zapopan, Jal.

  • Sr. Big Data Engoneer

    hace 2 semanas

    Zapopan, México Intugo A tiempo completo

    **Position Summary**:Our team is looking for a **Sr.Data Engineer** with a diverse background in data integration to join the Data Services team.Some data are small, some data are very large (1 trillion+ rows), some data is structured, some data is not.Our data comes in all kinds of sizes, shapes and formats.Traditional RDBMS like PostgreSQL, Oracle, SQL...

  • Big Data

    hace 2 semanas

    Zapopan, México Oracle A tiempo completo

    Career Level - IC4**Responsibilities**:Data Engineering:1. Design, develop, and maintain scalable data pipelines and ETL processes to collect, process, and store large volumes of data from diverse sources.2. Implement and optimize distributed computing frameworks such as Apache Hadoop, Apache Spark, or Apache Flink to handle big data processing tasks...

  • Big Data

    hace 2 días

    Zapopan, México Oracle A tiempo completo

    Career Level - IC4**Responsibilities**:Data Engineering:1. Design, develop, and maintain scalable data pipelines and ETL processes to collect, process, and store large volumes of data from diverse sources.2. Implement and optimize distributed computing frameworks such as Apache Hadoop, Apache Spark, or Apache Flink to handle big data processing tasks...

  • Senior Software Engineer for Goldengate Big Data

    hace 6 días

    Zapopan, México Oracle A tiempo completo

    **Our Team : Oracle GoldenGate for BigData** Oracle GoldenGate (OGG) is a comprehensive software package for real-time data integration and replication in heterogeneous IT environments. Oracle GoldenGate for Big Data streams transactional data into big data systems in real time, raising the quality and timeliness of business insights. For more information,...

  • Sr. Platform Insights data Engineer

    hace 4 semanas

    Zapopan, México Axon Impact A tiempo completo

    **Sr. Platform Insights Data Engineer****Ubicación**: Guadalajara, Jalisco (oficinas por Andares)**Modalidad**: Híbrida (especificaciones se abordan en entrevista)**Tipo de contrato**: Directo con la empresa**Compensación**: Sueldo base competitivo + prestaciones superiores de ley**Acerca del rol**Estamos buscando un/a **Sr. Data Engineer** apasionado/a y...

  • Sr Data Engineer

    hace 11 horas

    Zapopan, México Ryscode A tiempo completo

    DescriptionLooking for a Sr. Data Engineer located in GUADALAJARA, México or willing to relocate for a full-time on-site work scheme.Required TechnologiesPython, AWS, Kafka, snowflakeGood English communicationGDL Position: ON-SITETipo de puesto: Tiempo completoSueldo: $60,000.00 - $68,400.00 al mesBeneficios:- Caja de ahorro- Seguro de gastos médicos-...

  • Big Data Senior

    hace 2 semanas

    Zapopan, México BairesDev A tiempo completo

    En BairesDev® llevamos 15 años liderando proyectos de tecnología para clientes como Google, Rolls-Royce y las startups más innovadoras de Silicon Valley. Actualmente, contamos con un equipo de 4000 profesionales conformado por el top 1% de la industria trabajando de forma remota desde más de 50 países.Al postularte a esta vacante, estarás dando el...

  • Big Data Engineer

    hace 3 semanas

    Zapopan, México Intugo A tiempo completo

    **Position Summary**:Our team is looking for a **Data Engineer** with a diverse background in data integration to join the Data Services team.Some data are small, some data are very large (1 trillion+ rows), some data is structured, some data is not. Our data comes in all kinds of sizes, shapes and formats.Traditional RDBMS like PostgreSQL, Oracle, SQL...

  • Big Data Engineer

    hace 2 semanas

    Zapopan, México Intugo A tiempo completo

    **Position Summary**:Our team is looking for a **Data Engineer** with a diverse background in data integration to join the Data Services team.Some data are small, some data are very large (1 trillion+ rows), some data is structured, some data is not.Our data comes in all kinds of sizes, shapes and formats.Traditional RDBMS like PostgreSQL, Oracle, SQL...

  • Sap Pp Sr

    hace 2 semanas

    Zapopan, México Ntt Data A tiempo completo

    We are currently seeking a SAP PP Sr to join our team in Zapopan, Jalisco (MX-JAL), Mexico (MX).**Role**: SAP PP Consultant- At NTT DATA, we know that with the right people on board, anything is possible.The quality, integrity, and commitment of our employees are key factors in our company's growth, market presence and our ability to help our clients stay a...