Big Data Engineer
hace 3 semanas
**Position Summary**:
Our team is looking for a **Data Engineer** with a diverse background in data integration to join the Data Services team.
Some data are small, some data are very large (1 trillion+ rows), some data is structured, some data is not. Our data comes in all kinds of sizes, shapes and formats.
Traditional RDBMS like PostgreSQL, Oracle, SQL Server, MPPs like StarRocks, Vertica, Snowflake, Google BigQuery, and unstructured, key-value like MongoDB, Elasticsearch, to name a few.
We are looking for individuals who can design and solve any data problems using different types of databases and technologies supported within our team.
We use MPP databases to analyze billions of rows in seconds.
We use Spark and Iceberg, batch or streaming to process whatever the data needs are.
We also use Trino to connect all different types of data without moving them around.
Besides a competitive compensation package, you’ll be working with a great group of technologists interested in finding the right database to use, the right technology for the job in a culture that encourages innovation.
If you’re ready to step up and take on some new technical challenges at a well-respected company, this is a unique opportunity for you.
**Responsibilities**:
- Implement ETL/ELT processes using various tools and programming languages (Scala, Python) against our MPP databases StarRocks, Vertica and Snowflake
- Work with the Hadoop team and optimize Hive and Iceberg tables
- Contribute to the existing Data Lake and Data Warehouse imitative using Hive, Spark, Iceberg, Presto/Trino
- Analyze business requirements, design and implement required data models
**Qualifications: (must have)**
- BA/BS in Computer Science or in related field
- 1+ years of experience with MPP databases such as StarRocks, Vertica, Snowflake
- 3+ years of experience with RDBMS databases such as Oracle, MSSQL or PostgreSQL
- Programming background with Scala, Python, Java or C/C++
- Strong in any of the Linux distributions, RHEL,CentOS or Fedora
- Experience working in both OLAP and OLTP environments
- Experience working on-prem, not just cloud environments
**Desired: (nice to have)**
- Experience with Elasticsearch or ELK stack
- Working knowledge of streaming technologies such as Kafka
- Working knowledge of orchestration tools such Oozie and Airflow
- Experience with Spark. PySpark, SparkSQL, Spark Streaming, etc
- Experience using ETL tools such as Informatica, Talend and/or Pentaho
- Understanding of Healthcare data
- Data Analyst or Business Intelligence would be a plus
Tipo de puesto: Tiempo completo, Por tiempo indeterminado
Salario: $30,000.00 - $40,000.00 al mes
Horario:
- Lunes a viernes
Experiência:
- Snowflake: 1 año (Obligatorio)
- Vertica: 1 año (Obligatorio)
- Oracle DB: 3 años (Obligatorio)
- PostgreSQL: 3 años (Obligatorio)
- MSSQL: 3 años (Obligatorio)
- Python: 3 años (Obligatorio)
- Linux: 3 años (Obligatorio)
Idioma:
- Inglés (Obligatorio)
Lugar de trabajo: remoto híbrido en 45050, Zapopan, Jal.
-
Senior Software Engineer for Goldengate Big Data
hace 4 semanas
Zapopan, México Oracle A tiempo completo**Our Team : Oracle GoldenGate for BigData** Oracle GoldenGate (OGG) is a comprehensive software package for real-time data integration and replication in heterogeneous IT environments. Oracle GoldenGate for Big Data streams transactional data into big data systems in real time, raising the quality and timeliness of business insights. For more information,...
-
Big Data
hace 1 semana
Zapopan, México Oracle A tiempo completoAnalyze, design develop, troubleshoot and debug software programs for commercial or end user applications. Writes code, completes programming and performs testing and debugging of applications. We are seeking a versatile and experienced professional to fill the combined role of Data Engineer with analytics experience. This position requires a candidate who...
-
Data Engineer, Ds2-science
hace 2 días
Zapopan, México Servicios Comerciales Amazon Mexico S. de R.L. de C.V. - D44 A tiempo completo5+ years of experience with data warehouse technical architectures, ETL/ ELT, reporting/analytic tools and, scripting. - 5+ years of demonstrated quantitative and qualitative data experience with data modeling, ETL development - Knowledge of data modeling and experience SQL with Redshift, Oracle, MySQL, and Columnar Databases - Experience managing competing...
-
Data Engineer, Ds2-science
hace 2 días
Zapopan, México Servicios Comerciales Amazon Mexico S. de R.L. de C.V. - D44 A tiempo completo5+ years of experience with data warehouse technical architectures, ETL/ ELT, reporting/analytic tools and, scripting. - 5+ years of demonstrated quantitative and qualitative data experience with data modeling, ETL development - Knowledge of data modeling and experience SQL with Redshift, Oracle, MySQL, and Columnar Databases - Experience managing competing...
-
Data Engineer, Science
hace 4 semanas
Zapopan, México Servicios Comerciales Amazon Mexico S. de R.L. de C.V. - D44 A tiempo completo3+ years of data engineering experience - Experience with data modeling, warehousing and building ETL pipelines The Amazon Devices team designs and engineers high-profile consumer electronics, including the best-selling Kindle family of products. We have also produced groundbreaking devices like Fire tablets, Fire TV, Amazon Dash, and Amazon Echo. What...
-
Fresher / Data Engineer & Analytics Developer
hace 6 días
Zapopan, México Oracle A tiempo completoAnalyze, design develop, troubleshoot and debug software programs for commercial or end user applications. Writes code, completes programming and performs testing and debugging of applications. We are seeking a professional to fill the combined role of Data Engineer and Analytics. This position requires a candidate who is willing to navigate between...
-
Data Engineer, DS2-Science
hace 3 días
Zapopan, Jalisco, México Amazon A tiempo completoThe Amazon Devices team designs and engineers high-profile consumer electronics, including the best-selling Kindle family of products. We have also produced groundbreaking devices like Fire tablets, Fire TV, Amazon Dash, and Amazon Echo.What will you help us create?The Team: How often have you had an opportunity to be a founding member of a team that is...
-
Data Engineer, DS2-Science
hace 3 días
Zapopan, Jalisco, México Amazon A tiempo completoThe Amazon Devices team designs and engineers high-profile consumer electronics, including the best-selling Kindle family of products. We have also produced groundbreaking devices like Fire tablets, Fire TV, Amazon Dash, and Amazon Echo.What will you help us create?The Team: How often have you had an opportunity to be a founding member of a team that is...
-
Data Engineer, DS2-Science
hace 2 días
Zapopan, México Amazon A tiempo completoDescriptionThe Amazon Devices team designs and engineers high-profile consumer electronics, including the best-selling Kindle family of products. We have also produced groundbreaking devices like Fire tablets, Fire TV, Amazon Dash, and Amazon Echo.What will you help us create?The Team: How often have you had an opportunity to be a founding member of a team...
-
Data Engineer, DS2-Science
hace 2 días
Zapopan, México Amazon A tiempo completoDescriptionThe Amazon Devices team designs and engineers high-profile consumer electronics, including the best-selling Kindle family of products. We have also produced groundbreaking devices like Fire tablets, Fire TV, Amazon Dash, and Amazon Echo.What will you help us create?The Team: How often have you had an opportunity to be a founding member of a team...
-
Data Engineer, Science
hace 4 semanas
Zapopan, Jal., México Amazon A tiempo completoData Engineer, Science & Data Technology team The Amazon Devices team designs and engineers high-profile consumer electronics, including the best-selling Kindle family of products. We have also produced groundbreaking devices like Fire tablets, Fire TV, Amazon Dash, and Amazon Echo. What will you help us create? The Team: How often have you had an...
-
Data Engineer, Science
hace 4 semanas
Zapopan, México Servicios Comerciales Amazon Mexico S. de R.L. de C.V. - D44 A tiempo completoThe Amazon Devices team designs and engineers high-profile consumer electronics, including the best-selling Kindle family of products. We have also produced groundbreaking devices like Fire tablets, Fire TV, Amazon Dash, and Amazon Echo. What will you help us create?The Team: How often have you had an opportunity to be a founding member of a team that is...
-
Data Engineer Mid
hace 4 semanas
Zapopan, México Derevo A tiempo completo¡¡We are looking for your talent!! ✋ **Data Engineer Mid** ** **The desired profile should have at least 3 years hands-on experience in designing, establishing, and maintaining data management and storing systems. Skilled in collecting, processing, cleaning, and deploying large datasets, understanding ER data models, and integrating with multiple...
-
Data Engineer Senior
hace 4 semanas
Zapopan, México Derevo A tiempo completo¡¡We are looking for your talent!! ✋ *** Data Engineer Senior** **** **El perfil deseado debe tener al menos 5 años de experiência práctica en el diseño, establecimiento y mantenimiento de sistemas de gestión y almacenamiento de datos. Hábil en la recopilación, procesamiento, limpieza y despliegue de grandes conjuntos de datos, la...
-
Fresher / Data Engineer & Analytics Developer
hace 5 días
Zapopan, México Oracle A tiempo completoWe are looking for Big Data developers and Analytics skills. Preferred experience in Cloud development, Spark, SQL, Python, Data Bases and scripting. Career Level - IC2 **Responsibilities**: Data Engineering: 1. Design, develop, and maintain scalable data pipelines and ETL processes to collect, process, and store large volumes of data from diverse...
-
Data Engineer, DS2-Science
hace 1 día
Zapopan, México Servicios Comerciales Amazon Mexico S. de R.L. de C.V. - D44 A tiempo completoThe Amazon Devices team designs and engineers high-profile consumer electronics, including the best-selling Kindle family of products. We have also produced groundbreaking devices like Fire tablets, Fire TV, Amazon Dash, and Amazon Echo. What will you help us create?The Team: How often have you had an opportunity to be a founding member of a team that is...
-
Business Intelligence Engineer, Ds2-science
hace 1 semana
Zapopan, México Servicios Comerciales Amazon Mexico S. de R.L. de C.V. - D44 A tiempo completoExperience using SQL to pull data from a database or data warehouse and scripting experience (Python) to process data for modeling - Experience in data mining, ETL, etc. and using databases in a business environment with large-scale, complex datasets - Experience with data visualization using Tableau, Quicksight, or similar tools - Bachelor's degree in...
-
Data Engineer
hace 1 semana
Zapopan, México STAND 8 A tiempo completoSTAND 8 is a global leader providing end-to-end IT Solutions. We solve business problems through PEOPLE, PROCESS, and TECHNOLOGY and are looking for individuals to help us scale software projects designed to change the world! **Responsibilities** - Augment and maintain the existing repositories and data structures within AWS (used to process and store large...
-
Business Intelligence Engineer, DS2-Science
hace 7 días
Zapopan, Jal., México Amazon A tiempo completoBusiness Intelligence Engineer, DS2-Science & Data Technology team Are you a data enthusiast? Does the world’s most complex logistic systems inspire your curiosity? Is your passion to navigate through hundreds of systems, processes, and data sources to solve the puzzles and identify the next big opportunity? Are you a creative big thinker who is...
-
Business Intelligence Engineer, DS2-Science
hace 7 días
Zapopan, México Servicios Comerciales Amazon Mexico S. de R.L. de C.V. - D44 A tiempo completoAre you a data enthusiast? Does the world’s most complex logistic systems inspire your curiosity? Is your passion to navigate through hundreds of systems, processes, and data sources to solve the puzzles and identify the next big opportunity? Are you a creative big thinker who is passionate about using data and optimization tools to direct decision making...