Data Engineer
hace 2 semanas
Job Requirements We are looking to hire a data analyst to join our data team. Who will take responsibility for managing master data set, developing reports, and troubleshooting data issues. To do well in this role is necessary a very fine eye for detail, experience as a data analyst, and a deep understanding of the popular data analysis tools and databases. **Responsibilities**: - You will be using Data wrangling techniques converting one "raw" form into another including data visualization, data aggregation, training a statistical model etc. - Work with various relational and non-relational data sources with the target being Azure based SQL Data Warehouse & Cosmos DB repositories - Clean, unify and organize messy and complex data sets for easy access and analysis - Create different levels of abstractions of data depending on analytics needs - Hands on data preparation activities using the Azure technology stack especially Azure Databricks is strongly preferred - Implement discovery solutions for high speed data ingestion - Work closely with the Data Science team to perform complex analytics and data preparation tasks - Work with the Sr. Data Engineers on the team to develop APIs - Experience with Complex Data Parsing (Big Data Parser) and Natural Language Processing (NLP) Transforms on Azure a plus - Design solutions for managing highly complex business rules within the Azure ecosystem **Minimum Requirements**: - Mid to advanced level knowledge of Python and Pyspark is an absolute must. - Knowledge of Azure, Hadooop 2.0 ecosystems, HDFS, MapReduce, Hive, Pig, sqoop, Mahout, Spark etc. a must - Experience with Web Scraping frameworks (Scrapy or Beautiful Soup or similar) - Significant programming experience (with above technologies as well as Java, R and Python on Linux) a must - Extensive experience working with Data APIs (Working with RESTful endpoints and/or SOAP) - Excellent working knowledge of relational databases, MySQL, Oracle etc. - Experience with Complex Data Parsing (Big Data Parser) a must. Should have worked on XML, JSON and other custom Complex Data Parsing formats - Knowledge of High-Speed Data Ingestion, Real-Time Data Collection and Streaming is a plus - Bachelor’s in computer science or related educational background - 3-5 years of solid experience in Big Data technologies a must Work Experience **Minimum Requirements**: - Mid to advanced level knowledge of Python and Pyspark is an absolute must. - Knowledge of Azure, Hadooop 2.0 ecosystems, HDFS, MapReduce, Hive, Pig, sqoop, Mahout, Spark etc. a must - Experience with Web Scraping frameworks (Scrapy or Beautiful Soup or similar) - Significant programming experience (with above technologies as well as Java, R and Python on Linux) a must - Extensive experience working with Data APIs (Working with RESTful endpoints and/or SOAP) - Excellent working knowledge of relational databases, MySQL, Oracle etc. - Experience with Complex Data Parsing (Big Data Parser) a must. Should have worked on XML, JSON and other custom Complex Data Parsing formats - Knowledge of High-Speed Data Ingestion, Real-Time Data Collection and Streaming is a plus - Bachelor’s in computer science or related educational background - 3-5 years of solid experience in Big Data technologies a must
-
Data Engineer
hace 3 semanas
Monterrey, México Dataart A tiempo completoClient: Our client is a leading airline in Latin America, committed to delivering frictionless passenger experiences and enabling data-driven decisions across all airport operations.- Position overview: We are looking for our next Data Engineer to support the development, implementation, and maintenance of data pipelines and solutions that enable analytics...
-
Data Engineer Senior Remote
hace 3 semanas
Monterrey, México Training Talent A tiempo completo**Vacante para la empresa Training Talent en Monterrey, Nuevo León**:Somos una consultora de servicios de desarrollo de software con integraciones en nube, soluciones IoT y Machine Learning con presencia en Latam y EE. UU. socios de Microsoft, Amazon, buscamos en México Data Engineer o ingeniero de datos Sr bilingüe en esquema remoto:Equipo técnico muy...
-
Data Engineer Senior Remote
hace 5 horas
Monterrey, México Training Talent A tiempo completo**Vacante para la empresa Training Talent en Monterrey, Nuevo León**: Somos una consultora de servicios de desarrollo de software con integraciones en nube, soluciones IoT y Machine Learning con presencia en Latam y EE. UU. socios de Microsoft, Amazon, buscamos en México Data Engineer o ingeniero de datos Sr bilingüe en esquema remoto: Equipo técnico muy...
-
Data Engineer Senior Remote
hace 5 horas
Monterrey, México Training Talent A tiempo completo**Vacante para la empresa Training Talent en Monterrey, Nuevo León**:Somos una consultora de servicios de desarrollo de software con integraciones en nube, soluciones IoT y Machine Learning con presencia en Latam y EE. UU. socios de Microsoft, Amazon, buscamos en México Data Engineer o ingeniero de datos Sr bilingüe en esquema remoto:Equipo técnico muy...
-
Data Engineer
hace 3 semanas
Monterrey, México Axen A tiempo completoDescripciónEn AXEN IT Consulting estamos creciendo exponencialmente con clientes con grandes proyecciones de crecimiento, Contamos con más de 25 años de experiência en el mercado de servicios de tecnologías de la información, Enfocados en nuestro crecimiento y al mismo tiempo ofreciendo planes de mejora a nuestro talento, Actualmente estamos buscando...
-
Data Engineer
hace 6 días
Monterrey, México Rivka Development A tiempo completo**Data Engineer (Data Migration)**- **Please submit your resume in **English** and read the **full description** before applying!****About Us**:**What will make you the best fit**:- Proven experience as a Data Engineer with expertise in migration processes- Excellent English communication skills (Advanced Level)- Proficiency in SQL and/or Python for data...
-
Data Engineer
hace 1 semana
Monterrey, México British American Tobacco A tiempo completo**BAT MEXICO IS LOOKING FOR A DATA ENGINEER!** **JOB TITLE: DATA ENGINEER** **FUNCTION: Information Technology - Digital Business Solutions (DBS)** **CITY & COUNTRY: MONTERREY, MEXICO** **ROLE SUMMARY!** **Reports to**: Director, DBS **ACCOUNTABILITIES** - We need to implement data ingestion pipelines from multiple data sources using Databricks and...
-
Data Engineer
hace 1 semana
Monterrey, México ALTUMWARE A tiempo completo_**DATA ENGINEER**_- **Hibrido - Monterrey, Nuevo León**_- Tu eres el talento que buscamos:_- **+3 años de experiência en**:_- _Azure Data Factory_- _Databricks_- Phyton- SQL- Ofrecemos:_- _Esquema 10_0% nómina- Prestaciones de ley- Vales de despensa- Seguro de gastos medicos mayores- Tarjeta de regalo el día de tu cumpleaños- Descuentos en...
-
Data Engineer
hace 1 semana
Monterrey, México SITI Group A tiempo completo**Work available: Data Engineer** **Job qualifications**: - 2-3 years of experience in Python, SQL and ETL - intermediate - 6+ months to a year the DBT (Data Build Tool) or similar (Luigi) as ETL for data migration. - 2 years of experience Apache Airflow or Graphic Data Flow Management: like jenkins, kafka, spark or data pipelines - DC/IC **Skills**: -...
-
Data Scientist Engineer
hace 2 semanas
Monterrey, México Divelement Web Services A tiempo completoJob Summary: We are seeking a talented and experienced Data Science Engineer to join our data team. As a Data Science Engineer, you will be responsible for leveraging your expertise in data analysis, machine learning, and software engineering to develop innovative data-driven solutions. You will collaborate with cross-functional teams to extract insights...
