Senior Big Data Development Engineer

hace 3 semanas


Guadalajara, México Travelport A tiempo completo

**Duties**:

- Support the design and building of innovative framework and tools to support all phases of delivering Data Value
- Support the design and building data pipeline architectures
- Aid in systems optimization: optimize streaming products, optimize data analytic platforms, optimize data processing workflows: all are enhanced for robustness, scalability, and performance
- Maintain, enhance, and perform research in support of the Big Data environment
- Develop High Performance Computing Solutions to process TBs of data at scale

**Main Accountabilities**:

- Assist in the design, develop, and test big data solutions
- Install and integrate various technologies in the big data echo system
- Troubleshoot issues in big data framework
- Aid in the implementation of analytical models
- Deliver solutions while using an Agile Development model with iterative deliverables
- Create quality deliverables to communicate technical solutions to appropriate audiences
- Understand issues, problem solving and design/architect solutions
- Build and collaborate with business and technical teams to deliver software
- Learn continuously, leveraging training resources and self-directed training, sharing knowledge and skills with others
- Provide mentoring and leadership to more junior resources
- Passion for technology and willingness to learn is required
- Have ability to work in a fast paced and dynamic work environment and be able to produce efficient and robust solution
- High energy, confidence, and agility to drive a team
- Candid and direct communication
- A creative thinker who can bring in new ideas and innovations to the company

**Required Qualifications**:

- 2+ years of Java development experience in large scale enterprise development for Undergraduates
- 1+ years of Java development experience in large scale enterprise development for Masters/PHD
- Produce high-quality, maintainable software
- Knowledgeable of developing in the Cloud
- Knowledge of multiple threading development and performance tuning
- Knowledge of implementing efficient logic using collections and data structures
- Knowledge of some of the following Big Data Technologies (e.g., Elastic Search, Kafka, Spark, HDFS and Hive)
- Knowledge in Design Patterns, OOP/OOD, Software Architecture
- Bachelor’s in computer science, engineering, information technology, or related degree and/or equivalent work experience
- Good communication skills with both Technical and Business audience

**Preferred Qualifications**:

- Knowledgeable in Scala or Python programming
- Knowledgeable in the field of big data on a TB or PB Scale environment (e.g. Hadoop, MongoDB, Couch Base, Cassandra)
- Knowledgeable of Spark Based Technologies (e.g. Spark Data frames, Spark Streaming and Spark SQL)
- Experience in the following: C, C++, Perl, PHP, Scala or Python
- Experience in frontend development (e.g., JavaScript, jQuery, AngularJS, ReactJS)
- Web service protocols such as REST



  • Guadalajara, México Zoolatech A tiempo completo

    **Project Description** We are looking for a passionate Senior Data Engineer who would like to work with a top-notch technology stack in a friendly and cozy atmosphere for one of the greatest retail companies in the USA. Why is Nordstrom one of the greatest? Founded in 1901, it prospered through two world wars, the Spanish flu, Great Depression, the 2020...

  • Senior Data Engineer

    hace 6 días


    Guadalajara, México Virtusa A tiempo completo

    Senior Data Engineer - 120019 Description Responsibilities 10+ Years in engineering solutions using PySpark and Python String SQL AND framework development experience. Experienced in working in a Cloud environment Able to create cohesive technology solutions using microservices our system and implementing new features Collaborating...

  • Senior Engineer

    hace 18 horas


    Guadalajara, Jal., México PSC Industries A tiempo completo

    i Ad i Ad **Senior SDET Engineer (ETL Testing and Healthcare Industry experience)****Location : Guadalajara, Mexico****Responsibilities**- **A minimum of 8+ years of Exp is required**:- **Looking for an SDET engineer with Experience in ETL Testing.**:- Strong Python/PySpark/Pandas experience.- Experience in developing and implementing test strategies...


  • Guadalajara, México AstraZeneca A tiempo completo

    **Senior Data Security Engineer** **About the AstraZeneca** AstraZeneca is a global, innovation-driven biopharmaceutical business that focuses on the discovery, development, and commercialization of prescription medicines for some of the world's most serious diseases. But we're more than one of the world's leading pharmaceutical companies. At AstraZeneca,...


  • Guadalajara, México AstraZeneca A tiempo completo

    **JOB DESCRIPTION**: AstraZeneca is a global, innovation-driven biopharmaceutical business that focuses on the discovery, development and commercialization of prescription medicines for some of the world's most serious diseases. R&D IT is AZ’s global IT capability function supporting key science related business areas operating out of sites across the US,...

  • Big Data Leader

    hace 1 mes


    Guadalajara, México U hi A tiempo completo

    **Big Data Leader - Trabajo Remoto** - Databricks, PySpark and Python project development work experience is a must. - SQL Knowledge, with have databricks and pyspark : Offshore - Expertise in Bigdata Eco systems like HDFS and Spark - Experience in GitHuB repository - Data Warehouse/Data Marts/Data Modelling/Analytics experience is a must - Able to convert...

  • Data Engineer

    hace 4 semanas


    Guadalajara, México Aspiria A tiempo completo

    **Aspiria** es una Institución Financiera Digital que ayuda a incrementar el acceso a capital a los negocios de México a través de su plataforma en línea. Nosotros buscamos como hacer llegar el capital de manera sencilla y rápida a los negocios mexicanos, los cuales son el motor de la economía. Aspiria te invita a formar parte de su equipo de trabajo...

  • Big Data Engineer

    hace 1 mes


    Guadalajara, México Intugo Call Center A tiempo completo

    Intugo in Partnership with a leading company in the technology industry are looking for a **Data Engineer** with a diverse background in data integration to join the Data Services team. Some data are small, some data are very large (1 trillion+ rows), some data are structured, and some data are not. Our data comes in all kinds of sizes, shapes and formats....


  • Guadalajara, México CODIGOMX A tiempo completo

    **Senior Data Engineer - Guadalajara (Hybrid)** **Years of Experience: 5+ years** **Required Technologies: Amazon Web Services (AWS), PYSPARK, sql, Power BI, Python, CI/CD** **Required Languages: English - Advanced** **Industries: Software development** **Notes** **Description** **Essential skills for the role** - Experience in AWS Services (like EMR,...

  • Data Engineer

    hace 1 mes


    Guadalajara, México Aspiria A tiempo completo

    **Aspiria** es una empresa de servicios financieros digitales, que ayuda a incrementar el acceso a capital a los negocios de México a través de su plataforma en línea. Nosotros buscamos como hacer llegar el capital de manera sencilla y rápida a los negocios mexicanos, los cuales son el motor de la economía. Aspiria te invita a formar parte de su...

  • Data Engineer

    hace 4 semanas


    Guadalajara, México Encora A tiempo completo

    **Responsibilities** - Design, build, and maintain the data infrastructure needed to support our AI solutions - Develop and maintain data pipelines to collect, process, and store data from various sources - Optimize data storage and processing for performance and scalability - Work closely with machine learning engineers and data scientists to ensure that...


  • Guadalajara, Jal., México Amazon A tiempo completo

    Senior BI Engineer, DS2-Science & Data Technology team The Amazon Devices team designs and engineers high-profile consumer electronics, including the best-selling Kindle family of products. We have also produced groundbreaking devices like Fire tablets, Fire TV, Amazon Dash, and Amazon Echo. What will you help us create? The Team: How often have you had an...

  • Azure Data Engineer

    hace 1 mes


    Guadalajara, México BONbLOC A tiempo completo

    Cleans, prepares, and optimizes data for further analysis and modelling. Designs, develops, optimizes, and maintains data architecture and pipelines that adhere to Data Pipeline (ie ELT) principles and business goals. **Roles and Responsibilities**: - Designs, develops, optimizes, and maintains data architecture and pipelines that adhere to ELT principles...

  • Lead Data Engineer

    hace 1 mes


    Guadalajara, México CHUBB A tiempo completo

    With you Chubb is better! Chubb is the world’s largest publicly traded P&C insurance company and a leading commercial lines insurer in the United States. With operations in 54 countries and territories, Chubb provides commercial and personal property and casualty insurance, personal accident and supplemental health insurance, reinsurance, and life...


  • Guadalajara, México Reclutamiento en TI A tiempo completo

    **Vacante para la empresa Reclutamiento en TI en Guadalajara, Jalisco**: Position Description The Senior Cloud Operations Engineer will support Amazon Web Services (AWS) and Linux/Windows environments. The Senior Cloud Operations Engineer needs to be familiar with AWS, Apache, Tomcat, PostgreSQL, Oracle, Ansible, Jenkins, Jira, Confluence and SaaS...

  • Senior Data Analyst

    hace 7 horas


    Guadalajara, México Daxx A tiempo completo

    We're seeking world-class talent with a passion for data and analytics, a disciplined focus on business value, and ability to influence change! We are looking for a  Senior Data Analyst who is passionate about data reporting, data transformation, and process excellence. The ideal candidate is skilled in information systems, data structures, and problem...


  • Guadalajara, México Servicios Comerciales Amazon Mexico S. de R.L. de C.V. - D44 A tiempo completo

    The Amazon Devices team designs and engineers high-profile consumer electronics, including the best-selling Kindle family of products. We have also produced groundbreaking devices like Fire tablets, Fire TV, Amazon Dash, and Amazon Echo. What will you help us create?The Team: How often have you had an opportunity to be a founding member of a team that is...


  • Guadalajara, México Servicios Comerciales Amazon Mexico S. de R.L. de C.V. - D44 A tiempo completo

    3+ years of data engineering experience - Experience with data modeling, warehousing and building ETL pipelines The Amazon Devices team designs and engineers high-profile consumer electronics, including the best-selling Kindle family of products. We have also produced groundbreaking devices like Fire tablets, Fire TV, Amazon Dash, and Amazon Echo. What...


  • Guadalajara, México Brightcove A tiempo completo

    **Position Overview** Brightcove is looking to hire a senior software engineer in test. The Data Services team at Brightcove designs, develops and operates big data collection and processing systems that power the reporting and business intelligence tools for our customers. We do this on a massive scale, capturing billions of events each day from our video...


  • Guadalajara, Jalisco, México Hitachi Careers A tiempo completo

    Description:Imprivata is currently looking for a talented Senior Software Engineer, Distributed Systems (Cloud) to join the team.Requirements:Required Qualifications:BS/MS degree in Computer Science or related field, and 5 to 7 years of relevant work experience.Ability to learn and adapt to new, complex development environments with deep dive analytical...