Big Data Operations Engineer

hace 4 días

Guadalajara, Jalisco, México Tech Mahindra A tiempo completo
About Us

At Tech Mahindra, we are a global leader in digital transformation, enabling businesses to succeed in a rapidly changing world. Our culture is built on the principles of innovation, collaboration, and customer-centricity.

Job Summary

We are seeking a highly skilled Data Engineer - Hadoop Clusters to join our team. As a Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data processing systems using Hadoop and related technologies.

Key Responsibilities
  • Design and implement Hadoop clusters with optimal configurations
  • Drive automation of Hadoop deployments, cluster expansion, and maintenance operations
  • Manage Hadoop cluster, monitoring alerts, and notifications
  • Job scheduling, monitoring, debugging, and troubleshooting
  • Monitoring and management of the cluster in all respects, notably availability, performance, and security
  • Data transfer between Hadoop and other data stores (including relational databases)
  • Set up High Availability/Disaster Recovery environment
  • Debug/Troubleshoot environment failures/downtime
  • Performance tuning of Hadoop clusters and Hadoop Map Reduce routines
Requirements
  • Experience with Kafka, SPARK, etc.
  • Experience working with AWS big data technologies (EMR, Redshift, S3, Glue, Kinesis, DynamoDB, and Lambda)
  • Good knowledge on creation of Volumes, Security group rules, Key pairs, Floating IPs, Images, and Snapshots and Deploying Instances on AWS
  • Experience configuring and/or integrating with monitoring and logging solutions such as syslog, ELK (Elastic, Logstash, and Kibana)
  • UNIX/Linux systems administration skills, including configuration, troubleshooting, and automation
  • Knowledge of Airflow, NiFi, Streamsets, etc.
  • Knowledge of container virtualization
What We Offer
  • Experience working with a remote, global team
  • Opportunity to learn about technologies
  • Take courses and certifications
  • Collaborate with the entire engineering organization to realize our RBAC vision
  • Play with the latest & greatest technologies on the test automation field
  • You'll enhance your automation testing expertise
  • Become part of a highly tech-savvy startup that's growing rapidly
  • There is a wide range of technologies, from programming languages and frameworks to other tools this role will be exposed to
About the Team

Our team is responsible for making our RBAC vision a reality across the stack. We develop and maintain critical systems related to Authentication and Authorization.

What We Look For
  • Passion for what you do and develop
  • Curious and persistent to find the right solutions to resolve complex problems
  • Able to communicate and express ideas properly
Why You'll Love This Job
  • Experience working with a remote, global team
  • Opportunity to learn about technologies
  • Take courses and certifications
  • Collaborate with the entire engineering organization to realize our RBAC vision
  • Play with the latest & greatest technologies on the test automation field
  • You'll enhance your automation testing expertise
  • Become part of a highly tech-savvy startup that's growing rapidly
  • There is a wide range of technologies, from programming languages and frameworks to other tools this role will be exposed to

  • Big Data Engineer

    hace 4 días

    Guadalajara, Jalisco, México Ntt Data A tiempo completo

    Job Title: Big Data EngineerAbout the Role:We are seeking a highly skilled Big Data Engineer to join our team at NTT DATA Services. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Spark and Scala.Key Responsibilities:Design and develop high-performance, reliable, and...

  • Big Data Support Engineer

    hace 6 días

    Guadalajara, Jalisco, México EPAM Systems A tiempo completo

    Job SummaryWe are seeking a highly skilled Big Data Support Engineer to join our team at EPAM Systems. As a key member of our global support organization, you will provide technical assistance and support to our customers using Cloud Platform products, solutions, and APIs.Key ResponsibilitiesCustomer Support: Provide timely and effective support to customers...

  • Data Governance Specialist

    hace 4 días

    Guadalajara, Jalisco, México NTT DATA A tiempo completo

    Job DescriptionJob Title: Master Data Support EngineerJob Summary:We are seeking a highly skilled Data Governance Specialist to join our team at NTT DATA Services. As a Data Governance Specialist, you will play a critical role in supporting and facilitating data governance initiatives, working closely with stakeholders, IT Leadership, and Product teams to...

  • Data Scientist Engineer

    hace 4 semanas

    Guadalajara, Jalisco, México NTT DATA Services A tiempo completo

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Scientist Engineer to join our team in Guadalajara, Jalisco (MX-JAL), Mexico (MX).• Bachelor degree or higher...

  • Data Scientist Engineer

    hace 4 semanas

    Guadalajara, Jalisco, México NTT DATA North America A tiempo completo

    Req ID: 292621NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Scientist Engineer to join our team in Guadalajara, Jalisco (MX-JAL), Mexico (MX). Bachelor degree or...

  • Big Data Support Engineer

    hace 2 meses

    Guadalajara, Jalisco, México EPAM Systems A tiempo completo

    DescriptionEPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver...

  • Big Data Developer

    hace 5 días

    Guadalajara, Jalisco, México Grid Dynamics International, Inc. A tiempo completo

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team and lead the development and management of our data feeds for digital eCommerce. In this role, you will act as a critical liaison between the digital and data teams, ensuring seamless data integration and flow across our platforms. Your expertise will drive the success of our data...

  • Data Engineer

    hace 6 días

    Guadalajara, Jalisco, México Intugo Call Center A tiempo completo

    About the RoleWe are seeking a highly skilled Data Engineer to join our Data Services team at Intugo Call Center. As a Data Engineer, you will play a crucial role in designing and implementing data solutions that drive business growth and innovation.Key ResponsibilitiesDesign and implement ETL/ELT processes using various tools and programming languages...

  • Data Visualizartion Engineer

    hace 4 semanas

    Guadalajara, Jalisco, México NTT DATA A tiempo completo

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Visualizartion Engineer to join our team in Guadalajara, Jalisco (MX-JAL), Mexico (MX).Skills required: Basic...

  • Big Data Architect

    hace 5 días

    Guadalajara, Jalisco, México Caylent A tiempo completo

    We are a fully remote global company with employees in various regions. We celebrate the culture of each of our team members and foster a community of technological curiosity. Our company values diversity and is committed to creating an inclusive environment for all employees.**The Mission**:At Caylent, a Big Data Architect works as an integral part of a...

  • Big Data Support Specialist

    hace 6 días

    Guadalajara, Jalisco, México Epam Systems A tiempo completo

    Job SummaryWe are seeking a highly skilled Big Data Support Specialist to join our team at Epam Systems. As a key member of our global support organization, you will provide technical assistance and support to customers using Cloud Platform products, solutions, and APIs.Key ResponsibilitiesProvide technical support to customers using Cloud Platform products,...

  • Data Scientist Engineer

    hace 5 días

    Guadalajara, Jalisco, México NTT DATA, Inc. A tiempo completo

    About NTT DATA, Inc.NTT DATA, Inc. is a leading provider of IT and business services, delivering innovative solutions to clients worldwide. As a trusted partner, we help organizations transform through business and technology consulting, industry and digital solutions, applications development and management, managed edge-to-cloud infrastructure services,...

  • Data Scientist Engineer

    hace 1 mes

    Guadalajara, Jalisco, México NTT DATA Services A tiempo completo

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Scientist Engineer to join our team in Guadalajara, Jalisco (MX-JAL), Mexico (MX).En Ntt Data estamos en busca de...

  • Data Engineer

    hace 6 días

    Guadalajara, Jalisco, México Amdocs A tiempo completo

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Amdocs. As an ETL Developer, you will play a critical role in designing, developing, and maintaining our data warehouse and big data platform.Key ResponsibilitiesDesign and develop new data pipelines and ETL processes to support business growth and improvementDevelop and maintain...

  • Data Engineer

    hace 6 días

    Guadalajara, Jalisco, México Flextal Staffing Llc A tiempo completo

    About the RoleFlextal Staffing Llc is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in designing, building, and maintaining scalable data pipelines and infrastructure.Key ResponsibilitiesDesign, develop, and maintain scalable ETL (Extract, Transform, Load) pipelines to process large volumes of...

  • Data Visualizartion Engineer

    hace 1 mes

    Guadalajara, Jalisco, México NTT DATA North America A tiempo completo

    Req ID: 292630NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Visualizartion Engineer to join our team in Guadalajara, Jalisco (MX-JAL), Mexico (MX).Skills Required:...

  • Data Visualizartion Engineer

    hace 4 semanas

    Guadalajara, Jalisco, México NTT DATA North America A tiempo completo

    Req ID: 292632NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Visualizartion Engineer to join our team in Guadalajara, Jalisco (MX-JAL), Mexico (MX). Basic understanding...

  • Data Architect

    hace 4 días

    Guadalajara, Jalisco, México Capgemini Engineering A tiempo completo

    About the Role**Job Title:** Data Engineer**Job Type:** Full-time**Location:** Remote**Industry:** Technology, Engineering, and Manufacturing**Company:** Capgemini EngineeringJob SummaryWe are seeking an experienced Data Engineer to join our team at Capgemini Engineering. As a Data Engineer, you will be responsible for designing, building, and maintaining...

  • Data Integration Specialist

    hace 4 días

    Guadalajara, Jalisco, México Ibm A tiempo completo

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at IBM Consulting. As a Data Engineer, you will play a critical role in developing, maintaining, evaluating, and testing big data solutions.Key ResponsibilitiesStrategic Data Model Design and ETL Optimization: Design, build, optimize, and support new and existing data models and ETL...

  • Data Scientist Engineer

    hace 1 mes

    Guadalajara, Jalisco, México NTT DATA North America A tiempo completo

    Req ID: 292625NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Scientist Engineer to join our team in Guadalajara, Jalisco (MX-JAL), Mexico (MX).En Ntt Data estamos en...