Senior Data DevOps Engineer with AWS expertise

hace 2 días

Desde casa, México EPAM Systems A tiempo completo

We are hiring a Senior Data DevOps Engineer with strong AWS expertise to design, optimize, and secure cloud-based data infrastructures. You will take charge of infrastructure and automation decisions, guide team members, and collaborate with various teams to implement effective data solutions. Apply now to be part of a dynamic environment that values your skills and leadership.

Responsibilities

  • Create and enhance scalable data infrastructure using AWS services such as ECS, RDS, Athena, Glue, S3, EBS, CloudFormation, IAM, and Redshift
  • Build and maintain automated workflows with Infrastructure as Code tools including Terraform and AWS CloudFormation
  • Partner with data engineering and analytics teams to optimize high-performance data pipelines using Python and AWS Glue
  • Set and uphold best practices for AWS-focused CI/CD pipelines using tools like GitHub Actions, AWS CodePipeline, Jenkins, or others
  • Boost the scalability, reliability, performance, and cost-effectiveness of cloud data platforms
  • Integrate advanced data tools like Apache Airflow and Apache Spark on AWS EMR to enhance workflows
  • Analyze and resolve complex systemic issues across AWS-hosted systems with thorough root cause analysis
  • Develop and enforce robust IAM policies, security configurations, encryption standards, and AWS best practices
  • Plan capacity, optimize resources, and manage costs for essential data platform components
  • Support and mentor team members, fostering adoption of best practices

Requirements

  • Over 3 years of professional experience in Data Engineering, DevOps, or related fields emphasizing cloud infrastructure and automation
  • Strong Python programming skills for scripting, automation, and workflow efficiency
  • Expertise in SQL for managing large datasets
  • Proven experience managing AWS data infrastructure services including Redshift, Glue, EMR, and Athena
  • In-depth knowledge of Infrastructure as Code tools such as Terraform, AWS CloudFormation, or Ansible
  • Proven skills in building and maintaining CI/CD pipelines with Jenkins, GitHub Actions, AWS CodePipeline, or equivalents
  • Experience with distributed data processing and orchestration tools like Apache Spark and Apache Airflow
  • Advanced Linux administration and performance tuning capabilities in cloud environments
  • Strong understanding of networking protocols (TCP, UDP, ICMP, DNS, NAT) in cloud settings
  • Experience deploying and automating infrastructure at scale using Terraform or similar tools
  • Proficient in installing and operating data pipeline platforms like Apache Kafka and NiFi
  • Capability to lead complex technical projects and mentor junior and mid-level engineers
  • English proficiency at professional level (B2 or above)

Nice to have

  • Knowledge of additional cloud providers such as Azure or GCP and hybrid cloud designs
  • Experience with statistical tools like R and data visualization platforms such as Tableau or Power BI
  • Familiarity with advanced CI/CD platforms like Bamboo
  • Experience implementing hybrid cloud and on-premises data solutions with secure, scalable flows
  • Understanding of container orchestration using Kubernetes, Docker, or AWS ECS/EKS

  • Lead Data DevOps Engineer with AWS Expertise

    hace 2 días

    Desde casa, México EPAM Systems A tiempo completo

    We are seeking an experienced Lead Data DevOps Engineer skilled in AWS to steer our cloud data infrastructure initiatives. You will be responsible for leading the architecture, improvement, and secure scaling of our cloud-based data platforms while mentoring your team and collaborating with multiple stakeholders. Join us to influence the future of our...

  • Senior Data DevOps Engineer with AWS Focus

    hace 2 días

    Desde casa, México EPAM Systems A tiempo completo

    We are seeking a seasoned Senior Data DevOps Engineer focused on AWS to design, build, and maintain scalable cloud data infrastructures. You will be responsible for infrastructure strategy, automation, and mentoring, collaborating closely with teams to deliver efficient and secure cloud solutions. If you have the skills and leadership to excel, apply now to...

  • Senior Data DevOps Engineer with Azure expertise

    hace 2 días

    Desde casa, México EPAM Systems A tiempo completo

    We invite a Senior Data DevOps Engineer to join our team and lead the design and optimization of data infrastructure and workflow automation on Azure. This role involves creating scalable data solutions and collaborating closely with data engineering and other teams to ensure high pipeline efficiency, stability, and performance. Apply now to become part of...

  • Senior DevOps Engineer

    hace 2 semanas

    Desde casa, México Zipdev A tiempo completo

    Our client, a leading provider of software solutions aimed at enhancing patient engagement in medical, dental/ortho, and optometry practices, is seeking a Senior DevOps Engineer to join their dynamic team. As a Senior DevOps Engineer, you will play a crucial role in optimizing and maintaining the infrastructure and deployment processes for their all-in-one...

  • Senior AI Platform Engineer with AWS Expertise

    hace 3 semanas

    Desde casa, México EPAM Systems A tiempo completo

    We are looking for a Senior AI Platform Engineer to deliver robust infrastructure supporting production ML solutions on AWS, enhancing AI/ML workflows and platforms.You will collaborate with data science teams to architect innovative AI/ML environments using AWS services like SageMaker and EKS, driving projects from inception to delivery. Join us to advance...

  • Senior Data DevOps Engineer

    hace 2 días

    Desde casa, México EPAM Systems, Inc. A tiempo completo

    We are looking for a Senior Data DevOps Engineer to strengthen our data infrastructure and optimize development workflows.In this role, you will apply your Data DevOps expertise to improve data management and streamline deployment processes. If you thrive on creating efficient solutions and enjoy working collaboratively, we encourage you to join our...

  • Lead Data DevOps Engineer with Azure expertise

    hace 2 días

    Desde casa, México EPAM Systems A tiempo completo

    We are seeking a Lead Data DevOps Engineer with expertise in Azure to spearhead the design and enhancement of our data infrastructure and workflows. You will oversee scalable data implementations on Azure, working closely with data engineering and other teams to maintain efficient pipelines, system reliability, and performance. Apply today to be a key...

  • Lead Data DevOps Engineer

    hace 3 semanas

    Desde casa, México EPAM Systems, Inc. A tiempo completo

    We are looking for a Lead Data DevOps Engineer to drive the migration of Spark, Flink, and additional services to Databricks.You will be responsible for creating and managing robust cloud infrastructure to enhance data processing pipelines. Join us to leverage your AWS, Terraform, and Databricks expertise and help deliver cutting-edge data...

  • Data DevOps Engineer

    hace 2 semanas

    Desde casa, México EPAM Systems A tiempo completo

    We are seeking a skilled **Data DevOps Engineer** to join our newly formed team of infrastructure engineers responsible for supporting our data processing pipeline infrastructure cluster. As a Data DevOps Engineer, you will play a critical role in incident response, problem management, and continuous configuration improvements across our data infrastructure...

  • Senior Aws Glue Data Engineer

    hace 2 semanas

    Desde casa, México Perficient A tiempo completo

    **Why is Perficient the best option?** Perficient is a leading global digital consultancy and has a presence around the globe transforming and connecting the most prominent brands with their customers. At Perficient, we seek to grow alongside professionals promoting agile cultures and values as we challenge, champion, and celebrate our people for us to...