Lead Data DevOps Engineer
hace 1 día
We are looking for a Lead Data DevOps Engineer to drive the migration of Spark, Flink, and additional services to Databricks.
You will be responsible for creating and managing robust cloud infrastructure to enhance data processing pipelines. Join us to leverage your AWS, Terraform, and Databricks expertise and help deliver cutting-edge data solutions.
Responsibilities
- Develop, launch, and oversee Databricks infrastructure with Terraform to support scalable data operations
- Enhance Spark and Flink workflows and coordinate job orchestration for optimal pipeline performance within Databricks
- Architect, implement, and sustain AWS cloud infrastructure ensuring high availability and top performance
- Work closely with stakeholders to collect requirements and execute infrastructure upgrades aligned with business goals
- Track and resolve issues in data infrastructure using monitoring tools like Datadog to guarantee uptime
- Refine and stabilize CI/CD pipelines leveraging Spinnaker and Jenkins for seamless continuous delivery
- Maintain adherence to security policies and best practices across the data infrastructure
Requirements
- Demonstrated track record in Data DevOps engineering with over 5 years managing cloud infrastructure
- Advanced skills in Amazon Web Services (AWS) cloud environment
- Proficient in managing Databricks platforms and associated data workflows
- Experienced in using Terraform for infrastructure as code deployment and management
- Comprehensive understanding of Spark and Flink data processing systems
- Capability to enhance CI/CD pipelines and automate deployment workflows
- Effective communication skills to collaborate within cross-functional teams
- Upper-Intermediate English proficiency (B2 level) for effective interaction with international teams
-
Data DevOps Engineer
hace 3 semanas
Desde casa, México EPAM Systems A tiempo completo**DESCRIPTION**:Take the next leap in your career as a **Data DevOps Engineer **with EPAM!As a key figure in our remote team, you'll implement and support advanced Terraform and Azure DevOps pipeline solutions across multiple environments. If you hold hands-on experience with Terraform, Azure DevOps, and possess a knack for communication, optimization, and...
-
Data Lead Engineer
hace 2 semanas
Desde casa, México Testing IT A tiempo completo**TESTING IT** Somos una empresa líder en pruebas de software, brindamos servicios en México y Nearshore a EEUU; te invitamos a unirte como** DATA LEAD ENGINEER**, jugará un papel fundamental para brindar servicios de TI excepcionales: **Buscamos a partir de 5-8 años de Experiência en**: **NIVEL DE INGLES CONVERSACIONAL B2-C2/ OBLIGATORIO** Alto...
-
Senior Data DevOps Engineer
hace 1 día
Desde casa, México EPAM Systems, Inc. A tiempo completoWe are looking for a Senior Data DevOps Engineer to strengthen our data infrastructure and optimize development workflows.In this role, you will apply your Data DevOps expertise to improve data management and streamline deployment processes. If you thrive on creating efficient solutions and enjoy working collaboratively, we encourage you to join our...
-
Lead Data Engineer
hace 3 semanas
Desde casa, México Luxoft A tiempo completo**Project** Description**:Luxoft DXC Technology Company is an established company focusing on consulting and implementation of complex projects in the financial industry. At the interface between technology and business, we convince with our know-how, well-founded methodology and pleasure in success. As a reliable partner to our renowned customers, we...
-
Lead DevOps Engineer
hace 1 semana
Desde casa, México EPAM Systems, Inc. A tiempo completoWe are seeking a skilled **Lead DevOps Engineer** to join our team.In this position, you will lead the design and maintenance of infrastructure on Google Cloud Platform using Terraform. You will leverage your proficiency in DevOps to achieve optimal performance and security, while partnering with various teams to refine our cloud solutions. Join us and drive...
-
Azure DevOps Engineer Lead
hace 1 semana
Desde casa, México 117 Human Resources Analytics A tiempo completoEn Human Resources Analytics, buscamos conectar al Talento correcto con la empresa correcta, por ello buscamos la posición de: **Azure DevOps Engineer Lead** **Empresa que contrata**:Mobiik **Zona de trabajo**:Remoto **Descripción del puesto**: - Como Ingeniero Líder en DevOps Azure, desempeñarás funciones clave para facilitar la colaboración entre...
-
Lead DevOps Engineer
hace 7 días
Desde casa, México EPAM Systems, Inc. A tiempo completoWe are seeking a Lead DevOps Engineer to join our Ads Organization, where you will play a vital role in ensuring the dependability and scalability of our data infrastructure. This role centers on system enhancements, troubleshooting, streamlining CI/CD pipelines, and collaborating with stakeholders to deliver effective solutions in a data-focused...
-
Data DevOps Engineer
hace 2 semanas
Desde casa, México EPAM Systems, Inc. A tiempo completoWe are seeking a skilled and solutions-driven **Data DevOps Engineer** to develop scalable infrastructure, streamline deployment pipelines, and support data processing systems essential for delivering business insights and value.**Responsibilities**- Design infrastructure solutions and ensure their seamless integration within development and production...
-
Lead Data Software Engineer
hace 3 semanas
Desde casa, México EPAM Systems, Inc. A tiempo completoWe are searching for a highly skilled and experienced **Lead Data Software Engineer** to design, build, and optimize scalable data solutions on modern cloud platforms such as BigQuery or Databricks. In this position, you will lead a team of Data Engineers, advocate for automation-first development practices, and enable impactful business insights through...
-
DevOps Engineer
hace 2 semanas
Desde casa, México Bhuvi IT Solutions A tiempo completo**Sr. DevOps Engineer** **Location: Remote** **6 years of experience.** **Skills: Need experience in Terraform Template creation, Terraform module write up,** - AWS Resources - Helm template, - Shell scripting, Bash scripting, Python Scripting - Github, Github action, - Branching strategy, - GitOps, - Experience in DevOps Architecture design and...