Lead Data Software Engineer

hace 1 día

Desde casa, México EPAM Systems, Inc. A tiempo completo

We are seeking an experienced Lead Data Software Engineer for a remote position to support our team's success and advance our Data Science initiatives.

In this role, you will play a pivotal part in designing and maintaining datamarts while ensuring scalable and efficient data solutions tailored to meet client needs. You will focus on developing and managing data pipelines, providing on-call support, and working closely with Data Science teams to deliver high-quality results. Additionally, you will lead a team of skilled professionals, offering mentorship and guidance to drive innovation and excellence within the industry.

Responsibilities

  • Lead and mentor the Data Software Engineering team, fostering a culture of continuous improvement and professional growth
  • Collaborate across disciplines to deliver high-quality data solutions aligned with project goals and deadlines
  • Establish and maintain effective Data Software Engineering processes, emphasizing automation, efficiency, and innovation
  • Implement and sustain scalable data solutions using AWS services
  • Oversee optimization of workflows and data processing through Apache Airflow and Apache Spark
  • Continuously evaluate industry trends and best practices to refine and adopt advanced Data Software Engineering methodologies
  • Provide on-call support for data pipelines and datamarts to ensure operational efficiency
  • Direct the creation and deployment of REST APIs to enable seamless data integration and communication
  • Engage with clients to understand their needs and deliver tailored solutions that meet their requirements
  • Manage team structure and organization to ensure timely and efficient delivery of projects
  • Work with stakeholders, demonstrating strong communication and leadership capabilities

Requirements

  • At least 5 years of experience as a Data Software Engineer, working on complex projects and large-scale data infrastructures
  • Minimum of 1 year of leadership experience, successfully managing and motivating a team of Data Software Engineers
  • Expertise in Amazon Web Services (AWS), including designing and implementing scalable data solutions
  • Extensive knowledge of Apache Airflow and Apache Spark for optimizing workflows and data processing
  • Advanced proficiency with one or more CI/CD tools, such as Jenkins, to streamline data pipeline delivery
  • Strong skills in Python and SQL for building and maintaining data pipelines and ETL processes
  • Experience with Databricks and PySpark for data analysis and processing
  • Familiarity with REST APIs for efficient data integration and communication
  • Excellent analytical skills for problem-solving and decision-making in complex environments
  • Strong client-facing abilities, ensuring effective collaboration and clear communication to achieve project objectives
  • Exceptional organizational and team management skills for delivering projects efficiently
  • Upper-intermediate English proficiency for effective communication, presentations, and discussions with stakeholders

Nice to have

  • Experience with Redshift for data warehousing and analysis

  • Lead Data Software Engineer

    hace 3 semanas

    Desde casa, México EPAM Systems, Inc. A tiempo completo

    We are searching for a highly skilled and experienced **Lead Data Software Engineer** to design, build, and optimize scalable data solutions on modern cloud platforms such as BigQuery or Databricks. In this position, you will lead a team of Data Engineers, advocate for automation-first development practices, and enable impactful business insights through...

  • Lead Data Software Engineer

    hace 4 semanas

    Desde casa, México EPAM Systems, Inc. A tiempo completo

    We are seeking a **Lead Data Software Engineer** to join our team.In this role, you will focus on creating software for data processing jobs and pipelines, ensuring the delivery of high-quality data to internal and external partners. You will work within a team committed to clean, maintainable code while treating data as a core product. If you are passionate...

  • Lead Data Software Engineer

    hace 3 semanas

    Desde casa, México EPAM Systems, Inc. A tiempo completo

    We are seeking a skilled and innovative **Lead Data Software Engineer** to join our team in building robust data pipelines for our cutting-edge data platform.This role is pivotal in transforming, translating, and optimizing data to support training and inference tasks.**Responsibilities**- Develop efficient and scalable data engineering solutions to support...

  • Lead Data Software Engineer

    hace 6 días

    Desde casa, México EPAM Systems, Inc. A tiempo completo

    We are seeking a dedicated and experienced **Lead Data Software Engineer** to join our team and contribute to developing advanced technology solutions for Investment operations, including trade processes, accounting, reconciliation, reporting, and related activities. **Responsibilities** - Define technical requirements for data-driven solutions in...

  • Lead Data Software Engineer

    hace 5 días

    Desde casa, México EPAM Systems, Inc. A tiempo completo

    We are seeking a dedicated and experienced **Lead Data Software Engineer** to join our team and contribute to developing advanced technology solutions for Investment operations, including trade processes, accounting, reconciliation, reporting, and related activities.**Responsibilities**- Define technical requirements for data-driven solutions in...

  • Lead Data Software Engineer

    hace 3 semanas

    Desde casa, México EPAM Systems, Inc. A tiempo completo

    We are seeking a proactive and seasoned **Lead Data Software Engineer**to guide our team and drive the development of a cutting-edge platform for our client.Our client is one of the world’s leading providers of reinsurance, insurance, and other forms of insurance-based risk transfer, working to make the world more resilient.This is a unique opportunity to...

  • Chief Data Software Engineer

    hace 3 semanas

    Desde casa, México EPAM Systems, Inc. A tiempo completo

    We are seeking a highly motivated and visionary **Chief Data Software Engineer** to design, strategize, and architect scalable data solutions on modern cloud platforms like BigQuery or Databricks.In this role, you will lead and inspire teams of Data Engineers and Data Architects, set the strategic direction for enterprise data infrastructure, and champion an...

  • Data Engineering Team Lead

    hace 5 días

    Desde casa, México TechBiz Global GmbH A tiempo completo

    **About TechBiz Global** TechBiz Global is a leading recruitment and software development company. Our diverse, globally distributed team provides IT recruitment, outstaffing, outsourcing, software development, and different consulting services with a primary focus on making our partners achieve their business goals successfully. With headquarters in...

  • Software Engineer

    hace 2 semanas

    Desde casa, México Red Hat Software A tiempo completo

    About the job: The Red Hat OpenStack engineering team is seeking a Software Engineer in Mexico. In this role, you will collaborate with upstream communities, lead the build out and continuous improvement of the CI process for OpenStack - involving containerized services. As a member of the design team, you'll contribute to feature test coverage, tooling...

  • Data Lead Engineer

    hace 2 semanas

    Desde casa, México Testing IT A tiempo completo

    **TESTING IT** Somos una empresa líder en pruebas de software, brindamos servicios en México y Nearshore a EEUU; te invitamos a unirte como** DATA LEAD ENGINEER**, jugará un papel fundamental para brindar servicios de TI excepcionales: **Buscamos a partir de 5-8 años de Experiência en**: **NIVEL DE INGLES CONVERSACIONAL B2-C2/ OBLIGATORIO** Alto...