Lead Data Software Engineer

hace 3 horas

Desde casa, México EPAM Systems A tiempo completo

We are seeking a highly skilled and experienced **Lead Data Software** **Engineer **to lead our data engineering team in the design, implementation, and maintenance of our data platform.

RESPONSIBILITIES
- Collaborate with Solution Architects to design and build a configuration/metadata-driven framework for data transformation and orchestration
- Develop and implement a Data Ingestion Framework, identifying patterns for initial and incremental data loads
- Guide the data engineering team in adopting best practices for data processing, ensuring scalability and maintainability of the data platform
- Oversee the documentation of all data engineering processes and frameworks for knowledge sharing and future reference
- Collaborate with DevOps Team to deploy & configure required infrastructure components, connect to Data Source, enable CI/CD, and deliver pipelines implementation (framework)

**REQUIREMENTS**:

- Data Architectural mindset
- Hands-on coding experience of Databricks Jobs with Python, PySpark
- Hands-on experience with Data Lake or Data Platform implementation
- Good understanding of relational and NoSQL data stores, methods, and approaches (star and snowflake, dimensional modeling)
- Experience in Azure cloud data platform, namely Azure Databricks, Delta Lake, ADSL2, Azure Data Factory, Azure SQL Database, Azure Functions
- Proven experience in leading data engineering teams
- Background or Excessive Knowledge in designing and implementing metadata-driven frameworks for data transformation and orchestration
- Expertise in developing data ingestion strategies for handling both initial and incremental data loads. Various integration patterns (REST, Files, DB Connect)
- Solid understanding of data engineering best practices and the ability to implement these in a team setting
- Excellent problem-solving skills and the ability to lead complex data engineering projects
- Strong communication and collaboration skills to work effectively with both technical and non-technical stakeholders

NICE TO HAVE
- Relevant certifications in Azure, Databricks, and data engineering methodologies

WE OFFER
- Career plan and real growth opportunities
- Unlimited access to LinkedIn learning solutions
- International Mobility Plan within 25 countries
- Constant training, mentoring, online corporate courses, eLearning and more
- English classes with a certified teacher
- Support for employee’s initiatives (Algorithms club, toastmasters, agile club and more)
- Enjoyable working environment (Gaming room, napping area, amenities, events, sport teams and more)
- Flexible work schedule and dress code
- Collaborate in a multicultural environment and share best practices from around the globe
- Hired directly by EPAM & 100% under payroll
- Law benefits (IMSS, INFONAVIT, 25% vacation bonus)
- Major medical expenses insurance: Life, Major medical expenses with dental & visual coverage (for the employee and direct family members)
- 13 % employee savings fund, capped to the law limit
- Grocery coupons
- 30 days December bonus
- Employee Stock Purchase Plan
- 12 vacations days plus 4 floating days
- Official Mexican holidays, plus 5 extra holidays (Maundry Thursday and Friday, November 2nd, December 24th & 31st)
- Monthly non-taxable amount for the electricity and internet bills

  • Data Engineer

    hace 2 semanas

    Desde casa, México Inetum A tiempo completo

    We are very grateful that you have decided to participate in the **recruitment and selection process**, you will see that your incorporation will lead you to great opportunities for professional development, remember that we are an international agile digital consulting group. In the era of post digital transformation, we strive to enable each of our 27,000...

  • Lead Data Software Engineer

    hace 4 semanas

    Desde casa, México EPAM Systems A tiempo completo

    We are seeking a highly skilled and experienced **Lead Data Software** **Engineer **to lead our data engineering team in the design, implementation, and maintenance of our data platform.RESPONSIBILITIES- Collaborate with Solution Architects to design and build a configuration/metadata-driven framework for data transformation and orchestration- Develop and...

  • Lead Data Software Engineer

    hace 2 días

    Desde casa, México EPAM Systems, Inc. A tiempo completo

    We are searching for a highly skilled and experienced **Lead Data Software Engineer** to design, build, and optimize scalable data solutions on modern cloud platforms such as BigQuery or Databricks. In this position, you will lead a team of Data Engineers, advocate for automation-first development practices, and enable impactful business insights through...

  • Lead Data Software Engineer

    hace 4 horas

    Desde casa, México EPAM Systems, Inc. A tiempo completo

    We are searching for a highly skilled and experienced **Lead Data Software Engineer** to design, build, and optimize scalable data solutions on modern cloud platforms such as BigQuery or Databricks. In this position, you will lead a team of Data Engineers, advocate for automation-first development practices, and enable impactful business insights through...

  • Lead Azure Data Engineer

    hace 3 semanas

    Desde casa, México Datalogics A tiempo completo

    **Lead Azure Data Engineer (REMOTE)**- **5000 USD - 6000 USD/month**:- **100% remote work**:- Full time- **B2B contract**:- **Direct employment by the company**We’re looking for a **Lead** **Azure Data Engineer **for a specialist supply chain, data and software engineering solutions company with over 380 employees, development centers in the USA and India...

  • Lead Data Software Engineer

    hace 5 días

    Desde casa, México EPAM Systems, Inc. A tiempo completo

    We are seeking a **Lead Data Software Engineer** to join our team.In this role, you will focus on creating software for data processing jobs and pipelines, ensuring the delivery of high-quality data to internal and external partners. You will work within a team committed to clean, maintainable code while treating data as a core product. If you are passionate...

  • Lead Data Software Engineer

    hace 2 semanas

    Desde casa, México EPAM Systems, Inc. A tiempo completo

    We are seeking a dedicated and experienced **Lead Data Software Engineer** to join our team and contribute to developing advanced technology solutions for Investment operations, including trade processes, accounting, reconciliation, reporting, and related activities. **Responsibilities** - Define technical requirements for data-driven solutions in...

  • Lead Data Software Engineer

    hace 3 días

    Desde casa, México EPAM Systems, Inc. A tiempo completo

    We are seeking a proactive and seasoned **Lead Data Software Engineer**to guide our team and drive the development of a cutting-edge platform for our client.Our client is one of the world’s leading providers of reinsurance, insurance, and other forms of insurance-based risk transfer, working to make the world more resilient.This is a unique opportunity to...

  • Lead Data Software Engineer

    hace 4 semanas

    Desde casa, México EPAM Systems, Inc. A tiempo completo

    We are seeking an experienced **Lead Data Software Engineer** to join our team.**Responsibilities**- Develop and implement scalable data architectures using Snowflake, including automated data ingestion with Snowpipe- Enhance data processing performance and security in Snowflake environments- Construct and sustain event-driven architectures using Apache...

  • Lead Data Software Engineer

    hace 3 horas

    Desde casa, México EPAM Systems, Inc. A tiempo completo

    We are seeking an experienced **Lead Data Software Engineer** to join our team. **Responsibilities** - Develop and implement scalable data architectures using Snowflake, including automated data ingestion with Snowpipe - Enhance data processing performance and security in Snowflake environments - Construct and sustain event-driven architectures using Apache...