Lead Data Engineer

hace 5 días

Desde casa, México EPAM Systems, Inc. A tiempo completo

We are seeking a **Lead Data Engineer** to join our innovative team and develop robust, scalable data infrastructure.

If you are passionate about crafting high-quality data solutions and working with cutting-edge technologies, this role offers an excellent opportunity to showcase your expertise.

**Responsibilities**
- Create scalable data pipelines leveraging Python3 and PySpark
- Manage Delta Tables on Databricks to enhance data storage and processing efficiency
- Partner with cross-functional teams to improve performance within AWS infrastructure, including S3, IAM, and EC2
- Maintain the security, reliability, and compliance of the data platform with organizational standards
- Streamline ETL/ELT workflows to improve efficiency and maintainability
- Diagnose and resolve technical issues in existing systems and pipelines
- Introduce advanced data engineering best practices and provide mentorship to junior engineers

**Requirements**:

- 5+ years of professional experience in data engineering or a related field
- Proficiency in Python3 and PySpark with the capability to deliver high-quality code
- Familiarity with Delta Tables and Databricks for large-scale data operations
- Background in AWS services such as S3, IAM, and EC2
- Expertise in data architecture design and distributed computing solutions

**Nice to have**
- Proficiency in DBT and Prefect2 for workflow orchestration
- Understanding of Spark Structured Streaming for processing real-time data
- Knowledge of Terraform for implementing infrastructure as code

**We offer**
- Career plan and real growth opportunities
- Unlimited access to LinkedIn learning solutions
- International Mobility Plan within 25 countries
- Constant training, mentoring, online corporate courses, eLearning and more
- English classes with a certified teacher
- Support for employee’s initiatives (Algorithms club, toastmasters, agile club and more)
- Enjoyable working environment (Gaming room, napping area, amenities, events, sport teams and more)
- Flexible work schedule and dress code
- Collaborate in a multicultural environment and share best practices from around the globe
- Hired directly by EPAM & 100% under payroll
- Law benefits (IMSS, INFONAVIT, 25% vacation bonus)
- Major medical expenses insurance: Life, Major medical expenses with dental & visual coverage (for the employee and direct family members)
- 13 % employee savings fund, capped to the law limit
- Grocery coupons
- 30 days December bonus
- Employee Stock Purchase Plan
- 12 vacations days plus 4 floating days
- Official Mexican holidays, plus 5 extra holidays (Maundry Thursday and Friday, November 2nd, December 24th & 31st)
- Monthly non-taxable amount for the electricity and internet bills

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.

  • Lead Azure Data Engineer

    hace 5 días

    Desde casa, México Datalogics A tiempo completo

    **Lead Azure Data Engineer (REMOTE)** - **5000 USD - 6000 USD/month**: - **100% remote work**: - Full time - **B2B contract**: - **Direct employment by the company** We’re looking for a **Lead** **Azure Data Engineer **for a specialist supply chain, data and software engineering solutions company with over 380 employees, development centers in the USA...

  • Lead Data Engineer

    hace 1 semana

    Desde casa, México Luxoft A tiempo completo

    **Project** Description**: Luxoft DXC Technology Company is an established company focusing on consulting and implementation of complex projects in the financial industry. At the interface between technology and business, we convince with our know-how, well-founded methodology and pleasure in success. As a reliable partner to our renowned customers, we...

  • Lead Data Engineer

    hace 1 semana

    Desde casa, México Luxoft A tiempo completo

    **Project** Description**:Luxoft DXC Technology Company is an established company focusing on consulting and implementation of complex projects in the financial industry. At the interface between technology and business, we convince with our know-how, well-founded methodology and pleasure in success. As a reliable partner to our renowned customers, we...

  • Lead Data Software Engineer

    hace 1 semana

    Desde casa, México EPAM Systems A tiempo completo

    We are seeking a highly skilled and experienced **Lead Data Software** **Engineer **to lead our data engineering team in the design, implementation, and maintenance of our data platform. RESPONSIBILITIES - Collaborate with Solution Architects to design and build a configuration/metadata-driven framework for data transformation and orchestration - Develop...

  • Data Lead Engineer

    hace 4 semanas

    Desde casa, México Testing IT A tiempo completo

    **TESTING IT** Somos una empresa líder en pruebas de software, brindamos servicios en México y Nearshore a EEUU; te invitamos a unirte como** DATA LEAD ENGINEER**, jugará un papel fundamental para brindar servicios de TI excepcionales:**Buscamos a partir de 5-8 años de Experiência en**:**NIVEL DE INGLES CONVERSACIONAL B2-C2/ OBLIGATORIO**Alto dominio de...

  • Lead Data Engineer

    hace 2 semanas

    Desde casa, México EPAM Systems, Inc. A tiempo completo

    We are looking for a highly skilled **Lead Data Engineer**to join our team.In this role, you will lead technical efforts for NoSQL-related projects, evaluate database platform technologies, and provide expert analysis and recommendations based on business requirements. You will collaborate closely with the engineering team to design and implement best...

  • Lead Data Engineer

    hace 2 semanas

    Desde casa, México EPAM Systems, Inc. A tiempo completo

    Join our dynamic team as a **Lead Data Engineer**, where you will contribute both independently and collaboratively to deliver top-tier data integration solutions.Your knowledge of investment financial data and expertise in agile methodologies will be key as you work with cross-functional teams to enhance our trading platform and reporting functionalities....

  • Data Engineer

    hace 3 semanas

    Desde casa, México Inetum A tiempo completo

    We are very grateful that you have decided to participate in the **recruitment and selection process**, you will see that your incorporation will lead you to great opportunities for professional development, remember that we are an international agile digital consulting group. In the era of post digital transformation, we strive to enable each of our 27,000...

  • Data Engineering Team Lead

    hace 3 semanas

    Desde casa, México TechBiz Global GmbH A tiempo completo

    **About TechBiz Global**TechBiz Global is a leading recruitment and software development company. Our diverse, globally distributed team provides IT recruitment, outstaffing, outsourcing, software development, and different consulting services with a primary focus on making our partners achieve their business goals successfully.With headquarters in Germany...

  • Lead Data Engineer

    hace 1 semana

    Desde casa, México EPAM Systems, Inc. A tiempo completo

    We are seeking a **Lead Data Engineer** to join our team. This position combines engineering and analytical duties. You will develop and maintain data infrastructure while analyzing cost data, identifying trends, and collaborating with teams to optimize cloud expenses. Primarily focusing on AWS, this role demands a solid understanding of AWS services and...