Lead Data Engineer with Python

hace 23 horas

Desde casa, México EPAM Systems, Inc. A tiempo completo

**Responsibilities**
- Develop and maintain reliable data pipelines for ingesting, transforming, and storing data from multiple sources
- Manipulate complex datasets and preprocess large-scale logs and time-series data using state-of-the-art tools and frameworks
- Leverage your knowledge of Python (Pandas, NumPy, etc.) to perform exploratory data analysis (EDA) and prepare data for business and analytical use cases
- Work collaboratively with cloud-based tools and infrastructure, focusing on scalability and performance optimization
- Utilize tools like Databricks, if experienced, or demonstrate a willingness to quickly ramp up on Databricks’ Lakehouse, Workflow, and ETL functionalities

**Requirements**:

- Proven experience of over 5 years as a Data Engineer or in a similar role, demonstrating a self-driven and problem-solving mindset
- At least 1 year of relevant leadership experience
- Expertise in Python for data processing, analysis, and manipulation (e.g., Pandas, NumPy, and advanced libraries)
- Proven experience working with large-scale logs, time-series data, and structured/unstructured data in diverse formats, preferably hardware/device data logs
- Knowledge of Databricks, including workflows, ETL processes, and working with Lakehouse architecture, is highly desirable
- Experience working with device data manipulation, such as medical data, IoT device data, hardware data, or similar
- Excellent command of written and spoken English (B2+ level)

**Nice to have**
- Exposure to PyTorch or TensorFlow for advanced data processing and AI/ML tasks

**We offer**
- Career plan and real growth opportunities
- Unlimited access to LinkedIn learning solutions
- Constant training, mentoring, online corporate courses, eLearning and more
- English classes with a certified teacher
- Support for employee’s initiatives (Algorithms club, toastmasters, agile club and more)
- Enjoyable working environment (Gaming room, napping area, amenities, events, sport teams and more)
- Flexible work schedule and dress code
- Collaborate in a multicultural environment and share best practices from around the globe
- Hired directly by EPAM & 100% under payroll
- Law benefits (IMSS, INFONAVIT, 25% vacation bonus)
- Major medical expenses insurance: Life, Major medical expenses with dental & visual coverage (for the employee and direct family members)
- 13 % employee savings fund, capped to the law limit
- Grocery coupons
- 30 days December bonus
- Employee Stock Purchase Plan
- 12 vacations days
- Official Mexican holidays, plus 5 extra holidays (Maundry Thursday and Friday, November 2nd, December 24th & 31st)
- Monthly non-taxable amount for the electricity and internet bills

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.

  • Lead Big Data Engineer with Databricks

    hace 4 semanas

    Desde casa, México EPAM Systems, Inc. A tiempo completo

    We are looking for a skilled** remote Lead Big Data Engineer with Databricks** experience to join our team.Your primary responsibility will be to lead the development of our ETL pipelines on Databricks using Spark/Scala, Databricks, and AWS. You must have extremely strong experience with Databricks, AWS, Python, and Elastic.**Responsibilities**- Lead the...

  • Lead Python Aws Engineer

    hace 2 semanas

    Desde casa, México EPAM Systems A tiempo completo

    We are seeking a **Lead Python AWS Engineer** to join our Agile Product Squad.RESPONSIBILITIES- Design, create, and uphold high-quality software solutions using Python within an AWS setting- Enhance the performance, scalability, and optimization of databases and data pipelines- Employ deep understanding of data pipeline design principles and best practices...

  • Lead Data Engineer

    hace 3 semanas

    Desde casa, México Luxoft A tiempo completo

    **Project** Description**:Luxoft DXC Technology Company is an established company focusing on consulting and implementation of complex projects in the financial industry. At the interface between technology and business, we convince with our know-how, well-founded methodology and pleasure in success. As a reliable partner to our renowned customers, we...

  • Snowflake Data Engineer with Dbt

    hace 4 semanas

    Desde casa, México KPI Partners A tiempo completo

    **Title: Snowflake Data Engineer with DBT****Location : Remote****Duration: 6+ months****Job Decsription**:- Advanced ability to write SQL.- Experience using Snowflake- Functional Python abilities- Ability to align working hours with NA for >6 hours/day (nearshore preferred)- Experience using Git version control, including branching, merging/rebasing, and...

  • Lead Data Software Engineer

    hace 3 días

    Desde casa, México EPAM Systems, Inc. A tiempo completo

    We are seeking an experienced Lead Data Software Engineer for a remote position to support our team's success and advance our Data Science initiatives.In this role, you will play a pivotal part in designing and maintaining datamarts while ensuring scalable and efficient data solutions tailored to meet client needs. You will focus on developing and managing...

  • Senior Data Engineer

    hace 22 horas

    Desde casa, México AgileEngine A tiempo completo

    ID: 14686 **What you will do** - Design and implement data pipelines using DBT for transformation and modeling; - Manage and optimize data warehouse solutions on Snowflake; - Develop and maintain ETL processes using Fivetran for data ingestion; - Utilize Terraform for infrastructure as code (IaC) to provision and manage resources in AWS, Snowflake,...

  • Data Engineer

    hace 4 días

    Desde casa, México Accolite Digital A tiempo completo

    Join a team of the top 1%.We believe in attracting and retaining the brightest technical minds from diverse backgrounds and nationalities to come together and create an enriched pool of global talent. Recognized as one of North America's fastest-growing companies, we aim to attract people who are passionate about technology and creating a real impact while...

  • Data Platform Engineer

    hace 2 semanas

    Desde casa, México Bhuvi IT Solutions A tiempo completo

    **#We_Are_Hiring for #Data_Platform_Engineer**Job Title**:Data Platform Engineer**Location: Remote (Mexico)Type: Long-term Contract**Key Skills: AWS, Snowflake, Kafka, Data Pipelines, Communication****Job Overview**:We’re looking for a skilled Data Platform Engineer to design, build, and manage scalable data pipelines and infrastructure using AWS,...

  • Data Lead

    hace 22 horas

    Desde casa, México HireIn Cloud A tiempo completo

    **Leading Financial Services StarUp** **looking for a DATA LEAD** **Technical Skills** - Experience of at least 2 years leading teams - Advanced experience working with Python - Advanced ecperience working with SQL - Experience with AWS - Experience with Data Governance - Proficient in data analysis tools and programming. - Expertise in data visualization...

  • Lead Azure Engineer

    hace 2 semanas

    Desde casa, México EPAM Systems A tiempo completo

    **DESCRIPTION**:Are you a skilled Azure Engineer with expertise in Python programming? Are you passionate about leading and driving innovative solutions in a dynamic IT environment? If so, we have an exciting opportunity for you to join EPAM as a**Lead Azure Engineer.**As a Lead Azure Engineer, you will play a crucial role in architecting, designing, and...