Lead Data Engineer with Python

hace 7 días

Desde casa, México EPAM Systems, Inc. A tiempo completo

**Responsibilities**
- Develop and maintain reliable data pipelines for ingesting, transforming, and storing data from multiple sources
- Manipulate complex datasets and preprocess large-scale logs and time-series data using state-of-the-art tools and frameworks
- Leverage your knowledge of Python (Pandas, NumPy, etc.) to perform exploratory data analysis (EDA) and prepare data for business and analytical use cases
- Work collaboratively with cloud-based tools and infrastructure, focusing on scalability and performance optimization
- Utilize tools like Databricks, if experienced, or demonstrate a willingness to quickly ramp up on Databricks’ Lakehouse, Workflow, and ETL functionalities

**Requirements**:

- Proven experience of over 5 years as a Data Engineer or in a similar role, demonstrating a self-driven and problem-solving mindset
- At least 1 year of relevant leadership experience
- Expertise in Python for data processing, analysis, and manipulation (e.g., Pandas, NumPy, and advanced libraries)
- Proven experience working with large-scale logs, time-series data, and structured/unstructured data in diverse formats, preferably hardware/device data logs
- Knowledge of Databricks, including workflows, ETL processes, and working with Lakehouse architecture, is highly desirable
- Experience working with device data manipulation, such as medical data, IoT device data, hardware data, or similar
- Excellent command of written and spoken English (B2+ level)

**Nice to have**
- Exposure to PyTorch or TensorFlow for advanced data processing and AI/ML tasks

**We offer**
- Career plan and real growth opportunities
- Unlimited access to LinkedIn learning solutions
- Constant training, mentoring, online corporate courses, eLearning and more
- English classes with a certified teacher
- Support for employee’s initiatives (Algorithms club, toastmasters, agile club and more)
- Enjoyable working environment (Gaming room, napping area, amenities, events, sport teams and more)
- Flexible work schedule and dress code
- Collaborate in a multicultural environment and share best practices from around the globe
- Hired directly by EPAM & 100% under payroll
- Law benefits (IMSS, INFONAVIT, 25% vacation bonus)
- Major medical expenses insurance: Life, Major medical expenses with dental & visual coverage (for the employee and direct family members)
- 13 % employee savings fund, capped to the law limit
- Grocery coupons
- 30 days December bonus
- Employee Stock Purchase Plan
- 12 vacations days
- Official Mexican holidays, plus 5 extra holidays (Maundry Thursday and Friday, November 2nd, December 24th & 31st)
- Monthly non-taxable amount for the electricity and internet bills

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.

  • Lead Big Data Engineer with Databricks

    hace 4 días

    Desde casa, México EPAM Systems, Inc. A tiempo completo

    We are looking for a skilled** remote Lead Big Data Engineer with Databricks** experience to join our team.Your primary responsibility will be to lead the development of our ETL pipelines on Databricks using Spark/Scala, Databricks, and AWS. You must have extremely strong experience with Databricks, AWS, Python, and Elastic.**Responsibilities**- Lead the...

  • Lead Azure Data Engineer

    hace 3 semanas

    Desde casa, México Datalogics A tiempo completo

    **Lead Azure Data Engineer (REMOTE)**- **5000 USD - 6000 USD/month**:- **100% remote work**:- Full time- **B2B contract**:- **Direct employment by the company**We’re looking for a **Lead** **Azure Data Engineer **for a specialist supply chain, data and software engineering solutions company with over 380 employees, development centers in the USA and India...

  • Data Engineer

    hace 1 semana

    Desde casa, México Accolite Digital A tiempo completo

    Join a team of the top 1%. We believe in attracting and retaining the brightest technical minds from diverse backgrounds and nationalities to come together and create an enriched pool of global talent. Recognized as one of North America's fastest-growing companies, we aim to attract people who are passionate about technology and creating a real impact while...

  • Lead Data Engineer

    hace 21 horas

    Desde casa, México Luxoft A tiempo completo

    **Project** Description**: Luxoft DXC Technology Company is an established company focusing on consulting and implementation of complex projects in the financial industry. At the interface between technology and business, we convince with our know-how, well-founded methodology and pleasure in success. As a reliable partner to our renowned customers, we...

  • Snowflake Data Engineer with Dbt

    hace 2 días

    Desde casa, México KPI Partners A tiempo completo

    **Title: Snowflake Data Engineer with DBT****Location : Remote****Duration: 6+ months****Job Decsription**:- Advanced ability to write SQL.- Experience using Snowflake- Functional Python abilities- Ability to align working hours with NA for >6 hours/day (nearshore preferred)- Experience using Git version control, including branching, merging/rebasing, and...

  • Snowflake Data Engineer with Dbt

    hace 4 días

    Desde casa, México KPI Partners A tiempo completo

    **Title: Snowflake Data Engineer with DBT** **Location : Remote** **Duration: 6+ months** **Job Decsription**: - Advanced ability to write SQL. - Experience using Snowflake - Functional Python abilities - Ability to align working hours with NA for >6 hours/day (nearshore preferred) - Experience using Git version control, including branching,...

  • Senior Python Data Engineer

    hace 2 semanas

    Desde casa, México 3Pillar A tiempo completo

    At 3Pillar Global, we specialize in building impactful software products that power digital businesses. We are looking for a talented Senior Data Python + AWS Engineer who will not only write code but also deliver exceptional product capabilities for our clients. Your contributions will play a pivotal role in achieving our passion for client success,...

  • Senior Python Data Engineer

    hace 2 semanas

    Desde casa, México 3Pillar A tiempo completo

    At 3Pillar Global, we specialize in building impactful software products that power digital businesses. We are looking for a talented Senior Data Python + AWS Engineer who will not only write code but also deliver exceptional product capabilities for our clients. Your contributions will play a pivotal role in achieving our passion for client success,...

  • Lead Data Software Engineer

    hace 4 semanas

    Desde casa, México EPAM Systems A tiempo completo

    We are seeking a highly skilled and experienced **Lead Data Software** **Engineer **to lead our data engineering team in the design, implementation, and maintenance of our data platform.RESPONSIBILITIES- Collaborate with Solution Architects to design and build a configuration/metadata-driven framework for data transformation and orchestration- Develop and...

  • Senior Data Engineer

    hace 7 días

    Desde casa, México AgileEngine A tiempo completo

    ID: 14686 **What you will do** - Design and implement data pipelines using DBT for transformation and modeling; - Manage and optimize data warehouse solutions on Snowflake; - Develop and maintain ETL processes using Fivetran for data ingestion; - Utilize Terraform for infrastructure as code (IaC) to provision and manage resources in AWS, Snowflake,...