Lead Data Software Engineer

We are seeking a proactive and seasoned **Lead Data Software Engineer**to guide our team and drive the development of a cutting-edge platform for our client.

Our client is one of the world’s leading providers of reinsurance, insurance, and other forms of insurance-based risk transfer, working to make the world more resilient.

This is a unique opportunity to take the lead on a transformative project, collaborating with a talented team to deliver innovative solutions using industry-leading technologies.

**Responsibilities**
- Collaborate with cross-functional teams to design, build, and implement scalable data solutions on the Palantir platform, while acting as a technical leader to drive alignment on best practices
- Lead the development and optimization of Spark-based data pipelines, ensuring high performance for large-scale data processing and mentoring the team to maintain quality standards
- Establish coding guidelines and standards while writing efficient and clean Python code to support team workflows
- Utilize PySpark for advanced data manipulation and transformation within distributed frameworks; provide guidance and troubleshooting on complex tasks
- Conduct root cause analysis on internal and external data to address business questions, while driving the team to identify and execute improvement opportunities
- Define and oversee the implementation of DevOps/DataOps practices, such as Agile workflows, sprint planning, continuous integration, and deployment strategies
- Architect scalable and reusable data models and structures, ensuring they align with current and future business requirements
- Oversee relational database operations with a focus on advanced query optimization, while actively supporting team members to develop database skills
- Serve as a trusted advisor, providing strategic and technical expertise to evaluate solutions and make high-impact decisions
- Communicate effectively with key stakeholders, ensuring project alignment, scope clarity, and excellence in delivery
- Mentor Junior and Mid-level Engineers on technical execution, project strategy, and data engineering best practices
- Promote a culture of innovation within the team, encouraging experimentation with new tools and driving continuous learning

**Requirements**:

- 5+ years of experience in Data Software Engineering
- Leadership experience exceeding 1 year applicable to the role
- Proven hands-on expertise with Palantir, PySpark, and Python
- Deep knowledge of Spark data pipelines and optimization in large-scale and diverse environments
- Advanced proficiency in relational databases and SQL query optimization, with proven experience working across various database platforms
- Strong background in data analysis and analytics, with a track record of performing root cause analysis on critical business processes and transformations
- Demonstrated expertise in implementing and overseeing DevOps/DataOps methodologies, including Agile project management, sprint planning, and CI/CD architectures
- Ability to translate detailed business requirements into strategic technical decisions, while fostering a systematic and solutions-driven approach
- Strong leadership and interpersonal communication skills, with the ability to build positive relationships across teams and stakeholders
- Excellent command of English (B2+ level), both written and spoken, with a strong emphasis on technical communication skills

**Nice to have**
- Familiarity with insurance, reinsurance, or financial industries
- Hands-on experience with Azure Databricks
- Experience working with Azure Data Services

**We offer**
- Career plan and real growth opportunities
- Unlimited access to LinkedIn learning solutions
- International Mobility Plan within 25 countries
- Constant training, mentoring, online corporate courses, eLearning and more
- English classes with a certified teacher
- Support for employee’s initiatives (Algorithms club, toastmasters, agile club and more)
- Enjoyable working environment (Gaming room, napping area, amenities, events, sport teams and more)
- Flexible work schedule and dress code
- Collaborate in a multicultural environment and share best practices from around the globe
- Hired directly by EPAM & 100% under payroll
- Law benefits (IMSS, INFONAVIT, 25% vacation bonus)
- Major medical expenses insurance: Life, Major medical expenses with dental & visual coverage (for the employee and direct family members)
- 13 % employee savings fund, capped to the law limit
- Grocery coupons
- 30 days December bonus
- Employee Stock Purchase Plan
- 12 vacations days plus 4 floating days
- Official Mexican holidays, plus 5 extra holidays (Maundry Thursday and Friday, November 2nd, December 24th & 31st)
- Monthly non-taxable amount for the electricity and internet bills

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our commun