Lead Data Software Engineer

We are seeking a proactive and seasoned **Lead Data Software Engineer**to guide our team and drive the development of a cutting-edge platform for our client.Our client is one of the world’s leading providers of reinsurance, insurance, and other forms of insurance-based risk transfer, working to make the world more resilient.This is a unique opportunity to take the lead on a transformative project, collaborating with a talented team to deliver innovative solutions using industry-leading technologies.**Responsibilities**- Collaborate with cross-functional teams to design, build, and implement scalable data solutions on the Palantir platform, while acting as a technical leader to drive alignment on best practices- Lead the development and optimization of Spark-based data pipelines, ensuring high performance for large-scale data processing and mentoring the team to maintain quality standards- Establish coding guidelines and standards while writing efficient and clean Python code to support team workflows- Utilize PySpark for advanced data manipulation and transformation within distributed frameworks; provide guidance and troubleshooting on complex tasks- Conduct root cause analysis on internal and external data to address business questions, while driving the team to identify and execute improvement opportunities- Define and oversee the implementation of DevOps/DataOps practices, such as Agile workflows, sprint planning, continuous integration, and deployment strategies- Architect scalable and reusable data models and structures, ensuring they align with current and future business requirements- Oversee relational database operations with a focus on advanced query optimization, while actively supporting team members to develop database skills- Serve as a trusted advisor, providing strategic and technical expertise to evaluate solutions and make high-impact decisions- Communicate effectively with key stakeholders, ensuring project alignment, scope clarity, and excellence in delivery- Mentor Junior and Mid-level Engineers on technical execution, project strategy, and data engineering best practices- Promote a culture of innovation within the team, encouraging experimentation with new tools and driving continuous learning**Requirements**:- 5+ years of experience in Data Software Engineering- Leadership experience exceeding 1 year applicable to the role- Proven hands-on expertise with Palantir, PySpark, and Python- Deep knowledge of Spark data pipelines and optimization in large-scale and diverse environments- Advanced proficiency in relational databases and SQL query optimization, with proven experience working across various database platforms- Strong background in data analysis and analytics, with a track record of performing root cause analysis on critical business processes and transformations- Demonstrated expertise in implementing and overseeing DevOps/DataOps methodologies, including Agile project management, sprint planning, and CI/CD architectures- Ability to translate detailed business requirements into strategic technical decisions, while fostering a systematic and solutions-driven approach- Strong leadership and interpersonal communication skills, with the ability to build positive relationships across teams and stakeholders- Excellent command of English (B2+ level), both written and spoken, with a strong emphasis on technical communication skills**Nice to have**- Familiarity with insurance, reinsurance, or financial industries- Hands-on experience with Azure Databricks- Experience working with Azure Data Services**We offer**- Career plan and real growth opportunities- Unlimited access to LinkedIn learning solutions- International Mobility Plan within 25 countries- Constant training, mentoring, online corporate courses, eLearning and more- English classes with a certified teacher- Support for employee’s initiatives (Algorithms club, toastmasters, agile club and more)- Enjoyable working environment (Gaming room, napping area, amenities, events, sport teams and more)- Flexible work schedule and dress code- Collaborate in a multicultural environment and share best practices from around the globe- Hired directly by EPAM & 100% under payroll- Law benefits (IMSS, INFONAVIT, 25% vacation bonus)- Major medical expenses insurance: Life, Major medical expenses with dental & visual coverage (for the employee and direct family members)- 13 % employee savings fund, capped to the law limit- Grocery coupons- 30 days December bonus- Employee Stock Purchase Plan- 12 vacations days plus 4 floating days- Official Mexican holidays, plus 5 extra holidays (Maundry Thursday and Friday, November 2nd, December 24th & 31st)- Monthly non-taxable amount for the electricity and internet billsEPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our commun