Lead Data Engineering

Description
LEAD
Data Engineering - Data Solutions
Mexico City | Mex

Role Description
As a Lead Data Engineer in the Data Solutions, Sales Pillar, you will be responsible for building complex data pipelines, data modelling, full-stack engineering, and integrating third-party APIs in alignment with our Future State Architecture. Our goal is to ensure excellence in scalability and performance while delivering a top-tier user experience. The ideal candidate will have a proven track record in data engineering, software development and a strong passion for creating innovative solutions that meet the evolving needs of our users.

This job requires that you be a quick learner, and self-starter with the ability to work under pressure, meet aggressive deadlines, and handle multiple projects/tasks simultaneously. You should have the ability to work in a fun, creative, and fast-paced environment. You are aware of trends and technical developments in the industry, and how those can be applied in your work, and have a point of view on the delivery approach for very complex or foundational features.

"You build it, you own it." Our engineering teams are responsible for the ongoing maintenance of our apps. Therefore this role also requires active engagement on deployments, monitoring, incident management and response, vendor oversight, and general ongoing operations activities.

In This Role, We Require Someone Who Can

• Build new and exciting components in an ever-growing and evolving market technology to provide scale and efficiency.
• Efficiently leverage evolving technologies and platforms to build highly scalable solutions that meet current and future business needs.
• Work in a Hybrid Engineering model and contribute to all phases of SDLC including design, discovery, implementation, code reviews, automation, and testing.
• Drive continuous improvement with a focus on process, controls, scalability, and maturity.
• Lead your team by example in using engineering best practices and in understanding risks and making relevant trade-offs. Follow and enable best practices for software development, including design patterns, code reviews, testing, launch strategies and documentation.
• Collaborate closely with Engineering Managers and serve as the technical leader for the team. Collaborate with Architects and Lead Engineers in the application design process, contributing innovative ideas and technical expertise in designing scalable systems.
• Engage with Product Managers to clarify customer requirements, propose viable workarounds, and understand related priorities better.
• Collaborate closely with cross-functional teams, including product managers, designers, and engineering teams, to deliver exceptional user experiences.
• Mentor and inspire team members through code reviews and dedicated knowledge sessions, fostering a culture of continuous learning and growth. You'll provide guidance and support to junior engineers, sharing your knowledge and expertise to help them thrive in their roles.
• Drive technical excellence and innovation establishing and upholding high standards for code quality, scalable architecture, performance, and reliability.
• Design and implement data architectures that align with business requirements and long-term goals. Develop data models, and schemas to support current and future integrations.
• Thrive in a culture of high ownership, accountability, delivery, and innovation.

Required
Experience and Skills

• 10+ years of professional software development experience in designing, building, scaling, and maintaining distributed production systems.
• At least 2+ years of hands-on technical leadership, driving the architecture and design of scalable and high-availability systems.
• Create and maintain scalable data pipelines to support ongoing data processing and analytics needs.
• Design and implement effective data models to ensure data integrity, performance, and scalability.
• Integrate data from various sources, including third-party APIs, to ensure comprehensive data availability.
• Utilize strong programming skills, particularly in Python, to develop and maintain data engineering solutions.
• Develop and manage integrations with third-party APIs to enhance data capabilities and ensure seamless data flow.
• Implement and manage data workflows using scheduling tools like Apache Airflow and DBT to automate and streamline data processes.
• Optimize data processing and storage for performance, scalability, and cost-efficiency.
• Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
• Implement and enforce data quality standards and governance policies to ensure data accuracy and reliability.
• Provide technical guidance and mentorship to junior data engineers and other team members.
• Maintain comprehensive documentation of data architecture, processes, and workflows.
• Identify and resolve data-related issues, ensuring minimal disruption to business operations.
• Build and optimize data solutions for AI applications, ensuring data is effectively utilized by both humans and AI agents.
• Engage with various teams and stakeholders to ensure alignment and effective communication across the organization.
• Stay updated with the latest industry trends and technologies to continuously improve data engineering practices and solutions.

Desired

• Knowledge of object-oriented programming (such as Java) and scripting languages (such as NodeJs).
• Hands-on experience using DBT.
• Knowledge of Heroku platform and Add-ons (Redis, Postgres)
• Experience with Salesforce CRM
• Experience with Salesforce Data Cloud
• Knowledge of large language models (LLMs) and agents
• Full-stack software development experience