Lead Data Engineer Spark

Important IT company At the Latin American level, growth requires: Lead Data Engineer Senior / Lead-level Data Engineering Focus: Big Data, Cloud Data Platforms, Databricks, ETL/ELT Lead Data Engineer to design and implement scalable data analytics solutions across on-premises and cloud data platforms. The ideal candidate will have strong hands-on experience building production-grade data pipelines and Big Data solutions, with expertise in Python, Spark, SQL, Hadoop, and Databricks . This role combines hands-on engineering with technical leadership, including architecture discussions, code reviews, mentoring, and driving best practices across data engineering initiatives.

Key Responsibilities
Design and build scalable, cloud-native data platforms and pipelines . ETL/ELT pipelines integrating data from multiple systems and sources. Build production-grade data solutions using Python, Spark, SQL, and Databricks . Design modular, maintainable, and scalable data processing components. Lead code reviews and ensure engineering best practices, testing, and maintainability. Mentor and guide data engineers, promoting technical growth and knowledge sharing. data quality, governance, lineage, cataloging, and access management . Troubleshoot complex data and pipeline issues in production environments. Participate in planning, estimation, feature sizing, and technical discussions with cross-functional teams. production-grade data engineering solutions . Python, PySpark/Spark, and SQL . experience with Snowflake is a plus. Hadoop ecosystem , including technologies such as Experience developing and managing data pipelines using Apache Airflow, Apache NiFi, or Talend . ETL/ELT, data integration, and distributed data processing . Git, CI/CD, automated testing, and release pipelines . Experience troubleshooting and optimizing complex data pipelines and workloads. technical lead or senior technical contributor within data engineering teams. Ability to decompose complex data problems into scalable and maintainable solutions. Snowflake or additional cloud data platforms. Java-based applications . Experience with data governance, data cataloging, lineage, and observability. Experience designing or modernizing on-premises data platforms into cloud-based architectures. ADVANCED CONVERSATIONAL ENGLISH AND SPANISH ESSENTIAL (