Lead Data Engineer

**Description**

Our Information Technology Group is seeking a **Lead Data Engineer** to join our team in Guadalajara to onboard and support growth needs.

**The Lead Data Engineer role will**:

- Work with the data architect and data engineering teams to design and build a BI and analytics solutions
- Implement batch and real time data movement design patterns and define best practices in data engineering.
- Lead a team of developers with deep experience in distrusted architecture patterns, big data processing frameworks.
- Design and develop optimal cloud data solutions (lakes, warehouses, marts, analytics) by collaborating with diverse IT teams including business analysts, project managers, architects, developers, or vendors
- Work closely with data engineers and data analysts to procure, blend and analyze data for quality and distribution; ensuring key elements are harmonized and modeled for effective analytics, while operating in a fluid, rapidly changing data environment
- Demonstrate strong conceptual, analytical, and problem-solving skills and ability to articulate ideas and technical solutions effectively to external IT partners as well as internal data team members
- Work with cross-functional teams, on-shore/off-shore, development/QA teams/Vendors in a matrixed environment for data delivery
- Update and maintain key data cloud solution deliverables and diagrams
- Ensure conformance and compliance using Georgia-Pacific data architecture guidelines and enterprise data strategic vision
- Review Data Platform (Redshift) health and develop roadmap.
- Establish standards for data warehouse, Python, PySpark
- Assist with implementing and supporting a BI release management process (CICD)
- Ensure developers are adhering to standards
- Monitor and improve data pipeline health
- Assisting with design/build BI and data solutions for project Catalyst and other key projects.
- Conduct Code Reviews, peer reviews and must be able to direct/mentor the Developers.

**What we need from you**:

- Minimum of 10 plus years of overall IT experience
- 8+ years of experience with a modern programming language such as Python, Java, or Scala
- Design, develop implementation patterns which can be cross shared across Segments.
- At least 8+ of hands-on experience in designing, implementing, managing large-scale data and ETL solutions with AWS IaaS and PaaS Compute, Storage, and Database services (S3, RDS, Lambda, IAM, RedShift, Glue, EMR, Kinesis, Athena).
- Hands on experience in Cloud monitoring stack like CloudTrail, CloudWatch and AWS Event-bridge trigger service.
- 5+ years of data warehousing experience on Redshift, AWS PostgreSQL, NoSQL - DynamoDB
- 4+ years of experience with UNIX/Linux including basic commands and shell scripting
- Design, Develop, Test, and deploy Pipelines with Batch, Real-time and Near Realtime capabilities across our Segments.
- 4+ years of experience in leading and delivering a data analytics project end to end
- Strong knowledge of Data Engineering, Data Warehousing, and database concepts
- Solids understanding of big data processing architectures, designing data intensive pipelines.
- Agile practice and excellent verbal and written communication skills.

**Preferred Qualifications**:

- AWS certifications like Solution Architect (SAA/SAP) or Data Analytics Specialty (DAS)
- Hands-on experience with AWS data technologies and at least one full life cycle project experience in building a data solution in AWS.
- Understanding of common DevSecOps/DataOps and CICD processes, methodologies, and technologies like GitLab, Terraform etc.
- Strong knowledge in PySpark, SQL and Redshift store procedures, Kinesis and AWS Glue service.
- Expertise with AWS integrations leveraging Spark.

Koch Global Solutions (KGS) is the global problem solver of business needs for Koch Industries. We serve more than 120,000 employees worldwide and partner with 11 Koch companies from diverse industries: from making fabric to manufacturing cell phone components. Since 2003 Koch has invested over $80 billion in acquisitions and other capital expenditures and are proud to reinvest more than 90% of our earnings back into our companies. Our culture is defined by the Principle-Based Management (PBM)® philosophy which guides everyday decision making and provides employees with opportunities to contribute and personally benefit from the value they create.