Senior Big Data Engineer

Hace 21 horas

méxico Apex Systems Jornada completa
  • Bachelor's degree in Computer Science, Engineering, Information Technology, or equivalent practical experience.
  • 6+ years of experience in Data Engineering, Big Data Engineering, or related disciplines.
  • Strong experience with Python for data engineering and pipeline development.
  • Hands-on experience with Apache Airflow for workflow orchestration (required ).
  • Advanced experience with Py Spark , Spark SQL , and distributed data processing.
  • Experience with Scala in data engineering environments.
  • Strong knowledge of relational and No SQL database technologies.
  • Experience writing and optimizing complex SQL queries.
  • Hands-on experience with Apache Kafka and event-driven architectures.
  • Experience building and supporting real-time data pipelines using Spark Streaming .
  • Strong experience with Google Cloud Platform (GCP) , specifically:
  • Big Query
  • Experience integrating RESTful APIs into data pipelines and data workflows.
  • Experience implementing CI/CD practices using Git Lab CI .
  • Strong understanding of data modeling, data quality, scalability, and performance optimization.
  • Excellent verbal communication and technical problem-solving skills.
  • Ability to explain design decisions and implementation approaches in a collaborative setting.