Data Engineer

Hace 12 horas

distrito federal, México Tata Consultancy Services Limited Jornada completa

(Candidate must be available to work from Mexico City office [Av. Reforma] office 2 day per week)

Main responsibilities and activities:
  • Design, develop, test, and maintain scalable data pipelines and data products supporting Enterprise Credit Risk initiatives.
  • Build and optimize batch and real-time data processing solutions using modern cloud and lakehouse technologies.
  • Partner with Risk, Product, Data Science, and Engineering teams to understand business requirements and translate them into technical solutions.
  • Develop reusable frameworks, components, and engineering patterns that improve development efficiency and platform consistency.
  • Implement data quality controls, monitoring, alerting, and observability capabilities to ensure data reliability and trustworthiness.
  • Support the migration and modernization of existing data assets and workloads into Databricks and cloud-native platforms.
  • Build and maintain curated datasets that support lending decisioning, portfolio risk management, and advanced analytics use cases.
  • Participate in architecture discussions and contribute technical recommendations for platform enhancements.
  • Troubleshoot production issues and drive root cause analysis to improve platform reliability and performance.
  • Follow engineering best practices for code quality, testing, deployment automation, security, and operational excellence.
  • Mentor junior engineers through code reviews, technical guidance, and knowledge sharing.
  • Continuously evaluate opportunities to improve scalability, performance, cost efficiency, and maintainability of data platforms.
  • Advanced English communication
  • Strong experience developing and maintaining enterprise-scale data engineering solutions.
  • Hands-on experience with Databricks, Apache Spark, PySpark, Hadoop, SQL, and Python.
  • Experience building ETL/ELT pipelines and large-scale data processing applications.
  • Experience working with cloud-based data platforms and storage technologies.
  • Strong understanding of data modeling concepts and analytical data structures.
  • Experience implementing automated testing, monitoring, and data quality practices.
  • Experience with Data formats ( Parquet, Avro, ORC )
  • Knowledge of CI/CD pipelines, Git-based development workflows, and DevOps principles.
  • Experience with Workflow orchestration Tools like Airflow
  • Strong analytical and problem-solving skills with the ability to work independently on complex technical challenges.
  • Knowledge of Java Based application development is a huge Plus.

We are offering:

  • Direct contract
  • Benefits of law and above

Tata Consultancy Services is an equal opportunity employer, our commitment to diversity & inclusion drives our efforts to provide equal opportunity to all candidates who meet our required knowledge & competency needs, irrespective of any socio-economic background, race, color, national origin, religion, sex, gender identity/expression, age, marital status, disability, sexual orientation or any others. We encourage anyone interested to build a career in TCS to participate in our recruitment & selection process.