Data Engineer- Inglés Avanzado

Buscas ser parte de una empresa innovadora, inclusiva y colaborativa, que valora tanto tu desarrollo profesional como el equilibrio entre tu vida personal y laboral, y que cuenta con diversidad de clientes líderes en varios sectores?Si es así, descubre la vacante que Deintec tiene para ti e impulsa tu carrera en ITPosición**:Data Engineer**Ubicación: CDMX, MéxicoEsquema: Híbrido en oficinas de CDMX AzcapotzalcoTipo de contrato: IndeterminadoHorario: Lunes a ViernesIdioma: Inglés avanzado conversacional requerido.C1, C2, Nativo.Escolaridad: Ingeniero computación, sistemas, etc.**Purpose of the position**The Data Engineer will join the Americas IT software and architecture team.This business centric IT team allows for business-focused development of new, cutting edge, solutions as well as integrating overall global/regional IT initiatives into the business.In this role, we are seeking a talented and motivated Data Engineer with hands-on experience in Apache Spark and MicrosoftFabric to join our dynamic data engineering team.In this role, you will be at the heart of our data initiatives, designing robust data pipelines, optimizing data architectures, and enabling data-driven decision-making across the organization.The Data Engineer would be expected to work independently and/or in conjunction with appropriate business unit/IT leaders or cross-functional teams during any engagement.They would be tasked with understanding technological and business problems and focused on delivering cutting-edge solutions.The Data Engineer must possess the ability to architect or integrate the appropriate solution from the ground up based on a set of business requirements.**Principal responsibilities**- Design and Develop Data Pipelines: Architect, build, and maintain scalable data pipelines leveraging Apache Spark and Microsoft Fabric to process large volumes of structured and unstructured data from diverse sources.- Data Integration: Integrate data from internal and external sources, ensuring accuracy, consistency, and reliability throughout the data lifecycle.- Performance Optimization: Monitor and optimize ETL/ELT processes for performance, scalability, and cost-efficiency, proactively identifying bottlenecks and implementing improvements.- Data Quality and Governance: Implement best practices for data quality, data cataloguing, and lineage, and support governance policies to ensure compliance and high standards.- Collaboration: Work closely with data scientists, analysts, business stakeholders, and cross-functional IT teams to gather requirements, deliver insights, and support analytical models.- Documentation: Prepare and maintain detailed documentation for data workflows, pipeline architectures, data schemas, and processes.- Continuous Improvement: Stay current with emerging trends and technologies in data engineering, suggesting and implementing innovative solutions to enhance the data platform.- Troubleshooting: Diagnose, debug, and resolve data pipeline and infrastructure issues to ensure robustness and reliability of the data ecosystem.- Security: Adhere to and enforce data security and privacy guidelines, ensuring sensitive data is handled appropriately.**Required critical behaviours**- Excellent problem-solving skills and meticulous attention to detail.- Strong communication and teamwork abilities, with a collaborative approach to project deliver**Required key skills****MANDATORIAS**- Proven experience working with Apache Spark for large-scale data processing (batch and streaming).- Hands-on expertise with Microsoft Fabric (formerly Power BI Dataflows, Data Factory within Fabric, or similar cloud-based data integration platforms).- Strong proficiency in SQL, Python, and/or Scala for data manipulation and ETL development.- Solid understanding of distributed systems, data warehousing, and data modeling concepts.- Demonstrated ability to design, implement, and optimize ETL/ELT- Bachelor's or Master's degree in Computer Science, Engineering, Information Systems, or a related field.- 2+ years of professional experience in data engineering, data architecture, or a related domain.- Experience with cloud platforms such as Microsoft Azure, AWS, or Google Cloud, with a preference for Azure.- Knowledge of data governance principles and data quality management.**Preferencial**- Knowledge of DevOps practices for data pipelines, including CI/CD, automated testing, and infrastructure as code.- Experience with real-time data processing and streaming frameworks (e.g., Kafka, Azure Event Hubs).P- Professional certifications in Apache Spark, Azure Data Engineering, or Microsoft Fabric/Power Platform.- Experience with data visualization and reporting tools (e.g., Power BI, Tableau).**Ofrecemos**:- Salario competitivo basado en experiência- Prestaciones Superiores a las de Ley (como: fondo de ahorro, caja de ahorro, SGMM, vales de despensa, etc.)- Oportunidad de cre