Data Engineer- Azure Data Bricks

The union of EPAM and NEORIS marks a significant turning point. Combining the English greeting 'Hello' with the Spanish greeting 'Hola', we reflect both companies' multicultural and global nature and a new way of collaborating, where EPAM leads globally, and NEORIS brings its client experience and regional knowledge in Latin America.

Estamos en búsqueda de Data Engineer- Azure Databricks

• We are looking for a skilled Data Engineer- Azure Databricks to join our Data & Analytics team in the US or Canada. The ideal candidate will have extensive experience in data engineering, working with Databricks and Azure cloud services, designing and implementing scalable Azure Cloud data solutions.
• You will play a crucial role in the development, optimization and maintenance of data pipelines and architectures, ensuring the quality and the availability of critical data through our Data Lake platform. You can work independently and as part of a team, with a strong desire to help shape our Data & Analytics platforms and strategy.

Key Responsibilities

The function consists of different responsibilities:

• Data Pipeline Engineering: Design, develop, and deploy robust and scalable data pipelines using Databricks, integrating data from various sources (databases, APIs, streaming platforms, etc.), transforming and cleaning data using SQL or Scala/Python and loading data into target systems (data lakes, data warehouses, etc.).
• Optimize pipeline performance for greater efficiency and cost-effectiveness.
• Databricks Expertise: Use all the capabilities of the Databricks platform, including Databricks SQL, Delta Lake, Databricks Runtime, and Databricks Workflows, to orchestrate complex data workflows and ensure data quality and pipeline reliability.
• Data Architecture and Modeling: Contribute to the design and implementation of robust data models in the data lake environment, ensuring data consistency, integrity and accessibility for various use cases.
• Data Quality Assurance: Implement rigorous data quality controls and validation procedures throughout the data pipeline to ensure high accuracy and reliability.
• Comply with the data governance policies and best practices.
• Cloud Integration: Seamlessly integrate Databricks with Azure cloud services for storage, compute and security, leveraging services like Azure Data Lake Storage.
• Continuous Learning: Stay up to date on the latest Databricks features, cloud technologies, and data engineering trends to continuously improve our solutions and deliver innovative results for our business.
• Collaboration and Communication: Work closely with data analysts, IT Front Line and business stakeholders to understand their data requirements and provide technical expertise on Databricks and data engineering best practices.

Key Competence Requirements

You will need to have:

• Bachelor's / Master's degree in Computer Science, (Business) Engineering, or a specialized master's in Machine Learning or AI.
• Proven Experience:7+ years of experience in data engineering with demonstrated expertise in Databricks and a focus on Azure Cloud Analytics Services. Proficiency in Azure Data Factory and Azure SQL Database acquired with Azure Data Lake. 5+ years of experience with Azure DevOps (git) with a solid experience with CI/CD pipelines.
• Understanding of data governance, quality and security best practices.
• Cloud Proficiency: Hands-on experience with Azure cloud platform with a good understanding of cloud data services and infrastructure.
• Programming Skills: Strong programming skills in SQL, Python or Scala with experience in data manipulation libraries (e.g., PySpark, Spark SQL).
• Data Fundamentals: Solid understanding of data warehousing principles, ETL processes, data modeling techniques and database systems.

• SQL Expertise: Advanced SQL skills for querying, transforming and analyzing data.

• Esquema remoto 100%

• Inglés avanzado (C1)
• EST TIME

Power Skills

• Liderazgo y gestión de equipos
• Resolución de problemas y diseño de soluciones
• Gestión del cambio
• Análisis de datos

Ofrecemos:

• Esquema 100% Nominal
• Prestaciones de Ley
• Paquete de Beneficios superiores.
• Programa Bienestar
• Plan de desarrollo profesional
• Colaboración multicultural

Te invitamos a conocernos en , Facebook, LinkedIn, Twitter o Instagram: @NEORIS.

Tipo de puesto: Tiempo completo

Sueldo: $70, $80,000.00 al mes

Beneficios:

• Aumentos salariales
• Caja de ahorro
• Descuento de gimnasio
• Descuentos y precios preferenciales
• Días por enfermedad
• Estacionamiento de la empresa
• Estacionamiento gratuito
• Programa de referidos
• Seguro de gastos médicos
• Seguro de gastos médicos mayores
• Seguro dental
• Vacaciones adicionales o permisos con goce de sueldo
• Vales de despensa

Idioma:

• Inglés avanzado (Obligatorio)

Lugar de trabajo: Empleo remoto