Senior Databricks Developer Data Engineer
hace 5 días
Senior Databricks Developer / Data Engineer Minimum 5 Years Experience on Cloud Platforms (AWS Azure) Position Overview We are seeking a highly skilled and experienced Databricks Developer / Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of hands‑on experience working with Databricks on leading cloud platforms such as AWS and Azure. You will be responsible for designing, building and optimizing scalable data pipelines, collaborating with cross‑functional teams and driving data‑driven decision making across the organization. Key Responsibilities Design, develop and maintain scalable data pipelines and ETL processes using Databricks on AWS and Azure. Optimize Spark jobs for performance, reliability and cost‑efficiency. Integrate Databricks workflows with cloud‑native storage solutions (S3 / ADLS). Implement data quality validation and governance best practices. Collaborate with data scientists, analysts and business stakeholders to understand requirements and deliver solutions. Troubleshoot and resolve issues in production data pipelines. Document technical solutions and create knowledge‑sharing materials for the team. Must Have Skills Databricks Platform Expertise: 5 years of hands‑on experience developing solutions on Databricks including workspace management, notebook development, job scheduling and cluster configuration. Cloud Platform Experience: Proven experience in deploying and managing Databricks environments on AWS and Azure. Apache Spark: Advanced knowledge of Spark (PySpark/Scala/SQL) for data processing and analytics. ETL & Data Pipeline Development: Expertise in building robust ETL processes and data pipelines. Programming Languages: Proficiency in Python and/or Scala. Cloud Storage Integration: Experience integrating with S3, ADLS or similar cloud storage services. SQL Skills: Strong ability to write and optimize complex SQL queries. Data Modeling: Solid understanding of data modeling concepts and best practices. Version Control: Familiarity with Git or similar version control systems. Problem Solving: Excellent troubleshooting and analytical skills. Good to Have Skills Experience with CI/CD pipelines and DevOps practices for data engineering. Knowledge of Delta Lake and advanced Databricks features (e.g. MLflow, Databricks SQL). Experience with other cloud platforms (Google Cloud Platform etc.). Exposure to data visualization tools (Power BI, Tableau etc.). Understanding of data security compliance and privacy standards. Hands‑on experience with streaming data (Kafka, Spark Streaming). Familiarity with REST APIs and data integration patterns. Ability to mentor junior team members and conduct code reviews. Experience with infrastructure as code (Terraform, CloudFormation). Qualifications Bachelor's or Master’s degree in Computer Science, Engineering or related field. Minimum 5 years of experience in Databricks development on AWS and/or Azure. Strong communication skills and ability to work in a collaborative environment. Relevant certifications (Databricks, AWS, Azure) are a plus. Location & Work Environment Hybrid work options available. Occasional travel may be required for team meetings or project kick‑offs. Key Skills Apache Hive, S3, Hadoop, Redshift, Spark, AWS, Apache Pig, NoSQL, Big Data, Data Warehouse, Kafka, Scala Employment Type Full Time Experience years Vacancy 1 #J-18808-Ljbffr
-
Senior Databricks Data Engineer
hace 3 días
Mexico City Kutir Technologies A tiempo completoA technology services company is seeking a Senior Databricks Developer / Data Engineer in Mexico City. The ideal candidate will have over 5 years of hands-on experience with Databricks on AWS and Azure. Responsibilities include designing and optimizing data pipelines, collaborating with teams, and driving data-driven decisions. This full-time role offers...
-
Life Sciences Data Engineer
hace 3 días
Mexico City Pyramid Consulting, Inc A tiempo completoA leading IT consultancy in Mexico City is seeking a skilled Data Engineer / BI Developer. You will design and maintain ETL pipelines, process data using Python and Databricks, and generate BI reports while ensuring compliance with data governance standards. The role requires strong skills in SQL and a good understanding of regulatory requirements in the...
-
Senior Data Engineer — Azure Data Factory
hace 3 días
Mexico City CAPGEMINI MEXICO A tiempo completoA leading technology consulting firm in Mexico is seeking a Senior Data Engineer to enhance their Innovation & Development team. The position requires a strong background in Databricks, SQL, and Azure Data Factory alongside 5+ years of experience in data engineering. The selected candidate will be responsible for developing scalable data pipelines, adapting...
-
Data QA Engineer
hace 3 días
Mexico City Kutir Technologies A tiempo completoData QA Engineer Databricks Development & Migration Projects Supporting Databricks Initiatives on AWS and Azure Cloud Platforms Position Overview We are seeking an experienced Data QA Engineer to join our team and support Databricks development and migration projects. The ideal candidate will have a minimum of 5 years of hands‑on experience working with...
-
Data QA Engineer
hace 3 días
Mexico City Kutir Technologies A tiempo completoData QA Engineer Databricks Development & Migration Projects Supporting Databricks Initiatives on AWS and Azure Cloud Platforms Position Overview We are seeking an experienced Data QA Engineer to join our team and support Databricks development and migration projects. The ideal candidate will have a minimum of 5 years of hands‑on experience working with...
-
Senior Data Engineer
hace 3 días
Mexico City W3Global A tiempo completoA leading staffing firm is seeking a Data Engineer to design and maintain scalable data pipelines, utilizing Azure Data Factory and Azure Databricks. The ideal candidate must have 10 to 15 years of experience and possess strong skills in Python and SQL. This full-time position offers the opportunity to collaborate with data architects to deliver actionable...
-
Data Engineer
hace 3 días
Mexico City W3Global A tiempo completoData Engineer at W3Global Join to apply for the Data Engineer role at W3Global. Responsibilities Design, build, and maintain scalable and efficient ETL/ELT data pipelines using Azure Data Factory and Azure Databricks. Write complex, high-performance SQL queries and scripts for data extraction, transformation, and loading. Implement data transformation logic...
-
Data Engineer
hace 5 días
Mexico City W3Global A tiempo completoData Engineer at W3Global Join to apply for the Data Engineer role at W3Global. Responsibilities Design, build, and maintain scalable and efficient ETL/ELT data pipelines using Azure Data Factory and Azure Databricks. Write complex, high-performance SQL queries and scripts for data extraction, transformation, and loading. Implement data transformation logic...
-
Senior Data Engineer
hace 4 semanas
Mexico City Azka IT A tiempo completoAzkait es una empresa Mexicana que busca y conecta el mejor talento IT con empresas Latinoamericanas y de Estados Unidos. Estamos en la búsqueda de tu talento como Senior Data Engineer / BI Engineer. Requisitos Licenciatura o Ingeniería pasante / titulado. Inglés conversacional intermedio avanzado (B2, C1, C2). Experiencia de 5 años o mayor como Data...
-
Senior Data Engineer
hace 4 semanas
Mexico City Azka IT A tiempo completoAzkait es una empresa Mexicana que busca y conecta el mejor talento IT con empresas Latinoamericanas y de Estados Unidos. Estamos en la búsqueda de tu talento como Senior Data Engineer / BI Engineer. Requisitos Licenciatura o Ingeniería pasante / titulado. Inglés conversacional intermedio avanzado (B2, C1, C2). Experiencia de 5 años o mayor como Data...
