Databricks Developer

hace 2 días

Ciudad de México, Ciudad de México Quadrant Technologies A tiempo completo

Job Description: Senior Databricks Developer / Data Engineer

Minimum 5+ Years Experience on Cloud Platforms (AWS, Azure)

Position Overview

We are seeking a highly skilled and experienced Databricks Developer / Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of hands-on experience working with Databricks on leading cloud platforms such as AWS and Azure. You will be responsible for designing, building, and optimizing scalable data pipelines, collaborating with cross-functional teams, and driving data-driven decision making across the organization.

Key Responsibilities


• Design, develop, and maintain scalable data pipelines and ETL processes using Databricks on AWS and Azure.


• Optimize Spark jobs for performance, reliability, and cost-efficiency.


• Integrate Databricks workflows with cloud-native storage solutions (S3, ADLS).


• Implement data quality, validation, and governance best practices.


• Collaborate with data scientists, analysts, and business stakeholders to understand requirements and deliver solutions.


• Troubleshoot and resolve issues in production data pipelines.


• Document technical solutions and create knowledge-sharing materials for the team.

Must Have Skills


• Databricks Platform Expertise: 5+ years of hands-on experience developing solutions on Databricks, including workspace management, notebook development, job scheduling, and cluster configuration.


• Cloud Platform Experience: Proven experience in deploying and managing Databricks environments on AWS and Azure.


• Apache Spark: Advanced knowledge of Spark (PySpark/Scala/SQL) for data processing and analytics.


• ETL & Data Pipeline Development: Expertise in building robust ETL processes and data pipelines.


• Programming Languages: Proficiency in Python and/or Scala.


• Cloud Storage Integration: Experience integrating with S3, ADLS, or similar cloud storage services.


• SQL Skills: Strong ability to write and optimize complex SQL queries.


• Data Modeling: Solid understanding of data modeling concepts and best practices.


• Version Control: Familiarity with Git or similar version control systems.


• Problem Solving: Excellent troubleshooting and analytical skills.

Good to Have Skills


• Experience with CI/CD pipelines and DevOps practices for data engineering.


• Knowledge of Delta Lake and advanced Databricks features (e.g., MLflow, Databricks SQL).


• Experience with other cloud platforms (Google Cloud Platform, etc.).


• Exposure to data visualization tools (Power BI, Tableau, etc.).


• Understanding of data security, compliance, and privacy standards.


• Hands-on experience with streaming data (Kafka, Spark Streaming).


• Familiarity with REST APIs and data integration patterns.


• Ability to mentor junior team members and conduct code reviews.


• Experience with infrastructure as code (Terraform, CloudFormation).

Qualifications


• Bachelor's or Master's degree in Computer Science, Engineering, or related field.


• Minimum 5 years of experience in Databricks development on AWS and/or Azure.


• Strong communication skills and ability to work in a collaborative environment.


• Relevant certifications (Databricks, AWS, Azure) are a plus.

  • Databricks Developer

    hace 2 días

    Ciudad de México, Ciudad de México Quadrant Technologies A tiempo completo

    Job Description: Senior Databricks DeveloperMinimum 5+ Years Experience on Cloud Platforms (AWS, Azure)Position OverviewWe are seeking a highly skilled and experienced Databricks Developer / Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of hands-on experience working with Databricks on leading cloud platforms such as AWS...

  • MuleSoft Developer

    hace 3 semanas

    Ciudad de México, Ciudad de México Argano A tiempo completo

    DescriptionIntroduction:We are seeking a skilled and motivated MuleSoft Developer to join our dynamic IT team. In this role, you will be responsible for designing, developing, and deploying integration solutions that enable seamless communication between applications and systems. You'll work on creating new integration use cases, while also supporting and...

  • MuleSoft Developer

    hace 2 días

    Ciudad de México, Ciudad de México Argano A tiempo completo

    Introduction:We are seeking a skilled and motivated MuleSoft Developer to join our dynamic IT team. In this role, you will be responsible for designing, developing, and deploying integration solutions that enable seamless communication between applications and systems. You'll work on creating new integration use cases, while also supporting and maintaining...

  • MuleSoft Developer

    hace 1 semana

    Ciudad de México, Ciudad de México Argano A tiempo completo

    IntroductionJOB DESCRIPTIONWe are seeking a skilled and motivatedMuleSoft Developerto join our dynamic IT team. In this role, you will be responsible for designing, developing, and deploying integration solutions that enable seamless communication between applications and systems. You'll work on creating new integration use cases, while also supporting and...

  • etl developer

    hace 2 días

    Ciudad de México, Ciudad de México Zurich Insurance A tiempo completo

    ZCCZurich Capability Center is currently hiring a:ETL Developer / LeadWe are looking for aSenior ETL Developer / Leadwith extensive experience inInformatica PowerCenterto join our data engineering team. In this role, you will not onlybuild, optimize, and integrate robust data pipelinesbut alsoguide technical decisions and mentor junior team members,...

  • ETL Developer

    hace 2 días

    Ciudad de México, Ciudad de México LiveWell A tiempo completo

    #ZCCZurich Capability Center is currently hiring a:IPC DEVELOPERWe are looking for a Senior ETL Developer / Lead with extensive experience in Informatica PowerCenter to join our data engineering team. In this role, you will not only build, optimize, and integrate robust data pipelines but also guide technical decisions and mentor junior team members,...

  • etl developer

    hace 3 semanas

    Ciudad de México, Ciudad de México Zurich Insurance A tiempo completo

    ZCCZurich Capability Center is currently hiring a:IPC DEVELOPERWe are looking for aSenior ETL Developer / Leadwith extensive experience inInformatica PowerCenterto join our data engineering team. In this role, you will not onlybuild, optimize, and integrate robust data pipelinesbut alsoguide technical decisions and mentor junior team members,...

  • Audit Senior Analytics Developer

    hace 2 días

    Ciudad de México, Ciudad de México PepsiCo A tiempo completo

    OverviewWe Are PepsiCo  Join PepsiCo and Dare for Better We are the perfect place for curious people, thinkers and change agents. From leadership to front lines, we're excited about the future and working together to make the world a better place.  Being part of PepsiCo means being part of one of the largest food and beverage companies in the world,...

  • Audit Senior Analytics Developer

    hace 3 semanas

    Ciudad de México, Ciudad de México PepsiCo A tiempo completo

    OverviewWe Are PepsiCoJoin PepsiCo and Dare for Better We are the perfect place for curious people, thinkers and change agents. From leadership to front lines, we're excited about the future and working together to make the world a better place.Being part of PepsiCo means being part of one of the largest food and beverage companies in the world, with our...

  • FullStack Developer 144

    hace 2 días

    Ciudad de México, Ciudad de México Stefanini Latam A tiempo completo

    DescriptionSé parte de Stefanini​En Stefanini somos más de genios, conectados desde 41 países, haciendo lo que les apasiona y co-creando un futuro mejor.​ResponsibilitiesDesarrollador FullstackDescripción del Puesto5 o más años de experiencia desarrollando aplicaciones web, Dashboards BI, uso y administración de base de datos, versionamiento de...