Data Platform Engineer Databricks Senior
hace 1 mes
MercerTech DnAi Platform engineering team is seeking candidates for the following position based in the CDMX office and be onsite 3 days a week: Sr. Data Platform Engineer
MercerTech DnAi Platform engineering team is seeking an experienced Mid-Level Data Platform Engineer with experience on data with AWS cloud who has expertise in the administration, development and implementation of large-scale data projects in the hybrid data platform (on-prem and cloud both).
What can you expect?- You will be responsible for overseeing the design, implementation, and maintenance of the data platform built on Kubernetes, AWS services and other SAAS solutions.
- You will be responsible to set up the platform and its toolkit like Databricks, Snowflake, IDMC with the best possible standards for different projects to work on it.
- You will also collaborate with projects’ business teams to understand their requirements, technical needs and help the team design their architecture using the combination of data tools aligning with MMC’s technology standards and security.
- You will also be involved in onboarding new technologies onto the platform and ensuring smooth operations through regular maintenance, governance, and guideline definition.
- You should be an expert in ETL processing toolsets to guide the developers to optimize their jobs.
- A company with a strong Brand and strong results to match.
- Culture of internal mobility, collaboration and valued partnership from the business.
- Employee Resource Groups which provide access to leaders, relevant volunteer and mentoring opportunities and interactions with counterparts in industry groups and client organizations.
- Entitled to vacation, floating holidays, time off to give back to your community, sick days, and national holidays (with early dismissal).
- Work with our partners to understand business and technology problems or opportunities.
- Conceptualize and implement the setup and management of the data platform built on Kubernetes, AWS services and other cloud SaaS solutions like Databricks, Snowflake, IDMC, Mongo Atlas across different regions.
- Configure and optimize the tech stack including Spark, NiFi, Python, R, Databricks, IDMC by Informatica, Snowflake AWS S3, Glue, and Athena for efficient performance and scalability to create the best-in-class data ingestion and processing data platform.
- Understand the data landscape i.e., tooling, tech stack, source systems etc. and work closely with development teams to improve data collection, quality, reporting and analytics capabilities.
- Provide guidance on selecting the appropriate tools in appropriate AWS regions to meet project objectives and performance requirements.
- Set up the skilled team who can support the projects to build efficient data pipelines.
- Collaborate with analytics and business teams to suggest and improve the data platform that supports business intelligence tools, increasing data accessibility, and fostering data-driven decision-making across the organization.
- Collaborate with different stakeholders like MMC infra, MMC security, MMC architecture teams to achieve high availability and scalability over the data platform.
- Continuous learning and implementation of the latest technologies.
- Troubleshoot incidents, identify root causes, fix, and document problems, and implement preventive measures.
- Set up processes, guidance, and documentation necessary to share the best practices guidelines for others to follow.
- Work with the data governance team on technology obsolescence, component re-use, and platform modernization.
- Crisis management and problem-solving.
- Be innovative in your design thinking and use your expertise to influence the MMC technology roadmap.
- Take your architectural designs through our onboarding processes to ensure they meet MMC’s standards and conventions.
- Empower the development teams to deliver your architectural designs.
- Bachelor's or Master's degree in Computer Science, Engineering, or related field.
- Extensive experience in data engineering roles with a focus on building and managing data platforms.
- Exposure to Big Data / Data Lake frameworks like Spark, Spark Streaming, Python, R, NiFi, AWS S3, Redshift, Glue, Athena etc and tools like Databricks, IDMC, Snowflake, MongoDB.
- Understanding of BI Tools like PowerBI, Qlik is an added advantage.
- Excellent communication and collaboration skills with the ability to work effectively with cross-functional teams.
- Ability to design and architect the solution when provided with the business requirement.
- An inquisitive mindset with a track record of seeking out and implementing new technologies and architectural patterns.
- Self-motivated to excel in a remote position, collaborating effectively with a remote team.
- You are a self-starter; you can take initiative without waiting for direction.
- Ability to take decisions during a crisis.
- The ability to work in a fast-paced environment with changing priorities and deadlines.
- You are used to working and communicating with both business and technical stakeholders at varying levels of seniority.
- Strong AWS experience.
- Experience in either one of Databricks or Snowflake.
- Experience in Informatica data quality and governance tools (IDMC).
If you are interested, please send your CV in English.
Interviews will be held in English.
#J-18808-Ljbffr-
Data platform engineer
hace 1 mes
distrito federal, México MX003 Marsh And Mclennan Servicios S.A. De Cv A tiempo completoDescription : MercerTech DnAi Platform engineering team is seeking candidates for the following position based in the CDMX office and be onsite 3 days a week : Sr. Data Platform Engineer MercerTech DnAi Platform engineering team is seeking an experienced Mid-Level Data Platform Engineer with expertise in data and AWS cloud who has experience in the...
-
distrito federal, México Zillow A tiempo completoSenior Software Development Engineer, Databricks and AI Platform About the team AI products at Zillow help millions of people find the best home for them with less stress and more visibility. Zillow scientists develop a variety of ML models (natural language understanding, computer vision, recommendation systems) that enables our customers to find and move...
-
Senior Data Engineer/Data Architect
hace 1 mes
distrito federal, México LAAgencia A tiempo completoSenior Data Engineer/Data Architect (Azure) Mexico Tasks: Implement data ingestion pipelines from multiple data sources using Azure Data Factory, Azure Databricks and other ETL tools. Develop scalable and re-usable, self-service frameworks for data ingestion and processing. Design, build, and manage SQL Server databases in the Azure cloud. Perform data...
-
Cloud Data Engineer Lead
hace 1 mes
distrito federal, México MX003 Marsh And Mclennan Servicios S.A. De Cv A tiempo completoDescription : MMC is seeking candidates for the following position based in the Mexico City office and be onsite 3 days a week : Cloud Data Engineer Lead / Data Engineering Lead What can you expect? The Cloud Data Engineer Lead will lead a small team, and be part of a very talented large team building data ingestion and transformation pipelines in the...
-
Data Visualization Platform Engineer
hace 1 mes
distrito federal, México Takeda Pharmaceuticals A tiempo completoJob Description Join our team and make an impact on patients’ lives We strive to create an exceptional people experience for patients, communities, partners, and employees. As a patient-focused, values-based, R&D-driven global biopharmaceutical company, we know our decisions and actions affect people’s lives. We look to our values of Takeda-ism, which...
-
Senior Data Integration Engineer
hace 4 semanas
distrito federal, México EPAM Systems A tiempo completoWe are in search of a Senior Data Integration Engineer with expertise in ETL/ELT solutions, SQL, data visualization, Google Cloud Platform, and Pentaho BI. Your primary role will involve supporting the entire data pipeline, identifying and resolving issues with data sources, understanding the logic behind queries, and communicating effectively with key...
-
Data Visualization Platform Engineer
hace 1 mes
distrito federal, México Takeda Pharmaceutical A tiempo completoBy clicking the “Apply” button, I understand that my employment application process with Takeda will commence and that the information I provide in my application will be processed in line with Takeda’s Privacy Notice and Terms of Use. I further attest that all information I submit in my employment application is true to the best of my knowledge. Job...
-
Data Visualization Platform Engineer
hace 1 mes
distrito federal, México Takeda A tiempo completoJoin our team and make an impact on patients’ lives We strive to create an exceptional people experience for patients, communities, partners, and employees. As a patient-focused, values-based, R&D-driven global biopharmaceutical company, we know our decisions and actions affect people’s lives. We look to our values of Takeda-ism, which incorporates...
-
Senior Software Development Engineer
hace 4 semanas
distrito federal, México Zillow A tiempo completoSenior Software Development Engineer - Big Data Apply Remote Type: Remote Location: Mexico City Time Type: Full time Posted on: Posted 30+ Days Ago Job Requisition ID: P744612 About the team Zillow’s Comprehensive Customer Data team is part of the Data Engineering organization and works closely with multiple product and analytics organizations. You...
-
Trending Now Staff Data Engineer
hace 4 semanas
distrito federal, México WIZELINE A tiempo completoStaff Data Engineer (Spark and Databricks Advanced) Wizeline is a global digital services company helping mid-size to Fortune 500 companies build, scale, and deliver high-quality digital products and services. We thrive in solving our customer’s challenges through human-centered experiences, digital core modernization, and intelligence everywhere (AI/ML...
-
Data Engineering Senior Analyst
hace 1 mes
distrito federal, México MX003 Marsh And Mclennan Servicios S.A. De Cv A tiempo completoDescription : We are MarshMcLennan, we offer consulting and risk management services, insurance brokerage and insurance program management for different sectors of the economy through the business units: Marsh, Mercer, Guy Carpenter and Oliver Wyman. At Marsh we are looking for candidates for the following position located in México City: Data Engineering...
-
Senior Software Engineer, Big Data
hace 4 semanas
distrito federal, México Zillow A tiempo completoSenior Software Engineer, Big Data Apply Remote Type: Remote Locations: Mexico City Time Type: Full Time Posted on: Posted 19 Days Ago Job Requisition ID: P745475 About the Team Zillow’s Customer Linking and Identity Platform team is part of the Data Engineering organization and works closely with multiple product and analytics organizations. You...
-
Senior Data Scientist
hace 1 mes
distrito federal, México Blue Orange Digital A tiempo completoCompany overview: Blue Orange Digital is a cloud-based data transformation and predictive analytics development firm with offices in NYC and Washington, DC. From startups to Fortune 500s, we help companies make sense of their business challenges by applying modern data analytics techniques, visualizations, and AI/ML. Founded by engineers, we love passionate...
-
Machine Learning Senior Engineer
hace 1 mes
distrito federal, México PayJoy A tiempo completoPayJoy is a mission-first financial service provider dedicated to helping under-served customers in emerging markets to achieve financial stability and success. We lend through our patented technology that turns a smartphone into digital collateral, and our cutting-edge machine learning, data science, and anti-fraud AI allow us to offer the lowest cost and...
-
Data Engineering Senior Analyst
hace 4 semanas
distrito federal, México Marsh McLennan A tiempo completoCompany: MMC Corporate Description: We are MarshMcLennan, offering consulting and risk management services, insurance brokerage, and insurance program management for different sectors of the economy through the business units: Marsh, Mercer, Guy Carpenter, and Oliver Wyman. At Marsh, we are looking for candidates for the following position located in México...
-
Sr. Data Engineer, Email Platform
hace 1 mes
distrito federal, México Salesforce, Inc. A tiempo completoSr. Data Engineer, Email Platform Location: Mexico - Mexico City Type: Full time Posted: 28 Days Ago About Salesforce: We’re Salesforce, the Customer Company, inspiring the future of business with AI + Data + CRM. Leading with our core values, we help companies across every industry blaze new trails and connect with customers in a whole new way. ...
-
distrito federal, México Teradata Group A tiempo completoOur Company At Teradata, we believe that people thrive when empowered with better information. That’s why we built the most complete cloud analytics and data platform for AI. By delivering harmonized data, trusted AI, and faster innovation, we uplift and empower our customers—and our customers’ customers—to make better, more confident decisions. The...
-
Senior Software Engineer
hace 1 mes
distrito federal, México Capital One A tiempo completoDo you love building and pioneering in the technology space? Our Card Technology team is looking to add a Principal Software Engineer who will focus primarily on backend development. We are building a big data platform to support our card business. This platform is used to service existing customers and also to market products to new customers. What You’ll...
-
Embedded Software Engineer Senior
hace 1 semana
distrito federal, México Robert Bosch Group A tiempo completoEmbedded Software Engineer Senior - Software Engineer Qualcomm Platform Full-time BGSW - MX is part of BGSW India, which is the largest development center outside of India. BGSW has a workforce of over 19,000 engineering and IT professionals supporting Bosch divisions and providing products and services for third-party customers. BGSW has four development...
-
Senior Software Development Engineer
hace 4 semanas
distrito federal, México Zillow A tiempo completoAbout the team Zillow’s Comprehensive Customer Data team is part of the Data Engineering organization and works closely with multiple product and analytics organizations. You will contribute to the design and implementation of data engineering solutions that support AI, Marketing, and Data Science teams in their effort to improve Zillow’s products for...
