Data platform engineer

Description:

MercerTech DnAi Platform engineering team is seeking candidates for the following position based in the CDMX office and be onsite 3 days a week: Sr. Data Platform Engineer

MercerTech DnAi Platform engineering team is seeking an experienced Mid-Level Data plat Engineer with experient on data with AWS cloud who has expertise in the administration, development and implementation of large-scale data projects in the hybrid data platform (on-prem and cloud both)

SR. DATA PLATFORM ENGINEER

What can you expect?

You will be responsible for overseeing the design, implementation, and maintenance of the data platform built on Kubernetes, AWS services and other SAAS solutions. You will be responsible to setup the platform and its toolkit like Databricks, Snowflake, IDMC with best possible standards for different projects to work on it. You will also collaborate with projects’ business teams to understand their requirements, technical needs and help the team design their architecture using the combination of data tools aligning with MMC’s technology standards and security. you will also be involved in onboarding new technologies onto the platform and ensuring smooth operations through regular maintenance, governance, and guideline definition. You should be an expert an ETL processing toolsets to have the capability to guide the developers to optimize their jobs

What is in it for you?

A company with a strong Brand and strong results to match Culture of internal mobility, collaboration and valued partnership from the business. Employee Resource Groups which provide access to leaders, relevant volunteer and mentoring opportunities and interactions with counterparts in industry groups and client organizations. Entitled to vacation, floating holidays, time off to give back to your community, sick days, and national holidays (with early dismissal).

We will count on you to:

 Work with our partners to understand business and technology problems or opportunities. Conceptualize and implement the setup and management of the data platform built on Kubernetes , AWS services and other cloud saas solutions like Databricks, Snowflake, IDMC, Mongo Atlas across different regions. Configure and optimize the techstack including Spark, NiFi, Python, R, Databricks, IDMC by Informatica, Snowflake AWS S3, Glue, and Athena for efficient performance and scalability to create the best-in-class data ingestion and processing data platform. Understand data landscape i.e., tooling, tech stack, source systems etc. and work closely with development teams to improve data collection, quality, reporting and analytics capabilities. Provide guidance on selecting the appropriate tools in appropriate AWS regions to meet project objectives and performance requirements. Setup the skilled team who can support the projects to build efficient data pipelines. Collaborate with analytics and business teams to suggest and improve data platform that support business intelligence tools, increasing data accessibility, and fostering data-driven decision-making across the organization. Collaborate with different stakeholders like MMC infra, MMC security, MMC architecture teams to achieve high availability and scalability over the data platform. Continuous learning and implementation of latest technologies Troubleshoot incidents, identify root causes, fix, and document problems, and implement preventive measures. Setup process, guidance, and documentations necessary to share the best practices guidelines for other to follow. Work with data governance team on technology obsolescence, component re-use and platform modernization. Crisis management and problem-solving Be innovative in your design thinking and use your expertise to influence the MMC technology roadmap. Take your architectural designs through our on boarding processes to ensure they meet MMC’s standards and conventions. Participate in cost estimations during budget cycles. Empower the development teams to deliver your architectural designs

What you need to have:

Bachelor's or Master's degree in Computer Science, Engineering, or related field. Extensive experience in data engineering roles with a focus on building and managing data platforms. Exposure to Big Data / Data Lake frameworks like Spark, Spark Streaming, Python, R, NiFi, AWS S3, Redshift, Glue, Athena etc and tools like Databricks, IDMC, Snowflake, MongoDB Understanding of BI Tools like PowerBI, Qlik is an added advantage. Excellent communication and collaboration skills with the ability to work effectively with cross-functional teams. Ability to design and architect the solution when provided with the business requirement. An inquisitive mind set with a track record of seeking out and implementing new technologies and architectural patterns. Self-motivated to excel in a remote position, collaborating effectively with a remote team. You are a self-starter; you can take initiative without waiting for direction. Ability to take decisions during crisis. The ability to work in a fast-paced environment with changing priorities and deadlines. You are used to working and communicating with both business and technical stakeholders at varying levels of seniority.

What makes you stand out?

 Strong AWS experience. Experience in either one of Databricks or Snowflake Experience in Informatica data quality and governance tools. (IDMC)

---