Data Engineer

In order to use this site, it is necessary to enable JavaScript.Here are the instructions how to enable JavaScript in your web browser.All Jobs > Data EngineerVerato Inc.ApplyData EngineerMerida, Yucatan, Yucatan, MEXApplyDescriptionThis position is based in Mérida, Yucatán, México. If you do not live in/around Merida, and are still interested in this position, relocation will be required within 60 days of accepting this position. Verato will provide a relocation bonus of $42,500 MNX pesos to help with your move.About VeratoAs digital transformation and AI progress at lightning speed, organizations find themselves data-rich and insights-poor. Digital transformation's promise to drive better experiences and business performance is falling short. Data is often trapped in silos across disconnected systems of record, such as ERPs and EHRs, systems of engagement, such as CRMs, and systems of insight, such as cloud data platforms. These systems cannot integrate seamlessly without a single source of truth for identity, making it impossible to share and consume complete and trusted 360-degree views of people, organizations, and networks.Verato, the identity intelligence experts, powers exceptional experiences everywhere by solving the problem that drives everything else — knowing who is who. The Verato MDM Cloudä, the next generation of MDM, delivers unprecedented identity intelligence by uniquely combining extraordinary identity resolution and enrichment with identity verification, AI-powered data governance, and advanced insights. Verato re-imagines MDM to be purpose-built and nimble to drive a complete and trusted 360-degree view of people, organizations, and networks across complex ecosystems with unmatched speed to value, enterprise-grade performance, and customer success. More than 75% of the US population flows through Verato, powering a single source of truth for identity across the critical industries of healthcare, life sciences, financial services, public sector, and beyond. For more information, visit Core to Verato's strategy for sustained growth is our commitment to building a strong, people-first culture that attracts, develops, and retains top talent worldwide. Verato operates on the simple principle that a company must prioritize its employees first and foremost. In return, these employees will take care of the company's customers, and in turn, those customers will support the company's shareholders. Verato believes in empowering teams with the best tools and development opportunities available. Staff are given chances to expand their knowledge in areas like technology (e.g., big data, distributed/cloud computing, complex algorithms), healthcare, and organizational development. As Verato continues a path of high growth and significant impact, every team member gains an influential front-row seat as we execute our business strategy. Together, we can bring about a profound and positive transformation in healthcare as we know it today.VERATO VALUESWe are committed to continually raising the standard of excellence throughout the organization, from marketing to engineering to customer service. Our guiding principles are to Make a Difference, to be Trustworthy, and to be Customer Obsessed.Verato employees have a precise focus on proactively protecting the privacy and security of all systems while always ensuring they are following documented policies and procedures.About The PositionWe are seeking aData Engineerwho is interested in joining a highly dynamic and creative development team. This is a leadership role within the Technology Department. Verato's SaaS software offering is a Master Data Management ( Verato MDM Cloud) platform that provides our customers with a complete and trusted 360-degree view of their patients, consumers, and providers. This technical software development position is focused on enhancing an established product based on client needs. This positionreports to the Director of Data Platformwithin the Technology Department.Essential Functions And ResponsibilitiesDesign data pipelines for API, streaming, and batch processing to facilitate data loads into the Snowflake data warehouse.Collaborate with other engineering and DevOps team members to implement, test, deploy, and operate data pipelines and ETL solutions.Develop scripts to Extract, Load and Transform data and other utility functionsOptimize data pipelines, ETL processes, and data integrations for large-scale data analytics use casesBuild necessary components to ensure data quality, monitoring, alerting, integrity, and governance standards are maintained in data processing workflowsAble to navigate ambiguity and thrives in a fast-paced environment. Takes initiative and consistently delivers results with minimal supervision.Performs data profiling and analysis required to perform development work or troubleshoot/assist in the resolution of data issues.RequirementsRequired Skills:Bachelor's or master's degree in Computer Science, Information Systems, or related field3+ years of experience in building and maintaining data pipelines and ETL/ELT processes in data-centric organizationsStrong coding skills using Python. Familiar with Python libraries related to data engineering and cloud services including pandas, boto, etc.At least 1-2 years of experience with AWS S3, SQS, Kinesis, Lambda, AWS DMS, Glue/EMR, AWS Batch or similar servicesHands-on experience building streaming and batch big data data pipelinesMust have knowledge of building Infrastructure in AWS cloud using Cloud formation or Terraform1+ years of working experience with Snowflake cloud data warehouse including Snowflake data shares, Snowpipes, Snow SQL, Tasks etcMust have working knowledge of various databases, SQL and NoSQLMust have working knowledge of various file formats like CSV, Json Avro, and Parquet.Hands-on experience with cloud platforms such as AWS and Google CloudStrong experience with Apache Spark, especially using PySpark for large-scale data processingExperience working with agile development methodologyExperienced in CI/CD and release processes, proficient in Git or other source control management systems, to streamline development and deployment workflowsOther Desired SkillsMinimum 2 years of designing and implementing operational production grade large-scale data pipelines, ETL/ELT and data integration solutions.Exposure to multi-tenant/multi-customer environments is a big plus.Hands on experience with productionized data ingestion and processing pipelinesStrong understanding of Snowflake Internals and integration of Snowflake with other data processing and reporting technologies.Experience working with structured, semi-structured, and unstructured dataFamiliarity with MongoDB or similar NoSQL database systemsSome familiarity with Apache Airflow and building/maintaining DAGsApplyView All JobsPowered byPayroll & HR SoftwareBy clicking "Accept All Cookies", you agree to the storing of cookies on your device to enhance site navigation, analyze site usage, and assist in our marketing efforts.Privacy Preference CenterWhen you visit any website, it may store or retrieve information on your browser, mostly in the form of cookies. This information might be about you, your preferences or your device and is mostly used to make the site work as you expect it to. The information does not usually directly identify you, but it can give you a more personalized web experience. Because we respect your right to privacy, you can choose not to allow some types of cookies. Click on the different category headings to find out more and change our default settings. However, blocking some types of cookies may impact your experience of the site and the services we are able to offer.More informationManage Consent PreferencesTargeting CookiesTargeting CookiesThese cookies may be set through our site by our advertising partners. They may be used by those companies to build a profile of your interests and show you relevant adverts on other sites. They do not store directly personal information, but are based on uniquely identifying your browser and internet device. If you do not allow these cookies, you will experience less targeted advertising.Strictly Necessary CookiesAlways ActiveThese cookies are necessary for the website to function and cannot be switched off in our systems. They are usually only set in response to actions made by you which amount to a request for services, such as setting your privacy preferences, logging in or filling in forms. You can set your browser to block or alert you about these cookies, but some parts of the site will not then work. These cookies do not store any personally identifiable information.Performance CookiesPerformance CookiesThese cookies allow us to count visits and traffic sources so we can measure and improve the performance of our site. They help us to know which pages are the most and least popular and see how visitors move around the site. All information these cookies collect is aggregated and therefore anonymous. If you do not allow these cookies we will not know when you have visited our site, and will not be able to monitor its performance.Performance CookiesSearch Iconcheckbox label labelConsent Leg.InterestSwitch Label labelSwitch Label labelSwitch Label label