Principal Data Engineer

hace 4 semanas


Xico, México Tiger Analytics, Llc A tiempo completo

About Tiger Analytics, LLC

Tiger Analytics, LLC is a global leader in AI and analytics consulting, empowering organizations to make data-driven decisions and drive business growth. Our team of experts is passionate about harnessing the power of data and technology to solve complex problems and create innovative solutions.

Job Summary

We are seeking an experienced Principal Data Engineer to join our team in Silicon Valley. As a key member of our data engineering team, you will be responsible for designing and building scalable data ingestion pipelines, conceptualizing high-performance data processing, and collaborating with cross-functional teams to deliver analytical solutions.

Key Responsibilities

  • Design and build metadata-driven data ingestion pipelines for batch and streaming datasets
  • Conceptualize and execute high-performance data processing for structured and unstructured data, and data harmonization
  • Schedule, orchestrate, and validate pipelines
  • Design exception handling and log monitoring for debugging
  • Ideate with peers to make tech stack and tools-related decisions
  • Interact and collaborate with multiple teams and stakeholders to meet deadlines and bring analytical solutions to life

Requirements

  • Experience in implementing data lakes with technologies like Azure Data Factory (ADF), PySpark, Databricks, ADLS, and Azure SQL Database
  • Comprehensive foundation with working knowledge of Azure Synapse Analytics, Event Hub & Streaming Analytics, Cosmos DB, and Purview
  • Passion for writing high-quality code that is modular, scalable, and free of bugs (debugging skills in SQL, Python, or Scala/Java)
  • Enthusiasm to collaborate with various stakeholders across the organization and take complete ownership of deliverables
  • Experience in using big data technologies like Hadoop, Spark, Airflow, NiFi, Kafka, Hive, Neo4J, and Elastic Search
  • Adept understanding of different file formats like Delta Lake, Avro, Parquet, JSON, and CSV
  • Good knowledge of building and designing REST APIs with real-time experience working on data lake or lakehouse projects
  • Experience in supporting BI and Data Science teams in consuming data in a secure and governed manner
  • Certifications like Data Engineering on Microsoft Azure (DP-203) or Databricks Certified Developer (DE) are a valuable addition

What We Offer

  • Excellent opportunity for significant career development in a fast-growing and challenging entrepreneurial environment with a high degree of individual responsibility
  • Competitive compensation packages among the best in the industry
  • Collaborative and dynamic work environment with a team-first mindset


  • Xico, México Jumpcloud A tiempo completo

    We are seeking a highly skilled Principal Data Engineer to join our Business Data Engineering team at Jumpcloud. As a key member of our team, you will provide technical leadership and strategic direction to drive business growth and innovation.Key Responsibilities:Develop and implement data engineering solutions to support business needsProvide technical...

  • Data Engineer

    hace 4 semanas


    Xico, México Rmx Dev S De R L De C V A tiempo completo

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Rmx Dev S De R L De C V. As a Data Engineer, you will play a critical role in designing, developing, and maintaining our cloud-based data lake.Key Responsibilities:Design and implement data ingestion pipelines in the cloud-based data lake to accommodate multiple data...

  • Process Engineer I

    hace 4 semanas


    Xico, México The Chemical Engineer A tiempo completo

    {"h1": "Process Engineer I", "p": "At The Chemical Engineer, we believe in the power of innovation to drive progress. Our team of experts is dedicated to developing cutting-edge solutions that transform the way we work and live. As a Process Engineer I, you will play a critical role in shaping the future of our company.**Key Responsibilities:*** Develop and...

  • Principal Engineer

    hace 4 semanas


    Xico, México The Bridge Social A tiempo completo

    About The Bridge SocialThe Bridge Social is the largest network of digital professionals in LATAM, with over 230,000 members. We connect startups, scale-ups, large companies, and consultancies from around the world to achieve impressive projects.Job Title: Principal EngineerWe're looking for a highly skilled and mission-driven individual to join our team as...

  • Senior Data Engineer

    hace 4 semanas


    Xico, México Agileengine, Llc A tiempo completo

    Job SummaryWe are seeking a highly skilled Data Engineer to join our team at Agileengine, Llc. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining complex data pipelines to connect different sources of data together.Key ResponsibilitiesCommunicate with cross-functional teams to understand data needs...

  • Data Engineer

    hace 17 horas


    Xico, México Paystone A tiempo completo

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Paystone. As a Data Engineer, you will play a critical role in building and maintaining robust data pipelines and integrations, ensuring data quality, and enabling self-serve analytics across our platforms.Key ResponsibilitiesDesign and develop data pipelines using Databricks...

  • Data Engineer Azure

    hace 17 horas


    Xico, México Laagencia A tiempo completo

    Job Title: Data Engineer AzureJob Summary:We are seeking a highly skilled Data Engineer to join our team at Laagencia. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems on Azure.Key Responsibilities:Design and implement data ingestion pipelines from diverse data sources using Azure Data...

  • Data Platform Engineer

    hace 4 semanas


    Xico, México Microsoft A tiempo completo

    About the RoleWe are seeking a highly skilled Data Platform Engineer to join our M365 Places Ecosystem Team. As a key member of our team, you will play a pivotal role in building and maintaining a robust infrastructure that underpins our data platform.ResponsibilitiesCollaborate with cross-functional teams to design scalable solutions and implement data...

  • Senior Data Engineer

    hace 4 semanas


    Xico, México Pinterest A tiempo completo

    About PinterestPinterest is a leading online platform where millions of people come to find new ideas and inspiration every day. Our mission is to help people discover and create a life they love. In this role, you will be part of the Business Intelligence and Information Infrastructure team, which builds data solutions to address the most pressing data...

  • Data Analytics Engineer

    hace 4 semanas


    Xico, México Marriott Vacations Worldwide A tiempo completo

    Job SummaryMarriott Vacations Worldwide is seeking a highly skilled Data Analytics Engineer to join our team. As a key member of our data analytics strategy, you will play a crucial role in unlocking the full potential of our data and driving business success.Key ResponsibilitiesTranslate business requirements into data requirements to inform IT development...


  • Xico, México Tiger Analytics, Llc A tiempo completo

    About the RoleTiger Analytics, LLC is a leading global AI and analytics consulting firm. We are a team of experts who are passionate about solving complex problems and making a meaningful impact on the lives of millions globally. Our culture is built on a foundation of expertise, respect, and a team-first mindset. We are headquartered in Silicon Valley and...

  • Senior Data Engineer

    hace 4 semanas


    Xico, México Cognizant A tiempo completo

    About the Role:Cognizant is seeking an exceptional Data Engineer to join our team. As a Data Engineer, you will play a critical role in supporting one of our clients by translating functional data and analytic requirements into solutions for consumption and use by the respective business or technology request.Key Responsibilities:Translate functional data...

  • Data Engineer

    hace 4 semanas


    Xico, México Getinge A tiempo completo

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Getinge. As a Data Engineer, you will play a critical role in designing and implementing our Data Platform, ensuring the seamless flow of data across our systems.Key ResponsibilitiesDesign and maintain scalable data structures that meet business requirementsDevelop and...

  • Data Engineer

    hace 4 semanas


    Xico, México Getinge A tiempo completo

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Getinge. As a Data Engineer, you will play a critical role in designing and implementing our Data Platform, ensuring the seamless flow of data across our systems.Key ResponsibilitiesDesign and maintain scalable data structures that meet business requirementsDevelop and...

  • Data Engineer

    hace 4 semanas


    Xico, México Capgemini A tiempo completo

    About the RoleWe are seeking a highly skilled Data Engineer with expertise in Azure Data Factory to join our team at Capgemini. As a Data Engineer, you will play a critical role in designing, developing, and implementing data pipelines and architectures that drive business value for our clients.Key ResponsibilitiesDesign and develop data pipelines using...

  • Senior Data Engineer

    hace 4 semanas


    Xico, México Agileengine, Llc A tiempo completo

    About the RoleAs a Senior Data Engineer at Agileengine, LLC, you will play a critical role in designing and implementing complex data pipelines to connect various data sources. Your expertise in data lakes, warehouses, and ETL/ELT processes will enable our clients to make data-driven decisions and drive business growth.Key ResponsibilitiesCollaborate with...


  • Xico, México Ntt Data A tiempo completo

    Job Title: SDET Automation Engineer Level 3About the Role:We are seeking a highly skilled SDET Automation Engineer Level 3 to join our team at NTT DATA Services. As a key member of our team, you will be responsible for designing, developing, and maintaining automated testing frameworks to ensure the quality of our software solutions.Key...


  • Xico, México Pepsico A tiempo completo

    About the RoleWe are seeking a highly skilled Principal Software Engineer to join our Strategy & Transformation (S&T) organization. As a key member of our team, you will play a pivotal role in software development activities and long-term initiative planning and collaboration across the organization.Key ResponsibilitiesDeliver end-to-end software development...

  • Data Engineer LATAM

    hace 4 semanas


    Xico, México Pepsico A tiempo completo

    About the RoleWe are seeking a highly skilled Data Engineer to join our team in Latin America. As a Data Engineer, you will play a pivotal role in crafting and sustaining the intricate systems for gathering, storing, and processing data essential for product insights.Key ResponsibilitiesDesign, implement, and maintain databases, including relational and...

  • Data Engineer 1

    hace 4 semanas


    Xico, México Lionbridge Technologies A tiempo completo

    Data Engineer I (Games)**Job Summary**We are seeking an experienced data analyst to join our team as a Data Engineer I (Games). As a key member of our data engineering team, you will be responsible for retrieving and processing data using a broad set of data technologies and resources.**Key Responsibilities**- Retrieve and process data using a broad set of...