Senior Big Data Engineer
hace 3 semanas
Job Overview:
We are looking for a highly skilled and motivated individual to design, develop, and maintain data pipelines or ETL-related systems using cloud-based technologies such as PySpark, Apache Spark, Databricks, and Data Lake in cloud environments like AWS or Microsoft Azure. The ideal candidate will have experience in implementing, testing, deploying, and troubleshooting data pipelines, as well as developing CI/CD pipelines using Git, Terraform, and Jenkins.
Main Responsibilities:
- Design and implement data pipelines or ETL-related systems using cloud-based technologies.
- Participate in the design of the above-mentioned system with the principal engineer and architect.
- Work with multiple sourcing teams when it comes to data ingest.
- Implement processes to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
- Select and implement the right technical tools and processes within the boundary defined by the client.
- Perform data analysis required to troubleshoot data-related issues and assist in the resolution of data issues.
Requirements:
- A degree in Computer Science, Information Systems, or other relevant subject area related to information technology.
- 3+ years of hands-on experience in technical architecture, design, development, and testing of data warehouse and big data solutions.
- 3+ years of experience in implementing, testing, deploying, and troubleshooting data pipelines using any of these: PySpark, Apache Spark, Databricks, and Data Lake in cloud environments such as AWS or Microsoft Azure.
- 3+ years of experience in a complex matrix organization within a global IT environment, having a diverse and complex landscape.
- Experience in developing CI/CD pipelines using Git, Terraform, and Jenkins.
- Prior experience working on multiple projects using Agile Methodologies (SAFE).
- Hands-on with applying pattern-based architecture, governance, security, and global process standards to system changes and deployments.
- Expertise in practicing DevOps principles for observability, reliability, and scalability.
- Diverse experience in databases, designs, constructs, and utilities.
What We Offer:
- Competitive salary range: $120,000 - $180,000 per year.
- Benefits include medical, dental, and vision insurance, 401(k) plan, paid time off, and holidays.
About Us:
Gspann Technologies, Inc is a leading provider of IT services with a diverse and complex landscape. We strive to be a trusted partner for our clients, providing innovative solutions and exceptional service.
-
Senior Big Data Engineer
hace 3 días
Xico, México Axity A tiempo completoEstimado candidato, estamos buscando a un Data Engineer experimentado para unirte a nuestro equipo de tecnología en Axity.**Salario:** $120,000 - $180,000 anuales, según experiencia y habilidades.Descripción del puesto:Como Data Engineer, serás responsable de diseñar, desarrollar y operar sistemas de datos escalables que manejen grandes cantidades de...
-
Ingeniero de Big Data Senior
hace 2 días
Xico, México Ids Comercial, S.A. De C.V. A tiempo completoIds Comercial, S.A. De C.V.Estamos buscando un Ingeniero de Big Data Senior para nuestra empresa con sede en Toreo, CDMX.**Descripción del trabajo:**El Ingeniero de Big Data Senior trabajará en el desarrollo de soluciones avanzadas de inteligencia artificial y ciencia de datos para nuestros clientes en México y Latinoamérica.**Habilidades y...
-
Full Stack Backend Developer
hace 2 meses
Xico, México Capital One A tiempo completoAbout UsWe are a leading financial services company, dedicated to helping our customers achieve financial empowerment.Job DescriptionWe are seeking a highly skilled Senior Software Engineer to join our Card Technology team. As a key member of our team, you will be responsible for designing, developing, and implementing big data platforms using AWS Glue,...
-
Ingeniero de Datos Senior con Experiencia en Big Data
hace 4 semanas
Xico, México Ids Comercial, S.A. De C.V. A tiempo completoDescripción del PuestoNuestro equipo está buscando a un ingeniero de datos senior con experiencia en big data para trabajar en proyectos complejos y contribuir al crecimiento continuo de nuestra empresa.ResponsabilidadesDiseñar, desarrollar e implementar sistemas distribuidos a gran escala que procesen grandes volúmenes de datos;Centrarse en la...
-
Senior Backend Software Engineer
hace 3 semanas
Xico, México Ntt Data A tiempo completoJob Title: Senior Backend Software EngineerAbout the Role:We are currently seeking a skilled Senior Backend Software Engineer to join our team in Mexico. As a senior member of our application development team, you will be responsible for designing and developing technical solutions that meet business needs.Responsibilities:Interpret written business...
-
Software Development Engineer in Test Senior
hace 3 días
Xico, México Ntt Data A tiempo completoJob Title: Senior Software Development Engineer in TestWe are seeking a Senior Software Development Engineer in Test to work closely with customers, business analysts, and team members to understand business requirements that drive the analysis, design, and quality of technical solutions.Key Responsibilities:Works closely with customers, business analysts,...
-
Senior Quality Assurance Engineer
hace 2 meses
Xico, México Ntt Data A tiempo completoWe are seeking a Senior Quality Assurance Engineer to join our team in Mexico City, Mexico.About NTT DATA ServicesNTT DATA Services is an equal opportunity employer and considers all applicants without regard to race, color, religion, citizenship, national origin, ancestry, age, sex, sexual orientation, gender identity, genetic information, physical or...
-
Data Analyst and ETL Big Data Specialist
hace 4 semanas
Xico, México Citi A tiempo completoJob OverviewCiti is seeking a highly skilled Data Analyst and ETL Big Data Specialist to join our team. This role will be responsible for various data activities, including database administration, data analysis, maintenance, data quality, and database management or database architecture/design engineering.About the RoleThis position covers incumbents...
-
Big Data Platform Developer
hace 2 meses
Xico, México Capital One A tiempo completoAbout the RoleWe are seeking an experienced Big Data Platform Developer to join our team at Capital One. In this role, you will have the opportunity to work on designing, developing, testing, and implementing big data platforms using AWS Glue, Spark, and other AWS services.Key ResponsibilitiesDesign and develop scalable big data platforms using Apache Spark,...
-
Data Infrastructure Engineer
hace 1 día
Xico, México Itkawa A tiempo completoBig Data Engineer OverviewWe are seeking a highly skilled Data Infrastructure Engineer to join our team at Itkawa. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale big data infrastructure.Key Responsibilities:Design and implement Cloudera Hadoop clusters, including deployment,...
-
Big Data Insights Senior Expert
hace 2 meses
Xico, México Citi A tiempo completoJob OverviewCiti seeks a highly skilled Big Data Insights Senior Expert to drive strategic data analysis and lead cross-functional initiatives. This role is responsible for leveraging in-depth disciplinary knowledge to contribute to the development of new techniques and improve processes.Main Responsibilities:Coordinate and contribute to data science...
-
Senior Data Engineer
hace 2 meses
Xico, México Encora A tiempo completoAbout the RoleEncora is seeking an experienced Senior Data Engineer to design and implement cloud-based data features utilized by hotels globally. This role will play a pivotal part in supporting and evolving our decision support environment, providing opportunities to contribute to innovative solutions within the hospitality industry.Key...
-
Ingeniero de Datos: Desarrollador de Big Data
hace 3 semanas
Xico, México Zemsania A tiempo completoLa empresa Zemsania, líder en el sector tecnológico, está buscando a un Ingeniero de Datos con experiencia en desarrollo de big data para unirse a nuestro equipo.Zemsania es una empresa innovadora que ofrece oportunidades de crecimiento y desarrollo profesional a sus empleados. Buscamos a un profesional con al menos 1 año de experiencia en desarrollo de...
-
Data Analytics Engineer
hace 2 días
Xico, México Microsoft A tiempo completoAbout the RoleWe are seeking a highly skilled Data Analytics Engineer to join our team as a Proactive Support Specialist. This is an exciting opportunity to work with large enterprise customers, providing expert-level technical support and guidance to drive peak health and optimum performance of their Big Data related technologies.Job DescriptionThis role...
-
Senior Frontend Software Engineer
hace 2 días
Xico, México Ntt Data A tiempo completoAbout the RoleWe are currently seeking a Senior Frontend Software Engineer to join our team in Mexico City, Mexico.Job ResponsibilitiesCreate user-centric design solutions through various digital platforms to gather feedback and improve usability.Develop seamless navigation through multiple digital programs and interfaces within the company.Implement...
-
Data Engineer Solutions Expert
hace 3 semanas
Xico, México Pepsico A tiempo completoAt PepsiCo, we are a dynamic and innovative company that offers exciting opportunities for talented professionals. We are currently seeking an experienced Data Engineer to join our team in the LATAM region.The ideal candidate will have 3-5 years of experience in database management, programming capabilities, ETL processes, big data technologies, cloud...
-
Senior Data Validation Engineer
hace 2 días
Xico, México Stand 8 A tiempo completoWe are seeking a highly skilled Senior Data Validation Engineer to join our team at Stand 8, a leading provider of end-to-end IT solutions to enterprise partners across the United States. Located in multiple cities including LA, Atlanta, New York, Raleigh, and more, we offer a dynamic and collaborative work environment where you can make a real impact.As a...
-
Data Platform Engineer
hace 1 mes
Xico, México Capital One A tiempo completoWe are Capital One, a company that is pioneering in the technology space. Our Card Technology team is looking to add a Data Platform Engineer who will focus primarily on backend development for our big data platform. This platform is used to service existing customers and also to market products to new customers.About the Role:This is an exciting opportunity...
-
Senior ETL Developer for NTT Data
hace 4 semanas
Xico, México Ntt Data A tiempo completoAbout the RoleWe are seeking a highly skilled Senior ETL Developer to join our team at NTT Data. As a key member of our data integration team, you will be responsible for designing and building scalable data solutions using IBM InfoSphere DataStage.
-
Senior Infrastructure Engineer
hace 2 meses
Xico, México Ntt Data A tiempo completoJob OverviewWe are seeking a highly skilled Senior Infrastructure Engineer to join our team in CDMX, Mexico.Estimated Salary:$85,000 - $110,000 per year.The ideal candidate will have experience in Windows Administration, Linux/Unix Administration, and scripting languages like Bash and Go.Key ResponsibilitiesDesign and implement infrastructure architecture...