Data Operations Engineer
hace 1 semana
As a Senior Data Operations Engineer hybrid, you will play a critical role in ensuring the reliability, scalability, and performance of our data platforms. This position is vital for our data platform team and overall data strategy, as it combines the responsibilities of maintaining high availability and operational excellence with optimizing data workflows and infrastructure.
In this role, you will work at the intersection of data operations and reliability engineering, ensuring our systems are robust, efficient, and scalable while also enabling seamless data processing and analytics. You will be crucial in maintaining the reliability of our data pipelines and infrastructure, and your contributions will directly impact the success of our data-driven decision-making processes.
**Responsibilities**:
- **On-Call Duties and Production Support**: Provide on-call support to address and resolve production incidents related to data platforms and infrastructure. Perform root cause analysis and implement solutions to prevent recurrence of issues.
- **Capacity Planning**: Conduct capacity planning to anticipate future needs and scale infrastructure accordingly. Use performance data to make informed recommendations on scaling and resource allocation.
- **System Reliability and Scalability**: Ensure system reliability and scalability by implementing best practices in infrastructure management and performance tuning. Collaborate with engineering teams to design and deploy scalable and resilient data solutions.
- **Infrastructure as Code (IaC)**: Use Terraform for provisioning and managing cloud infrastructure, ensuring that infrastructure changes are consistent, repeatable, and version-controlled.
- **Cross-Functional Collaboration**: Work closely with cross-functional teams, including data engineers, software developers, and product managers, to align on data platform requirements and deliver solutions that support business objectives.
- **Problem Prevention**: Proven ability to engage in problem prevention activities, including capacity planning, creating runbooks, and automating runbooks for known issues to drive self-healing capabilities.
**Qualifications**
- Demonstrated experience with Google Cloud Platform (GCP) and Amazon Web Services (AWS) for deploying and managing cloud-based data solutions and infrastructure.
- Proficiency in Python and Java for scripting, automation, and developing custom solutions.
- Strong understanding of API integrations and batch data processing. Experience with data orchestration tools such as Airflow and DBT.
- Hands-on experience with monitoring and observability tools like DataDog, Grafana, and Monte Carlo. Familiarity with Kubernetes for container orchestration and deployment.
- Experience with Terraform for managing cloud infrastructure as code.
- Experience with various relational and non-relational databases, including their management and optimization.
**Experience**
- Minimum of 5 years of experience in a similar role, combining SRE and data operations responsibilities.
- Proven track record of managing data platforms and infrastructure in cloud environments (GCP and AWS).
- Strong background in programming with Python and Java, as well as expertise in API and batch data workflows.
- Hands-on experience with SQL and dbt for data transformation and modeling.
- Experience with testing and quality assurance processes for data accuracy and system reliability.
- Experience with CI/CD pipelines and relevant tools such as Jenkins.
- Proficiency with Terraform for infrastructure management.
- Demonstrated ability to work effectively in cross-functional teams and to manage production support and incident response.
**About Brightcove**
Brightcove is a diverse, global team of smart, passionate people who are revolutionizing the way organizations deliver video. We're hyped up about storytelling, and about helping organizations reach their audiences in bold and innovative ways. When video is done right, it can have a powerful and lasting effect. Hearts open. Minds change.
Since 2004, Brightcove has been supporting customers that are some of the largest media companies, enterprises, events, and non-profit organizations in the world. There are over 600 Brightcovers globally, each of us representing our unique talents and we have built a culture that values authenticity, individual empowerment, excellence and collaboration. This culture enables us to harness the incredible power of video and create an environment where you will want to grow, stay and thrive. Bottom line: We take our video seriously, and we take great pride in doing it as #oneteam.
**WORKING AT BRIGHTCOVE**
We strive to provide our employees with an environment where they can do their best work and be their best selves. This includes a focus on our employees' work experience, actively creating a culture where inclusion and growth are at the center, and hiring, recognizing, promoting employees who are committed to li
-
Senior Data Engineer
hace 4 semanas
Guadalajara, México NTT DATA A tiempo completo**Req ID**: We are currently seeking a Senior Data Engineer to join our team in Guadalajara, Jalisco (MX-JAL), Mexico (MX).- Senior Data Engineer- Adhering to service operations and activities in accordance with the mission and goals of the organization- Adhering service operations and activities in accordance with the mission and goals of the data...
-
Master Data Support Engineer
hace 4 semanas
Guadalajara, México NTT DATA A tiempo completo**Req ID**: We are currently seeking a Master Data Support Engineer to join our team in Guadalajara, Jalisco (MX-JAL), Mexico (MX).**Job Description - Master Data Support Engineer**- Adhering to service operations and activities in accordance with the mission and goals of the organization- Work with operations leads and other service owners across the global...
-
Data Engineer
hace 4 días
Guadalajara, México NTT DATA A tiempo completo**Req ID**: 340436 We are currently seeking a Data Engineer to join our team in GDL, Jalisco (MX-JAL), Mexico (MX). **Data Engineer (Based in Guadalajara)** **Data Engineers**are responsible for designing, building, and maintaining the systems and processes that collect, store, and analyze data. They are responsible for gathering data from various sources...
-
Data Engineer
hace 4 días
Guadalajara, México NTT DATA A tiempo completo**Req ID**: We are currently seeking a Data Engineer to join our team in GDL, Jalisco (MX-JAL), Mexico (MX).**Data Engineer (Based in Guadalajara)****Data Engineers**are responsible for designing, building, and maintaining the systems and processes that collect, store, and analyze data. They are responsible for gathering data from various sources and...
-
Data Prompt Engineer
hace 3 semanas
Guadalajara, México Ntt Data A tiempo completo**Req ID**: ******We are currently seeking a Data Prompt Engineer to join our team in Guadalajara, México (MX-MEX), Mexico (MX).- summarization) ensuring accuracy, consistency, and contextually appropriate outputs.- Context Engineering: Build and manage systems that provide the AI with the right information and tools at the right time.This includes...
-
Data Prompt Engineer
hace 4 semanas
Guadalajara, México NTT DATA A tiempo completo**Req ID**: We are currently seeking a Data Prompt Engineer to join our team in Guadalajara, México (MX-MEX), Mexico (MX).- summarization) ensuring accuracy, consistency, and contextually appropriate outputs.- Context Engineering: Build and manage systems that provide the AI with the right information and tools at the right time. This includes selecting and...
-
Data Prompt Engineer
hace 10 horas
Guadalajara, México NTT DATA A tiempo completo**Req ID**: 343631 We are currently seeking a Data Prompt Engineer to join our team in Guadalajara, México (MX-MEX), Mexico (MX). - summarization) ensuring accuracy, consistency, and contextually appropriate outputs. - Context Engineering: Build and manage systems that provide the AI with the right information and tools at the right time. This includes...
-
Data Operations Engineer
hace 1 semana
Guadalajara, México Brightcove A tiempo completoAs a Senior Data Operations Engineer hybrid, you will play a critical role in ensuring the reliability, scalability, and performance of our data platforms. This position is vital for our data platform team and overall data strategy, as it combines the responsibilities of maintaining high availability and operational excellence with optimizing data workflows...
-
Data Engineer On-site
hace 4 días
Guadalajara, México NTT DATA A tiempo completo**Req ID**: We are currently seeking a Data Engineer On-site (GDL) to join our team in GDL, Jalisco (MX-JAL), Mexico (MX).**Data Engineer****On-site position (GDL)**Data Engineers are responsible for designing, building, and maintaining the systems and processes that collect, store, and analyze data. They are responsible for gathering data from various...
-
Data Engineer On-site
hace 4 días
Guadalajara, México NTT DATA A tiempo completo**Req ID**: 340437 We are currently seeking a Data Engineer On-site (GDL) to join our team in GDL, Jalisco (MX-JAL), Mexico (MX). **Data Engineer** **On-site position (GDL)** Data Engineers are responsible for designing, building, and maintaining the systems and processes that collect, store, and analyze data. They are responsible for gathering data from...