Crawler Engineer
hace 2 semanas
**Kairos** is a digital engineering company that helps businesses achieve agility at scale. Our solutions provide the tools necessary to spark innovation, drive development, and create long-term success.
**Job summary**:
Job summary:
This role focuses on enhancing and mastering Lex Machina's crawling infrastructure to support our customer-facing products. You will be responsible for designing and maintaining robust automated data collection systems in a challenging and large-scale environment. Your work will play a critical role in driving the success of our products, making this an impactful and rewarding opportunity.
**Responsibilities**:
- Build, maintain, and optimize automated data collection and storage systems, ensuring reliability and scalability.
- Extract and process large datasets from industries such as retail pricing, neobanks, and airlines or OTAs.
- Debug, troubleshoot, and optimize crawlers for maximum performance and accuracy.
- Collaborate with cross-functional teams to align data collection processes with business goals.
- Create and maintain comprehensive documentation of crawling infrastructure and processes.
- Communicate effectively with stakeholders by asking and answering questions, addressing issues and providing detailed updates.
Qualifications:
- Bachelor's degree in Computer Science, Software Engineering, or a related field (or equivalent experience).
- 3-5+ years of experience in backend software engineering, with a focus on Python in challenging environments.
- Proven expertise in large-scale data collection, processing, and storage systems.
- Strong problem-solving skills with an enthusiasm for detail and mastery of technical systems.
- Excellent communication skills, including thorough documentation and the ability to ask/answer questions diligently.
- Self-motivated, with a passion for delivering high-quality work that supports customerfacing products.
Preferred Qualifications:
- Experience with distributed systems and scalable architecture.
- Knowledge of modern software development practices, such as CI/CD and Agile methodologies.
- Familiarity with cloud environments such as AWS or Azure.
- _**Hybrid Position**_. Mexico City
Tipo de puesto: Tiempo completo
Sueldo: $50,000.00 - $60,000.00 al mes
Tipo de jornada:
- Turno de 8 horas
Idioma:
- Inglés (Deseable)
Lugar de trabajo: remoto híbrido en Cuauhtémoc, CDMX