Crawler Engineer

**Kairos** is a digital engineering company that helps businesses achieve agility at scale. Our solutions provide the tools necessary to spark innovation, drive development, and create long-term success.**Job summary**:Job summary:This role focuses on enhancing and mastering Lex Machina's crawling infrastructure to support our customer-facing products. You will be responsible for designing and maintaining robust automated data collection systems in a challenging and large-scale environment. Your work will play a critical role in driving the success of our products, making this an impactful and rewarding opportunity.**Responsibilities**:- Build, maintain, and optimize automated data collection and storage systems, ensuring reliability and scalability.- Extract and process large datasets from industries such as retail pricing, neobanks, and airlines or OTAs.- Debug, troubleshoot, and optimize crawlers for maximum performance and accuracy.- Collaborate with cross-functional teams to align data collection processes with business goals.- Create and maintain comprehensive documentation of crawling infrastructure and processes.- Communicate effectively with stakeholders by asking and answering questions, addressing issues and providing detailed updates.Qualifications:- Bachelor's degree in Computer Science, Software Engineering, or a related field (or equivalent experience).- 3-5+ years of experience in backend software engineering, with a focus on Python in challenging environments.- Proven expertise in large-scale data collection, processing, and storage systems.- Strong problem-solving skills with an enthusiasm for detail and mastery of technical systems.- Excellent communication skills, including thorough documentation and the ability to ask/answer questions diligently.- Self-motivated, with a passion for delivering high-quality work that supports customerfacing products.Preferred Qualifications:- Experience with distributed systems and scalable architecture.- Knowledge of modern software development practices, such as CI/CD and Agile methodologies.- Familiarity with cloud environments such as AWS or Azure.- _**Hybrid Position**_. Mexico CityTipo de puesto: Tiempo completoSueldo: $50,000.00 - $60,000.00 al mesTipo de jornada:- Turno de 8 horasIdioma:- Inglés (Deseable)Lugar de trabajo: remoto híbrido en Cuauhtémoc, CDMX