Software Development Engineer, Big Data

About the teamDesigns, builds and oversees the deployment and operation of technology architecture, solutions and software to capture, manage, store and utilize structured and unstructured data from internal and external sources. Establishes and builds processes and structures based on business and technical requirements to channel data from multiple inputs, route appropriately and store using any combination of distributed (cloud) structures, local databases, and other applicable storage forms as required. Develops technical tools and programming that leverage artificial intelligence, machine learning and big-data techniques to cleanse, organize and transform data and to maintain, defend and update data structures and integrity on an automated basis. Creates and establishes design standards and assurance processes for software, systems and applications development to ensure compatibility and operability of data connections, flows and storage requirements. Reviews internal and external business and product requirements for data operations and activity and suggests changes and upgrades to systems and storage to accommodate ongoing needs. May be internal or external, client-focused, working in conjunction with Professional Services and outsourcing functions. May include company-wide, web-enabled solutions.About the roleZillow Group aims to empower individuals to unlock life’s next chapter, and real estate data is a vital resource for all teams dedicated to this goal.The Real Estate Data for Analytics (REDA) team is uniquely positioned within Zillow to deliver this resource. Our team specializes in transforming a broad range source-aligned industry data into highly accessible data products that serve a range of analytical use cases across Zillow. By processing, aggregating, and curating this data, we minimize the data engineering burden for the many Zillow teams that focus on high-value Analytics, AI and ML initiatives.This role has been categorized as a Remote position. “Remote” employees do not have a permanent corporate office workplace and, instead, work from a physical location of their choice, which must be identified to the Company. U.S. employees may live in any of the 50 United States, with limited exceptions.In addition to a competitive base salary and benefits, this position is also eligible for equity awards based on factors such as experience, performance and location.Who you areAs a member of this team, you will:Collaborate with product managers, engineers and data scientists across teams to provide real estate data products purpose built for high priority initiativesMentor junior engineers, guiding them through product delivery milestones for work streams that you ownSkillfully design and implement efficient and maintainable components in new Databricks pipelineMigrate or deprecate legacy data pipelines to reduce overall support burden on the teamActively contribute to building a team culture of openness and innovationWho You AreA degree in Computer Science or a related technical field; or equivalent work experience5+ years of experience designing and implementing data pipelinesDemonstrable expertise in Python or JavaExcellent interpersonal skills and passionate about collaborating across organizational boundariesPossess the ability to own all aspects of the software development lifecycle including leadership of complex projects, breaking down milestones, and effective delegation to team membersExcited about mentorship and coaching your teammatesDatabricks experience is heavily preferredBasic understanding of ML model development life cycle is a plusGet to know usZillow is reimagining real estate to make it easier to unlock life’s next chapter.As the most-visited real estate website in the United States, Zillow and its affiliates help movers find and win their home through digital solutions, first class partners, and easier buying, selling, financing and renting experiences. Millions of people visit Zillow Group sites every month to start their home search, and now they can rely on Zillow to help make it easier to move. The work we do is helping people move from dreaming to transacting — and no matter what job you're in, you will play a critical role in making this vision a reality.Our efforts to streamline the real estate transaction are supported by a deep-rooted culture of innovation, our passion to redefine the employee experience, and a fundamental commitment to Equity and Belonging. We’re also setting the standard for work experiences of the future, where our employees are supported in doing their best work and living a flexible, well-balanced life. But don’t just take our word for it. Read recent reviews on Glassdoor and recent recognition from multiple organizations, including: the 100 Best Companies to Work For in 2022 list, Glassdoor Employees’ Choice Award, honoring the Best Places to Work in 2022, Bloomberg Gender-Equality Index 2022, Human Rights Campaign (HRC) Corporate Equity Index and Best Place to Work for LGBTQ Equality 2022, and TIME 100 Most Influential Companies list.Zillow Group is an equal opportunity employer committed to fostering an inclusive, innovative environment with the best employees. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, and gender identity. If you have a disability or special need that requires accommodation, please contact your recruiter directly.Qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable state and local law. #J-18808-Ljbffr