Senior/lead Data Software Engineer

hace 3 semanas

Desde casa, México AgileEngine A tiempo completo

ID: 12022**What you will do**- Collaborate closely with Data Scientists to understand their data requirements, model development needs, and performance optimization goals;- Design, build, and maintain scalable data pipelines and infrastructure to support ML model development and deployment;- Collect, process, and prepare large datasets for analysis, feature engineering, and model training;- Implement data quality checks, validation, and monitoring to ensure the reliability and accuracy of data used in ML models;- Optimize data storage, retrieval, and processing performance for ML workloads;- Develop and maintain ETL (Extract, Transform, Load) processes and workflows;- Manage data versioning, storage, and access control for ML datasets;- Collaborate with DevOps and IT teams to ensure smooth deployment and scaling of ML models in production environments;- Stay up-to-date with emerging technologies, tools, and best practices in data engineering and ML infrastructure.**Must haves**- Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field;- Proven experience as a Data Engineer, preferably in a role supporting Data Scientists;- Strong proficiency in programming languages such as Python, Java, or Scala;- Proficiency with data storage and processing technologies, including SQL databases, NoSQL databases, and distributed computing frameworks (e.g., Hadoop, Spark);- Experience with data warehousing solutions and data integration tools;- Experience with data pipeline and workflow management tools: AWS glue, Airflow, etc;- Knowledge of ML frameworks (e.g., TensorFlow, PyTorch) and ML model deployment;- Familiarity with cloud platforms (e.g., AWS, Azure, Google Cloud) and containerization (e.g., Docker, Kubernetes);- Excellent problem-solving skills and a collaborative mindset;- Excellent oral and written communication skills with a keen sense of customer service.**Nice to haves**- Experience in ad/marketing environment- Experience working with Data Lakes- Experience with Scala- Experience with Glue/EMR/Redshift/Airflow- Experience with Terraform.**The benefits of joining us**- **Professional growth**Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps- **Competitive compensation**We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities- **A selection of exciting projects**Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands- **Flextime**Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office - whatever makes you the happiest and most productive.reference: 12022**Job Types**: Full-time, ContractWork Location: Remote

  • Senior Data Software Engineer

    hace 2 semanas

    Desde casa, México EPAM Systems, Inc. A tiempo completo

    We are seeking a talented **Senior Data Software Engineer** to join our **remote**team and work on innovative project that aims to improve people's lives through vision and eye care products. As a senior member of our team, you will be responsible for designing and implementing scalable data software solutions that leverage Big Data technologies and Amazon...

  • Data Engineer

    hace 2 semanas

    Desde casa, México Inetum A tiempo completo

    We are very grateful that you have decided to participate in the **recruitment and selection process**, you will see that your incorporation will lead you to great opportunities for professional development, remember that we are an international agile digital consulting group. In the era of post digital transformation, we strive to enable each of our 27,000...

  • Senior Software Engineer

    hace 3 semanas

    Desde casa, México S&P Global A tiempo completo

    Senior Software Engineer, Automotive Team, Gurugram- India**Summary**:The Senior Software Engineer will own, support, investigate, audit, analyse, and evaluate production processes and their related outputs. The Senior Software Engineer will also assist in the Design, development, implementation and support of new or migrated production processes. The Senior...

  • Lead Data Software Engineer

    hace 4 semanas

    Desde casa, México EPAM Systems A tiempo completo

    We are seeking a highly skilled and experienced **Lead Data Software** **Engineer **to lead our data engineering team in the design, implementation, and maintenance of our data platform.RESPONSIBILITIES- Collaborate with Solution Architects to design and build a configuration/metadata-driven framework for data transformation and orchestration- Develop and...

  • Lead Data Software Engineer

    hace 4 horas

    Desde casa, México EPAM Systems A tiempo completo

    We are seeking a highly skilled and experienced **Lead Data Software** **Engineer **to lead our data engineering team in the design, implementation, and maintenance of our data platform. RESPONSIBILITIES - Collaborate with Solution Architects to design and build a configuration/metadata-driven framework for data transformation and orchestration - Develop...

  • Senior Data Engineer

    hace 2 semanas

    Desde casa, México CODIGOMX A tiempo completo

    **Required Technologies**AGILE(Scrum),.Git and Github, Matillion, snowflake, SQL, ETL ProcessRequired LanguagesEnglish - Advanced**Description**We are looking for a data engineer with more than 3 years of experience in the following stack and overall experience of more than 5 years in Data Warehousing- Snowflake- SQL- ETL / ELT toolset- MatillionCurrently...

  • Lead Data Software Engineer

    hace 2 días

    Desde casa, México EPAM Systems, Inc. A tiempo completo

    We are searching for a highly skilled and experienced **Lead Data Software Engineer** to design, build, and optimize scalable data solutions on modern cloud platforms such as BigQuery or Databricks. In this position, you will lead a team of Data Engineers, advocate for automation-first development practices, and enable impactful business insights through...

  • Lead Data Software Engineer

    hace 5 horas

    Desde casa, México EPAM Systems, Inc. A tiempo completo

    We are searching for a highly skilled and experienced **Lead Data Software Engineer** to design, build, and optimize scalable data solutions on modern cloud platforms such as BigQuery or Databricks. In this position, you will lead a team of Data Engineers, advocate for automation-first development practices, and enable impactful business insights through...

  • Lead Azure Data Engineer

    hace 4 semanas

    Desde casa, México Datalogics A tiempo completo

    **Lead Azure Data Engineer (REMOTE)**- **5000 USD - 6000 USD/month**:- **100% remote work**:- Full time- **B2B contract**:- **Direct employment by the company**We’re looking for a **Lead** **Azure Data Engineer **for a specialist supply chain, data and software engineering solutions company with over 380 employees, development centers in the USA and India...

  • Senior Data Software Engineer

    hace 4 semanas

    Desde casa, México EPAM Systems, Inc. A tiempo completo

    We are looking for an experienced **Senior Data Software Engineer** to join our team.**Responsibilities**- Design and implement scalable data architectures using Snowflake, including automated data ingestion with Snowpipe- Optimize data processing performance and security in Snowflake environments- Build and maintain event-driven architectures with Apache...