Ai Solution Analyst

**Req ID**: We are currently seeking a AI Solution Analyst to join our team in Tijuana, Baja California (MX-BCN), Mexico (MX).**Job Title: AI Solution Analyst - Commercial Intelligence Platform****Project Overview**This project establishes a centralized, AI-powered **Commercial Intelligence Platform** designed to accelerate collaboration and enable data-driven decision-making for sales teams. By integrating **molecule intelligence**, **commercial data**, and **opportunity insights** into an intuitive interface, the platform empowers sales agents to identify collaboration partners, uncover share gain opportunities, and engage clients with actionable insights.Building on the success of the **Commercial Connections Dashboard**, the initiative expands adoption through an **embedded AI experience**, improving collaboration speed, win rates, and deal size while aligning with the organization's strategic direction.**Role Summary**This role focuses on **context design, knowledge curation, prompt engineering, and AI evaluation**, ensuring that GPT-generated insights are business-aligned, secure, and governed responsibly.**Key Responsibilities**- Act as the integration point between **data engineering, business intelligence, and AI development teams** to enable seamless interaction between enterprise data and LLMs.- Define, design, and curate the **context and knowledge base** that powers GPT's ability to provide accurate, relevant business insights.- Collaborate with Data Analysts and SMEs to **structure, tag, and prepare data elements** that feed into the GPT environment.- Develop and refine **prompt engineering strategies** and context frameworks aligned with business objectives.- Conduct **LLM evaluation and performance testing**, measuring response accuracy, completeness, and contextual relevance.- Partner with IT, data governance, and compliance teams to ensure **secure, ethical, and compliant AI behavior** within enterprise systems.- Prepare and maintain **documentation, AI performance dashboards, and prompt libraries** for standardized and scalable usage.**Key Deliverables****LLM Interaction Design Framework**: Comprehensive documentation outlining how GPT connects to datasets, including prompt templates and retrieval logic.**Knowledge Base Configuration**: Structured and curated commercial domain knowledge ensuring accurate GPT responses.**Evaluation Scripts & Test Results**: Defined evaluation sets, scoring criteria, and performance analyses.**Prompt Library & Usage Guidelines**: Standardized prompt templates ensuring consistent business outcomes.**AI Performance Dashboards / Reports**: Metrics on GPT accuracy, performance, and adoption trends.**Governance & Compliance Documentation**: Contributions to data privacy, bias prevention, and responsible AI frameworks.**Required Skills & Experience (5 Years in Each Core Area)****1. LLM Integration & Prompt Engineering (5 years)**- Proven experience designing, building, and maintaining **prompt engineering frameworks** for LLMs (e.g., GPT models).- Demonstrated ability to integrate LLMs with structured and unstructured data to generate business-aligned insights.- Hands-on experience optimizing **prompt templates, context injection, and retrieval augmentation** for enterprise use cases.**2. Context & Knowledge Base Design (5 years)**- Skilled in **curating, structuring, and managing contextual datasets** that improve AI accuracy and reliability.- Experience mapping business ontologies, taxonomies, and metadata for effective LLM context construction.- Deep understanding of how **data context influences AI reasoning and output quality**.**3. Evaluation & Testing of LLMs (5 years)**- Hands-on experience in developing **LLM evaluation frameworks** and defining quantitative scoring metrics.- Skilled in running systematic **evals and quality assessments** to validate GPT responses for accuracy and completeness.- Familiarity with A/B testing, human feedback integration, and response relevance scoring.**4. Data Literacy, Modeling & Integration (5 years)**- Strong proficiency in **data modeling, relational databases, and analytical structures** to support AI workflows.- Demonstrated experience in **data extraction, transformation, and validation** using SQL and Python.- Proven ability to align LLM data pipelines with business intelligence and data engineering processes.**5. Cloud & AI Environment Familiarity (5 years)**- Experience working with **Databricks, AWS, and ChatGPT** or similar AI/ML environments for model deployment and testing.- Understanding of **enterprise-scale AI infrastructure, APIs, and automation pipelines**.- Familiar with version control, MLOps principles, and integration of AI tools within secure cloud ecosystems.**6. Business & Collaboration Skills (5 years)**- Extensive experience collaborating across **business, IT, and analytics teams** to align AI capabilities with strategic