Associate Director Product

Your role in our mission

• LLM Solution Engineering Design and implement retrieval-augmented generation (RAG) pipelines: document preprocessing, chunking, embeddings, hybrid retrieval, grounding/citations, prompt templating. Build and integrate MCP (Model Context Protocol) tools/servers to expose enterprise systems and data sources to LLMs securely. Develop orchestration layers (tool/function calling, guardrails, prompt contracts) using Azure OpenAI with frameworks like Llamaindex. Build custom tools that can seamlessly interact with GitHub Copilot to act as force multiplier for the developers. Data Engineering on Azure Build ingestion and transformation pipelines into ADLS Gen2 (bronze/silver/gold), using efficient formats (Parquet, optionally Delta). Implement ETL/ELT workflows and scheduling (e.g., Data Factory, Functions, Container Apps), with schema design for telemetry, operational metrics, and curated aggregates. Optimize storage layout (partitioning, file sizing), handle schema evolution, and maintain data quality checks and lineage. Analytics & Experimentation Operationalize statistical analyses (joins, aggregations, time-series); run A/B tests, t‑tests, and basic causal methods (e.g., difference‑in‑differences) to quantify impact. Deliver consumable datasets with clear KPIs and semantic modeling; instrument cost/latency/quality metrics for AI features. Quality, Security & Governance Integrate quality signals from external reports; correlate them with engineering and product metrics for insights. Implement security best practices: data boundary controls, role-based access, secrets management (Key Vault), tenant isolation, audit logging; align with responsible AI guidelines. Platform & DevOps Productionize services on Azure (Functions, App Service/Container Apps, AKS as needed); implement CI/CD (GitHub Actions/Azure DevOps), testing, observability (App Insights/Log Analytics). Monitor performance and cost; apply model selection, token optimization, caching, and batching strategies. Design & Collaboration Translate moderately specified requirements into architecture docs, ADRs, and sequence diagrams; drive cross-functional alignment with product, engineering, and QA.

What we're looking for

What you should expect in this role