LLMs
Gemini vs Claude vs GPT in Production: A PM's Honest Comparison
An honest head-to-head of Gemini, Claude, and GPT in production — accuracy, cost, latency, and when to pick each. Based on 128K docs across 16K users.
LLMs
AI Engineering
The AI Evaluation Playbook: Measuring What Matters in Production LLM Systems
The AI Evaluation Playbook: Measuring What Matters in Production LLM Systems | AI PM Portfolio The AI Evaluation Playbook: Measuring What Matters in Production LLM Systems May 15, 2024 · 18 min read · Definitive Guide Most AI evaluation is done on benchmarks that do not reflect production reality. After 18 months of
AI Engineering
Multi-Modal AI in Practice: What Actually Works for Document Processing
Multi-Modal AI in Practice: What Actually Works for Document Processing | AI PM Portfolio Multi-Modal AI in Practice: What Actually Works for Document Processing April 8, 2024 · 14 min read · Technical Deep Dive Multi-modal AI -- combining vision and text understanding -- promised to solve document processing in one shot. Send
AI Engineering
How We Cut AI Inference Costs 30x Without Sacrificing Quality
How We Cut AI Inference Costs 30x Without Sacrificing Quality | AI PM Portfolio How We Cut AI Inference Costs 30x Without Sacrificing Quality January 18, 2024 · 17 min read · Cost Optimization Deep Dive Our AI document processing pipeline cost $2.30 per document. At 128,000 documents per tax season,
LLMs
LLMs Changed Everything We Thought We Knew About Document Processing
LLMs Changed Everything We Thought We Knew About Document Processing | AI PM Portfolio LLMs Changed Everything We Thought We Knew About Document Processing April 10, 2023 · 15 min read · Technical Deep Dive For years, document processing followed a rigid pipeline: OCR to extract text, regex to find patterns, rules to
AI Engineering
Building an AI Document Classification System: The Architecture Decisions That Mattered
Building an AI Document Classification System: The Architecture Decisions That Mattered | AI PM Portfolio Building an AI Document Classification System: The Architecture Decisions That Mattered February 25, 2023 · 16 min read · Technical Case Study At a YC-backed tax-tech startup, we built a document classification system that needed to sort thousands