LLMs
Gemini vs Claude vs GPT in Production: A PM's Honest Comparison | AI PM Portfolio Gemini vs Claude vs GPT in Production: A PM's Honest Comparison February 5, 2026 · 22 min read · Multi-Provider Analysis After 18 months running all three major AI providers in the same production
AI Engineering
The AI Evaluation Playbook: Measuring What Matters in Production LLM Systems | AI PM Portfolio The AI Evaluation Playbook: Measuring What Matters in Production LLM Systems May 15, 2024 · 18 min read · Definitive Guide Most AI evaluation is done on benchmarks that do not reflect production reality. After 18 months of
AI Engineering
Multi-Modal AI in Practice: What Actually Works for Document Processing | AI PM Portfolio Multi-Modal AI in Practice: What Actually Works for Document Processing April 8, 2024 · 14 min read · Technical Deep Dive Multi-modal AI -- combining vision and text understanding -- promised to solve document processing in one shot. Send
AI Engineering
How We Cut AI Inference Costs 30x Without Sacrificing Quality | AI PM Portfolio How We Cut AI Inference Costs 30x Without Sacrificing Quality January 18, 2024 · 17 min read · Cost Optimization Deep Dive Our AI document processing pipeline cost $2.30 per document. At 128,000 documents per tax season,
LLMs
LLMs Changed Everything We Thought We Knew About Document Processing | AI PM Portfolio LLMs Changed Everything We Thought We Knew About Document Processing April 10, 2023 · 15 min read · Technical Deep Dive For years, document processing followed a rigid pipeline: OCR to extract text, regex to find patterns, rules to
AI Engineering
Building an AI Document Classification System: The Architecture Decisions That Mattered | AI PM Portfolio Building an AI Document Classification System: The Architecture Decisions That Mattered February 25, 2023 · 16 min read · Technical Case Study At a YC-backed tax-tech startup, we built a document classification system that needed to sort thousands