Quality
Building a Self-Learning QA Loop: When Your Product Tests Itself | AI PM Portfolio Building a Self-Learning QA Loop: When Your Product Tests Itself March 10, 2025 · 16 min read · Engineering Deep Dive A self-learning QA loop is a testing system that automatically generates new tests from past bugs, validates system
Agentic AI
The Agentic AI Product Framework: Designing Systems That Act, Not Just Respond | AI PM Portfolio The Agentic AI Product Framework: Designing Systems That Act, Not Just Respond January 15, 2025 · 17 min read · Product Framework Agentic AI is the shift from systems that respond to prompts to systems that take
AI Engineering
16,000 Users, 4 AI Systems: A Retrospective | AI PM Portfolio 16,000 Users, 4 AI Systems: A Retrospective December 8, 2024 · 16 min read · Product Retrospective Over 18 months at a YC-backed tax-tech startup, I built and managed four AI systems that processed 128,000 documents for 16,000
AI Safety
AI Safety in Fintech: The Guardrails Nobody Talks About | AI PM Portfolio AI Safety in Fintech: The Guardrails Nobody Talks About November 20, 2024 · 17 min read · Regulated AI Deep Dive AI safety in fintech is not about bias or hallucination. It is about incorrect calculations users trust blindly, data
Product Strategy
The PM's Guide to Working with ML Engineers | AI PM Portfolio The PM's Guide to Working with ML Engineers October 12, 2024 · 16 min read · Top 10 ROI Guide The biggest bottleneck in AI product development is the communication gap between PMs and ML engineers. After
AI Engineering
From 50K to 500K: Scaling AI Processing Without Scaling the Team | AI PM Portfolio From 50K to 500K: Scaling AI Processing Without Scaling the Team September 5, 2024 · 15 min read · Scaling Case Study We scaled AI document processing from 50,000 to 500,000 per season with the same
AI Engineering
Designing AI Confidence Thresholds: When to Automate vs Escalate | AI PM Portfolio Designing AI Confidence Thresholds: When to Automate vs Escalate July 28, 2024 · 16 min read · Expert Matching Deep Dive The difference between an AI system that works and one that terrifies users is a well-designed confidence threshold. After
AI Engineering
Why Most AI Products Fail at the Last Mile: The Integration Problem | AI PM Portfolio Why Most AI Products Fail at the Last Mile: The Integration Problem June 20, 2024 · 14 min read · Contrarian Take Most AI products die not because the model is bad but because production integration is
AI Engineering
The AI Evaluation Playbook: Measuring What Matters in Production LLM Systems | AI PM Portfolio The AI Evaluation Playbook: Measuring What Matters in Production LLM Systems May 15, 2024 · 18 min read · Definitive Guide Most AI evaluation is done on benchmarks that do not reflect production reality. After 18 months of
AI Engineering
Multi-Modal AI in Practice: What Actually Works for Document Processing | AI PM Portfolio Multi-Modal AI in Practice: What Actually Works for Document Processing April 8, 2024 · 14 min read · Technical Deep Dive Multi-modal AI -- combining vision and text understanding -- promised to solve document processing in one shot. Send
AI Engineering
Building an AI Extraction Platform: 4 Providers, 60 Analyzers, 510 Tests | AI PM Portfolio Building an AI Extraction Platform: 4 Providers, 60 Analyzers, 510 Tests February 22, 2024 · 15 min read · Platform Architecture Case Study We built a document extraction platform that uses 4 AI providers, 60 specialized analyzers, and
AI Engineering
How We Cut AI Inference Costs 30x Without Sacrificing Quality | AI PM Portfolio How We Cut AI Inference Costs 30x Without Sacrificing Quality January 18, 2024 · 17 min read · Cost Optimization Deep Dive Our AI document processing pipeline cost $2.30 per document. At 128,000 documents per tax season,