Posts tagged: ai-workflow
-
How to Migrate a Test/Evaluation Pipeline for AI Workflows Without Breaking Production
Practical notes on how to change prompts, models, or evaluation pipelines for AI workflows while keeping the system stable.
→ -
Evaluating chatbot/AI workflow: benchmark, verifier, LLM judge and real-world test cases
A practical note on LLM evaluation: benchmarks are just the starting point, while a real product needs test cases, verifiers, human review and metrics tied to the workflow.
→ -
Monitoring AI workflows: learning from Netflix but applying at small scale
Designing just enough monitoring for small AI workflows: logs, metrics, traces, evaluation, and business signals.
→