Most “agentic” AI makes the model the orchestrator: one prompt in, any of many paths out. That’s non-determinism as a feature — and it’s why so many pilots never reach production.
- Every run can take a different path — non-determinism as a feature
- Opaque decisions; end-to-end testing is impossible
- Token usage — and cost, latency — vary wildly
- Most enterprise solutions: “Elasticsearch with extra steps”