Issue Details
Overreliance
llm09-2024 • Rank #9 in OWASP 2025
Explanation
Overreliance happens when users or systems accept model output without verification, even for high-stakes decisions. Hallucinations, stale context, and adversarial manipulation can produce plausible but incorrect guidance. The resulting risk is operational and safety impact driven by misplaced trust.
Remedy
Design workflows that require evidence, citations, or deterministic checks for critical outputs. Surface uncertainty and confidence signals clearly to end users. Add domain-specific verification layers and escalation paths when model responses affect security, compliance, or business-critical actions.
| Year | Rank | Category |
|---|---|---|
| 2024 | #9 | llm09-2024 - Overreliance |