Hallucination
환각
When a model produces something untrue but plausible sounding, as if it were fact.
A language model continues text; it does not look facts up. Where it lacks knowledge, the sentence still flows.
Mitigations exist: supply source documents, require citations, instruct the model to say it does not know, and keep a human check.
Numbers and citations are the dangerous part in learning material. It is why the research cited in Budit posts is verified against the original.
- Most common inNumbers, citations, names, dates.
- CountermeasuresRetrieval, visible sources, human review.