Hallucinations are inevitable but can be made statistically negligible