hallucinate

verb

1. (ambitransitive)To seem to perceive things (with one or more of one's senses) which are not really present; to have visions; to experience a hallucination.
2. To produce information that is not supported by the model's training data.

   “In case you were wondering, the yahoo url above doesn’t actually exist, the model just hallucinated it.”

   “Despite maintaining plausible general linguistic capabilities, dialogue models are still unable to fully discern facts and may instead hallucinate factually invalid information.”

   “Rankin sanctioned Ayala $3,000 and kicked him off the lawsuit after the lawyer admitted incorporating the hallucinated AI-generated cases in the brief. Morgan and Goody were sanctioned $1,000 each.”