Idea: Live Hallucination Detector

[mohamad-tohidi]

while the Rag system is generating the tokens, we buffer a small batch (20 tokens)
and we predict hallucinations online.

for this method, do we have to train the Hallucination Detector in an special way?
does your project support it?

[adaamko]

Hey, check this integration demo with langchain to support real time detection of hallucinations: https://github.com/KRLabsOrg/LettuceDetect/tree/main/lettucedetect/integrations/langchain Please note that the models were trained with the full context available, so the results might be worse.