Look. Seriously. Why would anybody ever expect a engine for generating the statistically most-likely response to a prompt-- an engine trained on some vast collection of internet sources-- to give the right answer to legal questions? WHY? Humans mostly don't do that, except when they're paid experts. WHY?

https://www.platformer.news/p/amazons-q-has-severe-hallucinations