What a Longer Context Window Actually Buys You
Context windows have grown enormously. The ability to use everything in them has not grown at the same rate, and the gap matters.
Research
Why Models Make Things Up, and What Genuinely Reduces It
Confident invention is a consequence of what these systems are trained to do. It can be reduced substantially and it cannot be eliminated by prompting.