>I really have a hard time making (or believing) the argument that they are just predicting the next word.

It's true, but by the same token our brain is "just" thresholding spike rates.