In the end it is about latency. A common example for me would be multireplace, where I select a word, ctrl + d through all instances and replace them. The second step will present me with multiple instaces of often wildly differnt usages of one word per second. This being sluggish or unreadable would be a dealbreaker for me, personally.

I can imagine that a somewhat responsive display would also be important for vim users.