MTP can give you small batches, but it is still WAY smaller than the batches you can get with prefill, which is limited only by the number of input tokens you have (but has diminishing returns on performance).

But:

1) It still makes no sense to upload the weights to the GPU with MTP as you are still bottlenecked by the weight upload.

2) I'm not sure MTP helps much with MoE models.