If you're not legally constrained, would you say more about when and how?

I'm curious if it's pre or post BERT, for instance, and also what kinds of things you had to do to induce that large a boost in speed.