It depends. Goods from inside the EU: you'll pay VAT (and recover it). Goods outside EU: you pay import duty (which might include VAT - but you don't actually pay that VAT as a company, because it's VAT)

If this wouldn't apply to services, it would give non-EU suppliers an unfair advantage.