If you’re French, you can’t buy car insurance from Italy or have a German bank account.

They literally can and do. It’s just so seamless within the EU that people who aren’t interested may not even realise they’re dealing with a company from another EU country. Being able to sell services cross-border without extra requirements (on top of those applying EU-wide) is the whole point of the single market in services.