You can control what your phone does too, so there’s no need to give up on it all just because a phone is in your pocket.

As others have mentioned in this thread - AOSP roms like GrapheneOS and LineageOS can do the trick.