Open up the schematic for what is in the ESP32 MODULE. There’s more than the IC in there. Decoupling caps are always a good idea since you are dealing with a radio that will have peak transmissions.

Doesn’t have to be, as you are assuming there that the device maker actually puts all the connectivity to that port – more than a few devices with a USB-C port and USB2.0 data only.