This downloads as a zip archive, and once unzipped, you can drag the Visual Studio Code binary into the macOS applications folder, ready for use from the Launchpad. With Visual Studio Code running ...

The change came in Visual Studio Code 1.54 (now 1.54.1, thanks to a bug fix update), which is available as a universal 64-bit binary, as is standard for apps with Apple Silicon support.