For NVME you will need to upgrade the firmware in the onboard 1-bit QSPI NOR FLASH, and then change the switches back for booting from the QSPI FLASH.
The latest SPL+U-Boot and U-Boot+OpenSBI firmware, at the time of writing, can be found at https://github.com/starfive-tech/VisionFive2/releases
The firmware you will need are u-boot-spl.bin.normal.out (129KiB - SPL+U-Boot) and visionfive2_fw_payload.img (2.82 MiB - U-Boot+OpenSBI).
Commands to run from a working OS on the VF2 to upgrade the firmware code in the onboard QSPI FLASH are:
$ sudo apt install mtd-utils
$ wget https://github.com/starfive-tech/VisionFive2/releases/download/VF2_v3.0.4/u-boot-spl.bin.normal.out
$ wget https://github.com/starfive-tech/VisionFive2/releases/download/VF2_v3.0.4/visionfive2_fw_payload.img
$ sudo flashcp -v u-boot-spl.bin.normal.out /dev/mtd0
$ sudo flashcp -v visionfive2_fw_payload.img /dev/mtd1
(If anyone is reading this post in the future the above commands will probably be out of date, so always read and use the latest Official StarFive VisionFive 2 Quick Start Guide which can be found at https://doc-en.rvspace.org)