It depends on the firmware version.
You can try to start with the 202306 release and write it too your micro SD card.
It’s easier on Ubuntu (or any other Linux distro), as you will be able to make the root partition larger and copy the script to download the additional packages.
You can do it afterwards, but it’s not without some challenges.
This is the thread to start with.
Download the image from here: https://debian.starfivetech.com/
Once you have written the image, you can try to boot. If it doesn’t boot after a couple of minutes, you can shut down and try again by changing the switches.
https://rvspace.org/en/project/VisionFive2_Debian_Wiki_202306_Release