Could well be that one board has an old/unhappy SPI . Yes, I got that message on one of my boards and switching to sdio boot via dip switch (see Detailed Boot Mode Settings on VisionFive 2) and booting the sdcard.img, flashing spi and then switching back to SPI/flash did the trick for me.
Flashing via uart will do the same.