What are you using as a power supply ?
I tried Zenwire YMS-608 100W and something called “Raspberry Pi 5 5.1V 5A Power Supply PD 27W USB Type C” from AliExpress. No difference at all, same behavior. I also found information that some ARM-based SBCs also have similar behaviour, and they also recommend installing an older NVMe, which consumes less power and, apparently, solves the problem. I also have an OrangePi RV2 (Spacemit K1), and there are no problems at all with either the power supplies or the NVMe.