Using Docker on Windows with Virtual Box

This is true of the entire OS

I just tried WSL2 Mode which still uses Hyper-V somehow?

Have you tried disabling Hyper-V entirely?

Is your copy of VirtualBox up to date? I think they've been doing core changes recently and I've had a couple updates that didn't work on my machine