Let's gather a few more details here just to make sure the stage is fully set here... What are you using for the file sharing configuration? There are a few options out there for macOS and Docker Desktop. Right now, the "standard" setup is gRPC FUSE for file sharing (there is also a "legacy" option that is osxfs option). The "experimental" feature is using the new Monterey VirtioFS feature. Probably would need to know which one of these you're using at the moment.
Other unrelated notes.. 😁
On a side note, my preliminary testing of the VirtioFS experimental feature yielded the following enticing results:
Some local testing of new VirtioFS framework for macOS w/ Docker. Gateway startup with bind-mount to fresh data volume, 63 seconds as a before time (versus 11 seconds for a standard startup w/ named volume). With VirtioFS framework as well as Big Sur virtualization.framework, 16 seconds for standard startup w/ bind mount (8 seconds for restart). With named volume, looks like 10 seconds for standard, 7 seconds for restart.
That said, not sure I'm ready to recommend turning it on full-time just yet.