Similar situation: m1 air and m3 air both have significant audio stutters and pops. This can be readily demonstrated in the sound control panel with the "test" button with no app running at all.
Things I've tried:
1. Changing the sampling rate and bit depth make a huge difference, much worse at higher settings, but still mild problems at 44kHz/ 16 bit (lowest setting.)
2. Turning off 3d acceleration has no effect (and note that no 3d app is required to recreate the problem.). Running a 3d app does make things worse though. 3D works pretty well with DX11 if no sound.
3. VM was made from scratch using easy settings.
4. Turning off all audio enhancements or turning off the microphone had no effect.
5. RAM/ CPU cores had no effect.
6. Latest versions with all patches (13.5.1, Win 11 ARM.)
7. Native Mac audio (in MacOS) works fine. Haven't tried any external audio device.
8. One outside post suggested loading some ancient version of the audio driver from a previous version of fusion; VM wouldn't boot when I tried this.
As noted, a different vendor (parallels, more expensive) doesn't have this problem at all. This is pretty clearly a vmware bug, and it's been reported multiple times, so here's to hoping for a fix.
M