VMware Workstation

 View Only
Expand all | Collapse all

Graphics artifacts suddenly fill the VM screen after long use of a Kali Linux VM guest with 3D acceleration enabled

  • 1.  Graphics artifacts suddenly fill the VM screen after long use of a Kali Linux VM guest with 3D acceleration enabled

    Posted Jul 05, 2025 01:15 PM
    Description:
     
    When "Accelerate 3D graphics" is enabled for a Kali Linux VM guest, its desktop environment (GNOME Wayland) becomes filled with graphical artifacts after the VM has been running continuously for around 20 hours on a Windows 11 host (physical machine). At this moment, the Kali Linux VM guest continues running, and the graphical interface can be restored by rebooting the VM.
     
    This issue does not usually occur during a short-term running Kali Linux VM guest, like 4 hours.
     
    This issue has persisted for at least six months and can be consistently reproduced on two different Windows 11 PCs with different hardware configurations.
     
    Below are more details.
    Windows PC host 1:
     
    ```
    OS: Windows 11 Pro for Workstation, 24H2, build 26100.3775
        Features:
            Virtual Machine Platform [Disabled]
            Windows Hypervisor Platform [Disabled]
            Windows Sandbox [Disabled]
            Windows Subsystem for Linux [Disabled]
        Vitalization-based security [Disabled]
    CPU: AMD Ryzen 9 9950X
    GPU: AMD Radeon Graphics (integrated in the CPU)
    GPU driver: AMD Software Adrenalin Edition 25.6.1
    VMware Workstation Pro 17.6.3 build-24583834
    ```
     
    Windows PC host 2:
     
    ```
    OS: Exactly the same as PC 1
    CPU: AMD Ryzen Threadripper Pro 5975WX
    GPU: Nvidia GeForce RTX 4060 Ti 16GB
    GPU driver: Nvidia Studio Driver 576.80
    VMware Workstation Pro: Exactly the same as PC 1
    ```
     
    Kali Linux VM guest:
     
    ```
    OS: Kali Linux 2025.2, kernel 6.12.33+kali-amd64
    mesa: 25.0.5-2
    Desktop environment: GNOME 48.1, Wayland
    vmx file:
        mks.enable3d = "TRUE"
        mks.enableDX12Presentation = "FALSE"
        mks.enableVulkanRenderer = "FALSE"
        mainMem.useNamedFile = "FALSE"
    ```


  • 2.  RE: Graphics artifacts suddenly fill the VM screen after long use of a Kali Linux VM guest with 3D acceleration enabled

    Posted Jul 07, 2025 09:38 AM
    Today I added the following two new lines to the vmx file of my Kali Linux VM guest:
     
    ``` 
    svga.noScreenBuffering = "TRUE" 
    mks.noScreenBuffering = "TRUE" 
    ```
     
    After running this VM continuously for 13 hours, the VM simply crashed with the following error:
    This is something I have never encountered before.



  • 3.  RE: Graphics artifacts suddenly fill the VM screen after long use of a Kali Linux VM guest with 3D acceleration enabled

    Posted Jul 07, 2025 10:02 AM
      |   view attached

    This is the mksSandbox log file associated with the ISBRenderComm error.


    Attachment(s)

    log
    mksSandbox-0.log   112 KB 1 version


  • 4.  RE: Graphics artifacts suddenly fill the VM screen after long use of a Kali Linux VM guest with 3D acceleration enabled

    Broadcom Employee
    Posted Jul 07, 2025 04:57 PM

    For this system, instead of the running on DX12 renderer using the config options 

      mks.enableDX12Presentation = "FALSE"
        mks.enableVulkanRenderer = "FALSE"
    Can you instead use these config options and run on vulkan renderer and check if you still hit the crash. If you see rendering corruption (right at the beginning) add mks.enableDX12Presentation = "FALSE" too.
     mks.vk.forceDevice=NVIDIA
     mks.vk.allowMultiGPU=TRUE



  • 5.  RE: Graphics artifacts suddenly fill the VM screen after long use of a Kali Linux VM guest with 3D acceleration enabled

    Posted Jul 07, 2025 10:36 PM
    Thanks for the advice. Now I am running the Kali Linux VM guest with the following vmx configuration:
    ```
    # mks.enableDX12Presentation = "FALSE"
    mks.enableVulkanRenderer = "TRUE"
    mks.vk.forceDevice = "NVIDIA"
    mks.vk.allowMultiGPU = "TRUE"
    ```
    Let's wait for the VM to run for about 12 hours and see how it goes.



  • 6.  RE: Graphics artifacts suddenly fill the VM screen after long use of a Kali Linux VM guest with 3D acceleration enabled

    Posted Jul 08, 2025 09:44 AM

    Well, after the Kali Linux VM guest had been running continuously for about 9 hours, once again, the full screen was suddenly covered in graphics artifacts.

    This time, the VM was running in "Windows PC host 2" as previously described. And the vmx file is:
    ```
    # mks.enableDX12Presentation = "FALSE"
    mks.enableVulkanRenderer = "TRUE"
    mks.vk.forceDevice = "NVIDIA"
    mks.vk.allowMultiGPU = "TRUE"
    ```



  • 7.  RE: Graphics artifacts suddenly fill the VM screen after long use of a Kali Linux VM guest with 3D acceleration enabled

    Posted Jul 09, 2025 10:53 AM

    I tested a new vmx configuration today, and the same problem still occurs after the Kali Linux VM guest has been running continuously for about 14 hours (using "Windows PC host 2" as previously described):

    ```
    mks.enableDX12Presentation = "FALSE"
    mks.enableVulkanRenderer = "TRUE"
    # mks.vk.forceDevice = "NVIDIA"
    mks.vk.allowMultiGPU = "TRUE"
    ```



  • 8.  RE: Graphics artifacts suddenly fill the VM screen after long use of a Kali Linux VM guest with 3D acceleration enabled

    Broadcom Employee
    Posted Jul 09, 2025 12:39 PM

    Can you please attach vmware.log and mksSandbox.log from the VM? Thanks!




  • 9.  RE: Graphics artifacts suddenly fill the VM screen after long use of a Kali Linux VM guest with 3D acceleration enabled

    Posted Jul 10, 2025 10:44 AM
      |   view attached

    Attached are all the log files from the folder where the Kali Linux VM is stored. Some sensitive information has been excluded for security reasons.


    Attachment(s)

    zip
    kali-vm-log.zip   180 KB 1 version


  • 10.  RE: Graphics artifacts suddenly fill the VM screen after long use of a Kali Linux VM guest with 3D acceleration enabled

    Broadcom Employee
    Posted Jul 10, 2025 01:23 PM

    I see some errors in the sandbox.log but it's hard to know from where it's coming. Can you please run the VM with full debugging info, reproduce the issue and attach the logs? See https://techdocs.broadcom.com/us/en/vmware-cis/desktop-hypervisors/workstation-pro/17-0/using-vmware-workstation-pro/configuring-virtual-machine-option-settings/configuring-advanced-options-for-a-virtual-machine/gathering-debugging-information.html for how to set this up.




  • 11.  RE: Graphics artifacts suddenly fill the VM screen after long use of a Kali Linux VM guest with 3D acceleration enabled

    Broadcom Employee
    Posted Jul 10, 2025 01:32 PM

    Also please attach dmesg.log and /var/log/kern.log from the Kali linux guest. Thanks!




  • 12.  RE: Graphics artifacts suddenly fill the VM screen after long use of a Kali Linux VM guest with 3D acceleration enabled

    Posted Jul 11, 2025 01:53 PM
      |   view attached
    The same issue was reproduced today. And the corresponding attachment below contains all the logs you requested:
    * vmware.log and mksSandbox.log are generated under full debugging information mode.
    * kern.log is copied directly from the Kali Linux VM.
    * dmesg.log is the output of the dmesg command from the Kali Linux VM.
    Again, I removed some sensitive information for security reasons.
    And I noticed the following error in the log:
    * vmware.log contains huge SVGA Driver errors.
    * kern.log contains vmwgfx errors
     
    I hope these logs can assist in identifying and resolving the issue efficiently.

    Attachment(s)

    zip
    full-debug-log.zip   6.89 MB 1 version


  • 13.  RE: Graphics artifacts suddenly fill the VM screen after long use of a Kali Linux VM guest with 3D acceleration enabled

    Broadcom Employee
    Posted Jul 11, 2025 01:57 PM

    * vmware.log contains huge SVGA Driver errors.
    * kern.log contains vmwgfx errors
    That's what I expected. Please try with the kernel I mentioned with vmwgfx fix is possible



  • 14.  RE: Graphics artifacts suddenly fill the VM screen after long use of a Kali Linux VM guest with 3D acceleration enabled

    Broadcom Employee
    Posted Jul 11, 2025 12:41 PM

    @Ian Forbes mentioned a memory leak with vmwgfx is fixed in kernel 6.12.34 so please try to upgrade to that kernel if possible.




  • 15.  RE: Graphics artifacts suddenly fill the VM screen after long use of a Kali Linux VM guest with 3D acceleration enabled

    Posted Jul 13, 2025 05:20 AM

    Just updated the kernel to 6.12.37. Will let you know if anything comes up!




  • 16.  RE: Graphics artifacts suddenly fill the VM screen after long use of a Kali Linux VM guest with 3D acceleration enabled

    Posted Jul 13, 2025 12:38 PM

    Unfortunately, the issue still persists with kernel 6.12.37 - I'm seeing the same behavior in the Kali Linux VM after about 10 hours of continuous use.

    Would you mind taking a look at the full debug log I uploaded earlier to see if there's anything else I could try or investigate?



  • 17.  RE: Graphics artifacts suddenly fill the VM screen after long use of a Kali Linux VM guest with 3D acceleration enabled

    Posted Jul 18, 2025 08:39 AM

    Using VMware Workstation Pro 17.6.4 and Kali Linux VM guest kernel 6.12.37, the same issue still occurs. The rest of the environment remains unchanged.




  • 18.  RE: Graphics artifacts suddenly fill the VM screen after long use of a Kali Linux VM guest with 3D acceleration enabled

    Broadcom Employee
    Posted 29 days ago

    We have been reproduce this in house and team is working on finding the bug. Does this happen with other distros like Ubuntu or other display managers?




  • 19.  RE: Graphics artifacts suddenly fill the VM screen after long use of a Kali Linux VM guest with 3D acceleration enabled

    Posted 28 days ago

    Glad to hear that you've been able to reproduce the issue. As for other distributions and environments, I haven't used them extensively or over a long period, so I'm not sure if the issue has a broader impact.




  • 20.  RE: Graphics artifacts suddenly fill the VM screen after long use of a Kali Linux VM guest with 3D acceleration enabled

    Posted 26 days ago

    I don't know if this helps, but ...

    ... I just installed the latest Kali 2025 with pretty much defaults. I took KDE Plasma Desktop ... well, why would you use anything else and it kind of feels the most demanding.

    I did not load any VM Tools - despite of that transparency (like for command line windows) works, copy/paste works between the Host and VM-windows resize works. Mouse doesn't move from VM to Host without pressing control-alt - not only a bad thing.

    I don't have 3D acceleration on - not sure why would you use it with Kali/KDE Plasma - what 3D does it really have? None of the other virtualization options for CPU are ON. Side channels midigations are OFF, because my Host is default Windows 11 Pro installation (without taking any of the VBS/Hyper-V thingies off). RAM I extended to 6 GB - the default under 1 GB seemed just wrong. Linux model is just "other Linux 64-bit".

    I'm keeping the VM active by ping (30 second intervals) and it has been now running for almost 24 hours. No problems with graphics or anything else. VMware is 17.5.2.




  • 21.  RE: Graphics artifacts suddenly fill the VM screen after long use of a Kali Linux VM guest with 3D acceleration enabled

    Posted Jul 08, 2025 02:39 AM

    can you tell me how did you enable or install the Wayland in Kali with the VMware Workstation Pro i have AMD Ryzen 7 7840HS w/ Radeon 780M Graphics, 3801 Mhz, 8 Core(s), and the i have RTX 4060 can you teach how can i enable it in my machine currently i am using the Gnome X11 and it sucks i also have the similar problem as you i guess you can check this is my thread:-https://community.broadcom.com/communities/community-home/digestviewer/viewthread?GroupId=7171&MessageKey=afd7b8b3-1564-466d-a45f-466379788268&CommunityKey=fb707ac3-9412-4fad-b7af-018f5da56d9f 




  • 22.  RE: Graphics artifacts suddenly fill the VM screen after long use of a Kali Linux VM guest with 3D acceleration enabled

    Posted Jul 08, 2025 09:46 AM

    The official Kali Linux documentation mentions how to turn on Wayland instead of using the default X11.




  • 23.  RE: Graphics artifacts suddenly fill the VM screen after long use of a Kali Linux VM guest with 3D acceleration enabled

    Posted 24 days ago

    As I write in the other thread about "Kali and distorted graphics", I now set 3D acceleration ON. There are no problems. I used KDE Plasma in Kali - that is just a standard option when installing Kali 2025.

    More details in the other thread.

    -------------------------------------------



  • 24.  RE: Graphics artifacts suddenly fill the VM screen after long use of a Kali Linux VM guest with 3D acceleration enabled

    Posted 23 days ago

    Could you upgrade from VMware Workstation Pro 17.5.2 to 17.6.4 and then rerun the relevant tests? The internal VMware team has already reproduced the issue on version 17.6.3 or 17.6.4 and is currently working on analyzing and resolving it. If you could try to reproduce the issue on 17.6.4 using your specific setup - such as KDE Plasma - and upload the debug logs, it might help move the issue closer to resolution.

    -------------------------------------------



  • 25.  RE: Graphics artifacts suddenly fill the VM screen after long use of a Kali Linux VM guest with 3D acceleration enabled

    Posted 23 days ago

    Just no. I don't have a spare system where I could load a newer, in many ways non-working, version. There is a longer explanation, but I will leave it like this now. In my main system, certainly not, I need it.




  • 26.  RE: Graphics artifacts suddenly fill the VM screen after long use of a Kali Linux VM guest with 3D acceleration enabled

    Posted 23 days ago

    No, but I'm now running Kali 2025 VM with Gnome. Initially, it works with 3D ON. However:

    - menus are bad compared to KDE Plasma
    - I don't know when it will go into Sleep/Suspend/Hibernate/whatever ... did I say that menus are bad, couldn't find those options

    I keep it alive with nping and see what happens with one or two days of uptime.

    -------------------------------------------