VMware vSphere

 View Only

  • 1.  ESXi 6.0 PSOD "GP Exception 13 in world 38249:vmast.38248 @ 0x418028088d64"

    Posted Jul 26, 2017 02:37 PM

    I have analyzed the logs and could not find much information. Below is the back trace which i was able to extract from vmkernel.zdump.

    All i could understand from the below back-trace is that there may be a kernel panic on CPU 17. Need to understand more about this.

    Need help in identifying if there were any hardware issue and understanding the back-trace.

    Hardware used is Cisco B200 M4, Processor "Intel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz"

    2017-07-20T14:16:42.294Z cpu51:33311)<7>fnic : 0 :: Abort Cmd called FCID 0x10600, LUN 0x5 TAG 24 flags 3

    2017-07-20T14:16:42.299Z cpu47:36001)<7>fnic : 0 :: abts cmpl recd. id 36 status FCPIO_SUCCESS

    2017-07-20T14:16:42.299Z cpu51:33311)<7>fnic : 0 :: Returning from abort cmd type 2 SUCCESS

    2017-07-20T14:16:42.299Z cpu33:33357)ScsiDeviceIO: 2652: Cmd(0x43be16ef6e40) 0xfe, CmdSN 0x28e4f2 from world 32830 to dev "naa.600601601950380017dee0a0673ce611" failed H:0x8 D:0x0 P:0x0 Possible sense data: 0x5 0x24 0x0.

    2017-07-21T07:17:54.202Z cpu48:33657)ScsiDeviceIO: 2613: Cmd(0x43b601960dc0) 0xfe, CmdSN 0x45ac98 from world 34355 to dev "naa.600601601950380080562945683ce611" failed H:0x0 D:0x2 P:0x5 Possible sense data: 0x5 0x24 0x0.

    2017-07-22T00:07:38.236Z cpu17:38249)World: 9757: PRDA 0x418044400000 ss 0x0 ds 0x10b es 0x10b fs 0x0 gs 0x13b

    2017-07-22T00:07:38.236Z cpu17:38249)World: 9759: TR 0x4020 GDT 0x439149621000 (0x402f) IDT 0x4180280ca000 (0xfff)

    2017-07-22T00:07:38.236Z cpu17:38249)World: 9760: CR0 0x80010031 CR3 0x30e9f3a000 CR4 0x42768

    2017-07-22T00:07:38.285Z cpu17:38249)Backtrace for current CPU #17, worldID=38249, rbp=0x0

    2017-07-22T00:07:38.285Z cpu17:38249)0x4391ab49baf0:[0x418028088d64]TimerRecomputeInterrupt@vmkernel#nover+0xf4 stack: 0x4391ab4a7000, 0

    2017-07-22T00:07:38.285Z cpu17:38249)0x4391ab49bb20:[0x41802808b49f]Timer_Interrupt@vmkernel#nover+0x117 stack: 0xef, 0x0, 0x0, 0x418028

    2017-07-22T00:07:38.285Z cpu17:38249)0x4391ab49bb50:[0x41802805a652]IntrCookie_DoInterrupt@vmkernel#nover+0x27a stack: 0x7780, 0x0, 0x0,

    2017-07-22T00:07:38.285Z cpu17:38249)0x4391ab49bc00:[0x418028056d60]IDT_IntrHandler@vmkernel#nover+0x104 stack: 0x0, 0x418044400200, 0x0

    2017-07-22T00:07:38.285Z cpu17:38249)0x4391ab49bc30:[0x4180280c8044]gate_entry_@vmkernel#nover+0x0 stack: 0x0, 0x0, 0x0, 0x0, 0x41804440

    2017-07-22T00:07:38.285Z cpu17:38249)0x4391ab49bcf0:[0x41802830515a]Power_HaltPCPU@vmkernel#nover+0x1ee stack: 0x417fe8283f20, 0x4180445

    2017-07-22T00:07:38.285Z cpu17:38249)0x4391ab49bd40:[0x418028212078]CpuSchedIdleLoopInt@vmkernel#nover+0x2f8 stack: 0x1ba1f9a2d4e578, 0x

    2017-07-22T00:07:38.285Z cpu17:38249)0x4391ab49bdc0:[0x4180282157d3]CpuSchedDispatch@vmkernel#nover+0x16b3 stack: 0x2054c7, 0x4391ab4270

    2017-07-22T00:07:38.285Z cpu17:38249)0x4391ab49bee0:[0x418028216398]CpuSchedWait@vmkernel#nover+0x240 stack: 0x0, 0x0, 0x1d01e4c000, 0x0

    2017-07-22T00:07:38.285Z cpu17:38249)0x4391ab49bf60:[0x418028093c10]VmAssistantProcessTasks@vmkernel#nover+0x1bc stack: 0x956800000000,

    2017-07-22T00:07:38.285Z cpu17:38249)0x4391ab49bfd0:[0x41802821702e]CpuSched_StartWorld@vmkernel#nover+0xa2 stack: 0x0, 0x0, 0x0, 0x0, 0

    2017-07-22T00:07:38.307Z cpu17:38249) [45m [33;1mVMware ESXi 6.0.0 [Releasebuild-5572656 x86_64] [0m

    #GP Exception 13 in world 38249:vmast.38248 @ 0x418028088d64

    2017-07-22T00:07:38.307Z cpu17:38249)cr0=0x8001003d cr2=0x34ed5000 cr3=0x2f14000 cr4=0x216c

    2017-07-22T00:07:38.308Z cpu17:38249)frame=0x4391ab49ba30 ip=0x418028088d64 err=0 rflags=0x10046

    2017-07-22T00:07:38.308Z cpu17:38249)rax=0x4390c6ea2378 rbx=0x4912af rcx=0x1ba1f9a441a904

    2017-07-22T00:07:38.308Z cpu17:38249)rdx=0x1ba1f9a5aeed16 rbp=0x0 rsi=0x417fe801bdc0

    2017-07-22T00:07:38.308Z cpu17:38249)rdi=0x4390c6ea2000 r8=0xd69 r9=0x418044101e00

    2017-07-22T00:07:38.309Z cpu17:38249)r10=0x4390c6ea2378 r11=0x418044501ec0 r12=0x1ba1f9a4600000

    2017-07-22T00:07:38.309Z cpu17:38249)r13=0x1ba1f9a5a00000 r14=0x1 r15=0x0

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:0 world:38250 name:"vmm1:ts3inssv122_(db453a62-a83f-4894-92a6-c54a83d47e4a)" (V)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:1 world:33478 name:"vmnic2-pollWorld-1" (S)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:2 world:40864 name:"vmm0:ts3inssv1600322_(5675cb44-4d92-4157-9bb0-69863dbd20cd)" (V)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:3 world:38238 name:"vmm0:ts3inssv370_(cc19274f-2edd-4581-b6b5-b2f64f1be269)" (V)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:4 world:32834 name:"netCoalesce2World" (S)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:5 world:33570 name:"SegThread2" (S)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:6 world:33631 name:"net-lacp" (U)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:7 world:6137633 name:"vmm0:win7-07_(196cb685-35a5-49d6-b67a-4629216f64e1)" (V)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:8 world:38251 name:"vmm2:ts3inssv122_(db453a62-a83f-4894-92a6-c54a83d47e4a)" (V)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:9 world:33480 name:"vmnic3-pollWorld-0" (S)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:10 world:38206 name:"vmm2:ts3inssv202_(6bbca7f6-ec50-4e1a-86f2-fd56434f85ad)" (V)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:11 world:36001 name:"netcpa-worker" (U)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:12 world:38207 name:"vmm3:ts3inssv202_(6bbca7f6-ec50-4e1a-86f2-fd56434f85ad)" (V)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:13 world:38241 name:"vmm2:ts3inssv370_(cc19274f-2edd-4581-b6b5-b2f64f1be269)" (V)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:14 world:37258 name:"vpxa-worker" (U)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:15 world:38229 name:"vmast.38228" (S)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:16 world:38252 name:"vmm3:ts3inssv122_(db453a62-a83f-4894-92a6-c54a83d47e4a)" (V)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:17 world:38249 name:"vmast.38248" (S)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:18 world:40866 name:"vmm1:ts3inssv1600322_(5675cb44-4d92-4157-9bb0-69863dbd20cd)" (V)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:19 world:6137637 name:"vmm3:win7-07_(196cb685-35a5-49d6-b67a-4629216f64e1)" (V)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:20 world:38242 name:"vmm3:ts3inssv370_(cc19274f-2edd-4581-b6b5-b2f64f1be269)" (V)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:21 world:33273 name:"memMap-21" (S)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:22 world:33017 name:"CpuMetricsLoadHistory" (S)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:23 world:33909 name:"VSIP PF Purge Thread" (S)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:24 world:33530 name:"tq:tcpip4" (S)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:25 world:38232 name:"vmm3:ts3inssv362_(a32184e3-74fb-4d57-aabe-c7d152d4d40a)" (V)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:26 world:38248 name:"vmm0:ts3inssv122_(db453a62-a83f-4894-92a6-c54a83d47e4a)" (V)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:27 world:33531 name:"tq:tcpip4-flow-affinitizer" (S)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:28 world:36326 name:"openwsmand" (U)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:29 world:33580 name:"SegThread12" (S)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:30 world:35640 name:"vpxa-worker" (U)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:31 world:34608 name:"hostd-worker" (U)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:32 world:37250 name:"vpxa-worker" (U)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:33 world:33356 name:"vmsyslogd" (U)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:34 world:33012 name:"memsched-periodic" (S)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:35 world:33671 name:"EmcMpioVolIoDispatchDaemon" (S)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:36 world:6436159 name:"vpxa-worker" (U)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:37 world:6443403 name:"vpxa-worker" (U)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:38 world:36826 name:"vpxa-worker" (U)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:39 world:35114 name:"hostd-worker" (U)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:40 world:36573 name:"dfwpktlogs" (U)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:41 world:33293 name:"memMap-41" (S)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:42 world:6441126 name:"vpxa-worker" (U)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:43 world:35830 name:"vemdpa" (U)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:44 world:34879 name:"hostd-worker" (U)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:45 world:35121 name:"hostd-worker" (U)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:46 world:32833 name:"coalesceWorld-0" (S)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:47 world:35115 name:"hostd-worker" (U)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:48 world:6683272 name:"vpxa-worker" (U)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:49 world:33424 name:"helper39-5" (SH)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:50 world:37438 name:"fdm" (U)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:51 world:6686103 name:"vpxa-worker" (U)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:52 world:37256 name:"vpxa-worker" (U)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:53 world:33305 name:"memMap-53" (S)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:54 world:36005 name:"netcpa-worker" (U)

    2017-07-22T00:07:38.309Z cpu17:38249)pcpu:55 world:33884 name:"helper59-0" (SH)

    2017-07-22T00:07:38.309Z cpu17:38249)@BlueScreen: #GP Exception 13 in world 38249:vmast.38248 @ 0x418028088d64

    2017-07-22T00:07:38.309Z cpu17:38249)Code start: 0x418028000000 VMK uptime: 37:14:18:23.572

    2017-07-22T00:07:38.310Z cpu17:38249)0x4391ab49baf0:[0x418028088d64]TimerRecomputeInterrupt@vmkernel#nover+0xf4 stack: 0x4391ab4a7000

    2017-07-22T00:07:38.310Z cpu17:38249)0x4391ab49bb20:[0x41802808b49f]Timer_Interrupt@vmkernel#nover+0x117 stack: 0xef

    2017-07-22T00:07:38.311Z cpu17:38249)0x4391ab49bb50:[0x41802805a652]IntrCookie_DoInterrupt@vmkernel#nover+0x27a stack: 0x7780

    2017-07-22T00:07:38.311Z cpu17:38249)0x4391ab49bc00:[0x418028056d60]IDT_IntrHandler@vmkernel#nover+0x104 stack: 0x0

    2017-07-22T00:07:38.311Z cpu17:38249)0x4391ab49bc30:[0x4180280c8044]gate_entry_@vmkernel#nover+0x0 stack: 0x0

    2017-07-22T00:07:38.312Z cpu17:38249)0x4391ab49bcf0:[0x41802830515a]Power_HaltPCPU@vmkernel#nover+0x1ee stack: 0x417fe8283f20

    2017-07-22T00:07:38.312Z cpu17:38249)0x4391ab49bd40:[0x418028212078]CpuSchedIdleLoopInt@vmkernel#nover+0x2f8 stack: 0x1ba1f9a2d4e578

    2017-07-22T00:07:38.313Z cpu17:38249)0x4391ab49bdc0:[0x4180282157d3]CpuSchedDispatch@vmkernel#nover+0x16b3 stack: 0x2054c7

    2017-07-22T00:07:38.313Z cpu17:38249)0x4391ab49bee0:[0x418028216398]CpuSchedWait@vmkernel#nover+0x240 stack: 0x0

    2017-07-22T00:07:38.313Z cpu17:38249)0x4391ab49bf60:[0x418028093c10]VmAssistantProcessTasks@vmkernel#nover+0x1bc stack: 0x956800000000

    2017-07-22T00:07:38.314Z cpu17:38249)0x4391ab49bfd0:[0x41802821702e]CpuSched_StartWorld@vmkernel#nover+0xa2 stack: 0x0

    2017-07-22T00:07:38.318Z cpu17:38249)base fs=0x0 gs=0x418044400000 Kgs=0x0

    2017-07-22T00:07:38.318Z cpu17:38249)vmkernel             0x0 .data 0x0 .bss 0x0

    2017-07-22T00:07:38.318Z cpu17:38249)chardevs             0x4180285bc000 .data 0x417fc0000000 .bss 0x417fc00003c0

    2017-07-22T00:07:38.318Z cpu17:38249)user                 0x4180285c3000 .data 0x417fc0400000 .bss 0x417fc040f900

    2017-07-22T00:07:38.318Z cpu17:38249)vsanapi              0x418028690000 .data 0x417fc0800000 .bss 0x417fc0802480

    2017-07-22T00:07:38.318Z cpu17:38249)vsanbase             0x418028698000 .data 0x417fc0c00000 .bss 0x417fc0c089c0

    2017-07-22T00:07:38.318Z cpu17:38249)vprobe               0x4180286a5000 .data 0x417fc1000000 .bss 0x417fc100e540

    2017-07-22T00:07:38.318Z cpu17:38249)vmkapi_mgmt          0x4180286ee000 .data 0x417fc1400000 .bss 0x417fc1400180

    2017-07-22T00:07:38.318Z cpu17:38249)procfs               0x4180286f3000 .data 0x417fc1800000 .bss 0x417fc1800240

    2017-07-22T00:07:38.318Z cpu17:38249)vmkapi_v2_2_0_0_mgmt_shim 0x4180286f6000 .data 0x417fc1c00000 .bss 0x417fc1c001a0

    2017-07-22T00:07:38.318Z cpu17:38249)vmkapi_v2_1_0_0_vmkernel_shim 0x4180286f7000 .data 0x417fc2000000 .bss 0x417fc2008a80

    2017-07-22T00:07:38.318Z cpu17:38249)vmkapi_v2_0_0_0_vmkernel_shim 0x4180286fd000 .data 0x417fc2400000 .bss 0x417fc2408100

    2017-07-22T00:07:38.318Z cpu17:38249)iodm                 0x418028703000 .data 0x417fc2800000 .bss 0x417fc2800138

    2017-07-22T00:07:38.318Z cpu17:38249)vmkapi_v2_2_0_0_vmkernel_shim 0x418028707000 .data 0x417fc2c00000 .bss 0x417fc2c0c800

    2017-07-22T00:07:38.318Z cpu17:38249)dma_mapper_iommu     0x41802870d000 .data 0x417fc3000000 .bss 0x417fc3000080

    2017-07-22T00:07:38.318Z cpu17:38249)vmkplexer            0x418028710000 .data 0x417fc3400000 .bss 0x417fc3400260

    2017-07-22T00:07:38.318Z cpu17:38249)vmklinux_9           0x418028714000 .data 0x417fc3800000 .bss 0x417fc3808ec0

    2017-07-22T00:07:38.318Z cpu17:38249)vmklinux_9_2_0_0     0x4180287a9000 .data 0x417fc3c00000 .bss 0x417fc3c07e84

    2017-07-22T00:07:38.318Z cpu17:38249)vmklinux_9_2_1_0     0x4180287ac000 .data 0x417fc4000000 .bss 0x417fc4007f98

    2017-07-22T00:07:38.318Z cpu17:38249)vmklinux_9_2_2_0     0x4180287af000 .data 0x417fc4400000 .bss 0x417fc4408798

    2017-07-22T00:07:38.318Z cpu17:38249)vmklinux_9_2_3_0     0x4180287b2000 .data 0x417fc4800000 .bss 0x417fc4808ad8

    2017-07-22T00:07:38.318Z cpu17:38249)iscsi_trans          0x4180287b5000 .data 0x417fc4c00000 .bss 0x417fc4c01800

    2017-07-22T00:07:38.318Z cpu17:38249)iscsi_trans_compat_shim 0x4180287c1000 .data 0x417fc5000000 .bss 0x417fc500096c

    2017-07-22T00:07:38.318Z cpu17:38249)iscsi_trans_incompat_shim 0x4180287c2000 .data 0x417fc5400000 .bss 0x417fc54007e4

    2017-07-22T00:07:38.318Z cpu17:38249)etherswitch          0x4180287c3000 .data 0x417fc5800000 .bss 0x417fc5814e40

    2017-07-22T00:07:38.318Z cpu17:38249)netsched             0x418028808000 .data 0x417fc5c00000 .bss 0x417fc5c03d40

    2017-07-22T00:07:38.318Z cpu17:38249)netioc               0x418028817000 .data 0x417fc6000000 .bss 0x417fc60000a0

    2017-07-22T00:07:38.318Z cpu17:38249)random               0x41802881d000 .data 0x417fc6400000 .bss 0x417fc6400600

    2017-07-22T00:07:38.318Z cpu17:38249)cnic_register        0x418028821000 .data 0x417fc6800000 .bss 0x417fc68001e0

    2017-07-22T00:07:38.318Z cpu17:38249)enic                 0x418028823000 .data 0x417fc6c00000 .bss 0x417fc6c00380

    2017-07-22T00:07:38.318Z cpu17:38249)usb                  0x418028837000 .data 0x417fc7000000 .bss 0x417fc7001680

    2017-07-22T00:07:38.318Z cpu17:38249)ehci-hcd             0x41802885d000 .data 0x417fc7400000 .bss 0x417fc74002a0

    2017-07-22T00:07:38.318Z cpu17:38249)hid                  0x418028869000 .data 0x417fc7800000 .bss 0x417fc78004e0

    2017-07-22T00:07:38.318Z cpu17:38249)dm                   0x41802886f000 .data 0x417fc7c00000 .bss 0x417fc7c00000

    2017-07-22T00:07:38.318Z cpu17:38249)nmp                  0x418028872000 .data 0x417fc8000000 .bss 0x417fc8004010

    2017-07-22T00:07:38.318Z cpu17:38249)vmw_satp_local       0x41802889d000 .data 0x417fc8400000 .bss 0x417fc8400028

    2017-07-22T00:07:38.318Z cpu17:38249)vmw_satp_default_aa  0x41802889f000 .data 0x417fc8800000 .bss 0x417fc8800000

    2017-07-22T00:07:38.318Z cpu17:38249)vmw_psp_lib          0x4180288a1000 .data 0x417fc8c00000 .bss 0x417fc8c00290

    2017-07-22T00:07:38.318Z cpu17:38249)vmw_psp_fixed        0x4180288a3000 .data 0x417fc9000000 .bss 0x417fc9000000

    2017-07-22T00:07:38.318Z cpu17:38249)vmw_psp_rr           0x4180288a6000 .data 0x417fc9400000 .bss 0x417fc9400068

    2017-07-22T00:07:38.318Z cpu17:38249)vmw_psp_mru          0x4180288a9000 .data 0x417fc9800000 .bss 0x417fc9800000

    2017-07-22T00:07:38.318Z cpu17:38249)libata_92            0x4180288ab000 .data 0x417fc9c00000 .bss 0x417fc9c02660

    2017-07-22T00:07:38.318Z cpu17:38249)libata_9_2_0_0       0x4180288d0000 .data 0x417fca000000 .bss 0x417fca001750

    2017-07-22T00:07:38.318Z cpu17:38249)libata_9_2_1_0       0x4180288d1000 .data 0x417fca400000 .bss 0x417fca401750

    2017-07-22T00:07:38.318Z cpu17:38249)libata_9_2_2_0       0x4180288d2000 .data 0x417fca800000 .bss 0x417fca801750

    2017-07-22T00:07:38.318Z cpu17:38249)usb-storage          0x4180288d3000 .data 0x417fcac00000 .bss 0x417fcac04b00

    2017-07-22T00:07:38.318Z cpu17:38249)emcp                 0x4180288e0000 .data 0x417fcb000000 .bss 0x417fcb000660

    2017-07-22T00:07:38.318Z cpu17:38249)healthchk            0x418028948000 .data 0x417fcb400000 .bss 0x417fcb412ae0

    2017-07-22T00:07:38.318Z cpu17:38249)teamcheck            0x41802895e000 .data 0x417fcb800000 .bss 0x417fcb813000

    2017-07-22T00:07:38.318Z cpu17:38249)vlanmtucheck         0x418028971000 .data 0x417fcbc00000 .bss 0x417fcbc12d40

    2017-07-22T00:07:38.318Z cpu17:38249)heartbeat            0x418028986000 .data 0x417fcc000000 .bss 0x417fcc012f00

    2017-07-22T00:07:38.318Z cpu17:38249)shaper               0x41802899b000 .data 0x417fcc400000 .bss 0x417fcc414c80

    2017-07-22T00:07:38.318Z cpu17:38249)lldp                 0x4180289b0000 .data 0x417fcc800000 .bss 0x417fcc800040

    2017-07-22T00:07:38.318Z cpu17:38249)cdp                  0x4180289b5000 .data 0x417fccc00000 .bss 0x417fccc14180

    2017-07-22T00:07:38.319Z cpu17:38249)ipfix                0x4180289cf000 .data 0x417fcd000000 .bss 0x417fcd013380

    2017-07-22T00:07:38.319Z cpu17:38249)tcpip4               0x4180289e6000 .data 0x417fcd400000 .bss 0x417fcd418600

    2017-07-22T00:07:38.319Z cpu17:38249)dvsdev               0x418028b45000 .data 0x417fcd800000 .bss 0x417fcd800040

    2017-07-22T00:07:38.319Z cpu17:38249)vmci                 0x418028b48000 .data 0x417fcdc00000 .bss 0x417fcdc059c0

    2017-07-22T00:07:38.319Z cpu17:38249)dvfilter             0x418028b6d000 .data 0x417fce000000 .bss 0x417fce000b00

    2017-07-22T00:07:38.319Z cpu17:38249)lacp                 0x418028b8e000 .data 0x417fce400000 .bss 0x417fce400180

    2017-07-22T00:07:38.319Z cpu17:38249)vmkapi_v2_1_0_0_dvfilter_shim 0x418028b9c000 .data 0x417fce800000 .bss 0x417fce8009f0

    2017-07-22T00:07:38.319Z cpu17:38249)vmkapi_v2_2_0_0_dvfilter_shim 0x418028b9d000 .data 0x417fcec00000 .bss 0x417fcec009f0

    2017-07-22T00:07:38.319Z cpu17:38249)vmkapi_v2_0_0_0_dvfilter_shim 0x418028b9e000 .data 0x417fcf000000 .bss 0x417fcf000930

    2017-07-22T00:07:38.319Z cpu17:38249)esxfw                0x418028b9f000 .data 0x417fcf400000 .bss 0x417fcf413a00

    2017-07-22T00:07:38.319Z cpu17:38249)vem-v198-l2device    0x418028bb6000 .data 0x417fcf800000 .bss 0x417fcf8003a0

    2017-07-22T00:07:38.319Z cpu17:38249)vem-v198-n1kv        0x418028bc1000 .data 0x417fcfc00000 .bss 0x417fcfc01320

    2017-07-22T00:07:38.319Z cpu17:38249)vem-v198-vssnet      0x418028bed000 .data 0x417fd0000000 .bss 0x417fd00100a0

    2017-07-22T00:07:38.319Z cpu17:38249)vem-v198-stun        0x41802907e000 .data 0x417fd0600000 .bss 0x417fd0600340

    2017-07-22T00:07:38.319Z cpu17:38249)libfc_92             0x4180290a6000 .data 0x417fd0a00000 .bss 0x417fd0a00540

    2017-07-22T00:07:38.319Z cpu17:38249)libfcoe_92           0x4180290c1000 .data 0x417fd0e00000 .bss 0x417fd0e001e0

    2017-07-22T00:07:38.319Z cpu17:38249)libfc_9_2_0_0        0x4180290ca000 .data 0x417fd1200000 .bss 0x417fd1200868

    2017-07-22T00:07:38.319Z cpu17:38249)libfcoe_9_2_0_0      0x4180290cb000 .data 0x417fd1600000 .bss 0x417fd16001f4

    2017-07-22T00:07:38.319Z cpu17:38249)libfc_9_2_1_0        0x4180290cc000 .data 0x417fd1a00000 .bss 0x417fd1a00868

    2017-07-22T00:07:38.319Z cpu17:38249)libfcoe_9_2_1_0      0x4180290cd000 .data 0x417fd1e00000 .bss 0x417fd1e001f4

    2017-07-22T00:07:38.319Z cpu17:38249)libfcoe_9_2_2_0      0x4180290ce000 .data 0x417fd2200000 .bss 0x417fd22001f4

    2017-07-22T00:07:38.319Z cpu17:38249)libfc_9_2_2_0        0x4180290cf000 .data 0x417fd2600000 .bss 0x417fd2600868

    2017-07-22T00:07:38.319Z cpu17:38249)fnic                 0x4180290d0000 .data 0x417fd2a00000 .bss 0x417fd2a00780

    2017-07-22T00:07:38.319Z cpu17:38249)dvfilter-generic-fastpath 0x4180290ee000 .data 0x417fd2e00000 .bss 0x417fd2e13080

    2017-07-22T00:07:38.319Z cpu17:38249)dvfilter-switch-security 0x41802910a000 .data 0x417fd3200000 .bss 0x417fd3200440

    2017-07-22T00:07:38.319Z cpu17:38249)traceflow            0x418029124000 .data 0x417fd3600000 .bss 0x417fd36001c0

    2017-07-22T00:07:38.319Z cpu17:38249)bfd                  0x418029128000 .data 0x417fd3a00000 .bss 0x417fd3a001c0

    2017-07-22T00:07:38.319Z cpu17:38249)vdl2                 0x41802912e000 .data 0x417fd3e00000 .bss 0x417fd3e00360

    2017-07-22T00:07:38.319Z cpu17:38249)vdrb                 0x418029187000 .data 0x417fd4200000 .bss 0x417fd4200700

    2017-07-22T00:07:38.319Z cpu17:38249)vmkibft              0x4180291d4000 .data 0x417fd4600000 .bss 0x417fd4603960

    2017-07-22T00:07:38.319Z cpu17:38249)vaai_filter          0x4180291d8000 .data 0x417fd4a00000 .bss 0x417fd4a02960

    2017-07-22T00:07:38.319Z cpu17:38249)vmw_vaaip_emc        0x4180291dc000 .data 0x417fd4e00000 .bss 0x417fd4e00058

    2017-07-22T00:07:38.319Z cpu17:38249)vmw_satp_lib_cx      0x4180291dd000 .data 0x417fd5200000 .bss 0x417fd5200130

    2017-07-22T00:07:38.319Z cpu17:38249)vmw_vaaip_cx         0x4180291df000 .data 0x417fd5600000 .bss 0x417fd5600008

    2017-07-22T00:07:38.319Z cpu17:38249)lvmdriver            0x4180291e1000 .data 0x417fd5a00000 .bss 0x417fd5a03500

    2017-07-22T00:07:38.319Z cpu17:38249)deltadisk            0x4180291fb000 .data 0x417fd5e00000 .bss 0x417fd5e07e40

    2017-07-22T00:07:38.319Z cpu17:38249)vdfm                 0x418029232000 .data 0x417fd6200000 .bss 0x417fd62001c0

    2017-07-22T00:07:38.319Z cpu17:38249)tracing              0x418029237000 .data 0x417fd6600000 .bss 0x417fd6606380

    2017-07-22T00:07:38.319Z cpu17:38249)rdt                  0x418029240000 .data 0x417fd6a00000 .bss 0x417fd6a05840

    2017-07-22T00:07:38.319Z cpu17:38249)vsanutil             0x41802927c000 .data 0x417fd6e00000 .bss 0x417fd6e0a5c0

    2017-07-22T00:07:38.319Z cpu17:38249)lsomcommon           0x4180292a5000 .data 0x417fd7200000 .bss 0x417fd7201940

    2017-07-22T00:07:38.319Z cpu17:38249)plog                 0x4180292e6000 .data 0x417fd7600000 .bss 0x417fd76084d0

    2017-07-22T00:07:38.319Z cpu17:38249)gss                  0x418029394000 .data 0x417fd7a00000 .bss 0x417fd7a02ad8

    2017-07-22T00:07:38.319Z cpu17:38249)vmfs3                0x4180293ba000 .data 0x417fd7e00000 .bss 0x417fd7e03b00

    2017-07-22T00:07:38.319Z cpu17:38249)sunrpc               0x418029438000 .data 0x417fd8200000 .bss 0x417fd8203880

    2017-07-22T00:07:38.319Z cpu17:38249)virsto               0x418029452000 .data 0x417fd8600000 .bss 0x417fd8600980

    2017-07-22T00:07:38.319Z cpu17:38249)lsom                 0x4180294c4000 .data 0x417fd8a00000 .bss 0x417fd8a0afa0

    2017-07-22T00:07:38.319Z cpu17:38249)ufs                  0x4180295a6000 .data 0x417fd8e00000 .bss 0x417fd8e008c0

    2017-07-22T00:07:38.319Z cpu17:38249)vfat                 0x4180295b9000 .data 0x417fd9200000 .bss 0x417fd9202800

    2017-07-22T00:07:38.319Z cpu17:38249)dvfg-igmp            0x4180295c4000 .data 0x417fd9600000 .bss 0x417fd9600208

    2017-07-22T00:07:38.319Z cpu17:38249)cmmds_net            0x4180295ca000 .data 0x417fd9a00000 .bss 0x417fd9a03740

    2017-07-22T00:07:38.319Z cpu17:38249)cmmds                0x4180295de000 .data 0x417fd9e00000 .bss 0x417fd9e05e80

    2017-07-22T00:07:38.319Z cpu17:38249)cmmds_resolver       0x41802964e000 .data 0x417fda200000 .bss 0x417fda200110

    2017-07-22T00:07:38.319Z cpu17:38249)vsan                 0x41802965f000 .data 0x417fda600000 .bss 0x417fda617780

    2017-07-22T00:07:38.319Z cpu17:38249)vmklink_mpi          0x4180297c3000 .data 0x417fdaa00000 .bss 0x417fdaa025c0

    2017-07-22T00:07:38.319Z cpu17:38249)swapobj              0x4180297c9000 .data 0x417fdae00000 .bss 0x417fdae03268

    2017-07-22T00:07:38.319Z cpu17:38249)nfsclient            0x4180297d2000 .data 0x417fdb200000 .bss 0x417fdb203ca0

    2017-07-22T00:07:38.319Z cpu17:38249)nfs41client          0x4180297ed000 .data 0x417fdb600000 .bss 0x417fdb605600

    2017-07-22T00:07:38.319Z cpu17:38249)vflash               0x418029851000 .data 0x417fdba00000 .bss 0x417fdba03700

    2017-07-22T00:07:38.319Z cpu17:38249)vmkapei              0x41802985c000 .data 0x417fdbe00000 .bss 0x417fdbe00b20

    2017-07-22T00:07:38.319Z cpu17:38249)procMisc             0x418029865000 .data 0x417fdc200000 .bss 0x417fdc200000

    2017-07-22T00:07:38.319Z cpu17:38249)ipmi_msghandler      0x418029866000 .data 0x417fdc600000 .bss 0x417fdc6005e0

    2017-07-22T00:07:38.319Z cpu17:38249)ipmi_si_drv          0x41802986f000 .data 0x417fdca00000 .bss 0x417fdca00660

    2017-07-22T00:07:38.319Z cpu17:38249)ipmi_devintf         0x41802987a000 .data 0x417fdce00000 .bss 0x417fdce00180

    2017-07-22T00:07:38.319Z cpu17:38249)vmkapi_v2_2_0_0_nmp_shim 0x41802987d000 .data 0x417fdd200000 .bss 0x417fdd200d68

    2017-07-22T00:07:38.319Z cpu17:38249)vmkapi_v2_0_0_0_nmp_shim 0x41802987e000 .data 0x417fdd600000 .bss 0x417fdd600ce8

    2017-07-22T00:07:38.319Z cpu17:38249)vmkapi_v2_1_0_0_nmp_shim 0x41802987f000 .data 0x417fdda00000 .bss 0x417fdda00ce8

    2017-07-22T00:07:38.319Z cpu17:38249)vmkapi_v2_2_0_0_iscsi_shim 0x418029880000 .data 0x417fdde00000 .bss 0x417fdde00970

    2017-07-22T00:07:38.319Z cpu17:38249)vmkapi_v2_1_0_0_iscsi_shim 0x418029881000 .data 0x417fde200000 .bss 0x417fde200970

    2017-07-22T00:07:38.319Z cpu17:38249)vmkapi_v2_0_0_0_iscsi_shim 0x418029882000 .data 0x417fde600000 .bss 0x417fde600970

    2017-07-22T00:07:38.319Z cpu17:38249)vmkstatelogger       0x418029883000 .data 0x417fdea00000 .bss 0x417fdea03840

    2017-07-22T00:07:38.319Z cpu17:38249)hbr_filter           0x4180298aa000 .data 0x417fdee00000 .bss 0x417fdee002c0

    2017-07-22T00:07:38.319Z cpu17:38249)ftcpt                0x4180298d6000 .data 0x417fdf200000 .bss 0x417fdf203000

    2017-07-22T00:07:38.319Z cpu17:38249)svmmirror            0x418029914000 .data 0x417fdf600000 .bss 0x417fdf600100

    2017-07-22T00:07:38.319Z cpu17:38249)cbt                  0x418029921000 .data 0x417fdfa00000 .bss 0x417fdfa00080

    2017-07-22T00:07:38.319Z cpu17:38249)migrate              0x418029925000 .data 0x417fdfe00000 .bss 0x417fdfe05100

    2017-07-22T00:07:38.319Z cpu17:38249)vsip                 0x418029990000 .data 0x417fe0200000 .bss 0x417fe0200f40

    2017-07-22T00:07:38.319Z cpu17:38249)filtmod              0x418029a1e000 .data 0x417fe0600000 .bss 0x417fe0603fc0

    2017-07-22T00:07:38.319Z cpu17:38249)vfc                  0x418029a2e000 .data



  • 2.  RE: ESXi 6.0 PSOD "GP Exception 13 in world 38249:vmast.38248 @ 0x418028088d64"
    Best Answer

    Posted Jul 26, 2017 10:01 PM

    Processor "Intel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz"

    Backtrace

    2017-07-22T00:07:38.309Z cpu17:38249)@BlueScreen: #GP Exception 13 in world 38249:vmast.38248 @ 0x418028088d64

    2017-07-22T00:07:38.309Z cpu17:38249)Code start: 0x418028000000 VMK uptime: 37:14:18:23.572

    2017-07-22T00:07:38.310Z cpu17:38249)0x4391ab49baf0:[0x418028088d64]TimerRecomputeInterrupt@vmkernel#nover+0xf4 stack: 0x4391ab4a7000

    2017-07-22T00:07:38.310Z cpu17:38249)0x4391ab49bb20:[0x41802808b49f]Timer_Interrupt@vmkernel#nover+0x117 stack: 0xef

    2017-07-22T00:07:38.311Z cpu17:38249)0x4391ab49bb50:[0x41802805a652]IntrCookie_DoInterrupt@vmkernel#nover+0x27a stack: 0x7780

    2017-07-22T00:07:38.311Z cpu17:38249)0x4391ab49bc00:[0x418028056d60]IDT_IntrHandler@vmkernel#nover+0x104 stack: 0x0

    2017-07-22T00:07:38.311Z cpu17:38249)0x4391ab49bc30:[0x4180280c8044]gate_entry_@vmkernel#nover+0x0 stack: 0x0

    2017-07-22T00:07:38.312Z cpu17:38249)0x4391ab49bcf0:[0x41802830515a]Power_HaltPCPU@vmkernel#nover+0x1ee stack: 0x417fe8283f20

    2017-07-22T00:07:38.312Z cpu17:38249)0x4391ab49bd40:[0x418028212078]CpuSchedIdleLoopInt@vmkernel#nover+0x2f8 stack: 0x1ba1f9a2d4e578

    2017-07-22T00:07:38.313Z cpu17:38249)0x4391ab49bdc0:[0x4180282157d3]CpuSchedDispatch@vmkernel#nover+0x16b3 stack: 0x2054c7

    2017-07-22T00:07:38.313Z cpu17:38249)0x4391ab49bee0:[0x418028216398]CpuSchedWait@vmkernel#nover+0x240 stack: 0x0

    2017-07-22T00:07:38.313Z cpu17:38249)0x4391ab49bf60:[0x418028093c10]VmAssistantProcessTasks@vmkernel#nover+0x1bc stack:

    2017-07-22T00:07:38.307Z cpu17:38249) [45m [33;1mVMware ESXi 6.0.0 [Releasebuild-5572656 x86_64] [0m

    Each VM is having multiple worlds that can be seen in the esxtop. vmast: This world is used for memory scanning.  This can be identified by the GID which will be common for all the worlds for the give Virtual machine

    Understanding Exception 13 and Exception 14 purple diagnostic screen events in ESX 3.x/4.x and ESXi 3.x/4.x/5.x/6.x (102…

    A general protection fault (Exception 13) occurs under one of these circumstances:

    1.The page being requested does not belong to the program requesting it (and is not mapped in program memory)

    2.The program does not have rights to perform a read or write operation on the page

    The Exception 13 General Protection Fault may be caused by either a hardware or a software issue.

    Further looking

    ESXi host fails with PSOD when using Intel Xeon Processor E5 v4, E7 v4, and D-1500 families (2146388) | VMware KB

    Look into additional info. similar backtrace is visible. Reported issue can occur when running a supported version of ESXi host with Intel Xeon Processor E5 v4, E7 v4, and D-1500 families, you may experience these symptoms. Looks like its a Hardware issue and need  system BIOS (firmware) upgrade. Check kb for more details.

    If you found this or any other answer helpful, please consider the use of the Correct or Helpful to award points.

    Best Regards,

    Deepak Koshal

    CNE|CLA|CWMA|VCP4|VCP5|CCAH