VMQ + Broadcom crashes servers

Yesterday I rebooted one of my hosts, and another host just crashed out of nowhere.
After some diggin’ this event shows in the eventviewer:

Event ID 113
Failed to allocate VMQ for NIC C777500C-AA7A-4F61-8862-0B8D09A2E967--A6F60352-0C31-4F30-9F27-F3FC8C1D5F87 (Friendly Name: VM) on switch DA1BEF5D-95DD-46FE-9E9E-43DE05FFCDDB (Friendly Name: Local). Reason - Maximum number of VMQs supported on the Protocol NIC is exceeded. Status = Insufficient system resources exist to complete the API.

Log Name:      System
Source:        Microsoft-Windows-Hyper-V-VmSwitch
Date:          8/22/2013 3:59:10 PM
Event ID:      113
Task Category: None
Level:         Error
Keywords:      
User:          S-1-5-83-1-3346485260-1331800698-2366333576-1743364617
Computer:      Hv01
Description:
Failed to allocate VMQ for NIC C777500C-AA7A-4F61-8862-0B8D09A2E967--A6F60352-0C31-4F30-9F27-F3FC8C1D5F87 (Friendly Name: VM) on switch DA1BEF5D-95DD-46FE-9E9E-43DE05FFCDDB (Friendly Name: Local). Reason - Maximum number of VMQs supported on the Protocol NIC is exceeded. Status = Insufficient system resources exist to complete the API.

After a second,thirth and fourth crash I was able to get a bluescreen captured and google the Errorcode.

Full_DPC_Watchdog_Violation

Found this knowlegde base article / hotfix (December 2012!) http://support.microsoft.com/kb/2789962 which says “Assume that you have a Windows Server 2012-based computer that has many third-party drivers installed. ” and yes we have some broadcom drivers!
After installing this hotfix, the server still crashed. After disabling VMQ (Disable-networkadaptervmq) the crashing stopped.

Dumpfile:

Probably caused by : tcpip.sys ( tcpip+6b869 )


DPC_WATCHDOG_VIOLATION (133)
The DPC watchdog detected a prolonged run time at an IRQL of DISPATCH_LEVEL
or above.
Arguments:
Arg1: 0000000000000000, A single DPC or ISR exceeded its time allotment. The offending
    component can usually be identified with a stack trace.
Arg2: 0000000000000504, The DPC time count (in ticks).
Arg3: 0000000000000503, The DPC time allotment (in ticks).
Arg4: 0000000000000000

So it seems like a combonation with VMQ and Broadcom NIC’s.
When the Maximum number of VMQ’s is reached, problems occur.

2 thoughts on “VMQ + Broadcom crashes servers

Leave a Reply

Your email address will not be published. Required fields are marked *