We have a 2008 R2 Hyper-V cluster with couple CSVs, their ownership is distributed among the nodes.
Today we had a problem - two of the CSVs became inaccessible from non-coordinating nodes. Both the problematic CSVs had the same coordinator. The rest of the CSVs were accessible just fine. As a result, all the VMs having storage on these CSVs crashed and wouldn't start.
It was obviously some problem with the node that owned them at that time. The problematic CSVs were shown as working and accessible in FCM) and I had to manually change the coordinating node and only then the CSVs became accessible again.
The error logged on non-coordinating nodes was: Cluster Shared Volume 'Volume3' is no longer available on this node because of 'STATUS_CONNECTION_DISCONNECTED(c000020c)'. All I/O will temporarily be queued until a path to the volume is reestablished.
Any idea what might have caused this? One strange thing is that on the problematic node 17 services crashed right after the CSVs became inaccessible.