I've had our cluster up and running for 6 months or so, everything has eben going smoothly. This morning things started behaving very strangely, starting with an event:
Cluster Shared Volume 'Volume11' ('RDS Apps') is no longer available on this node because of 'STATUS_IO_TIMEOUT(c00000b5)'. All I/O will temporarily be queued until a path to the volume is reestablished.
All hosts are using the same SAN, and only this volume seems to have went down. Now, for some reason I can't go to the clusterstorage folder on any of the Hyper-v Hosts. I get a not responding and explorer crashes. However, If i go to disk Management in the cluster all CSV's are shown as "onlline" however, when I click on some of them there are no Volumes. Even though they are shown as online the capacity is blank?
Nothing has changed, i've verified network connectivity to the SAN. Just about all of the VM's are running fine except for the ones on this particular volume. No errors what so ever on the SAN.
What happened?! Any ideas?