Hi,
I am looking through our cluster logs trying to rule out errors and I notice a repeat instance of this error for all of the cluster disks every 5 minutes:
ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 80
This seems to be related to other behavior happening at the same time related to DFSR. What I think is happening is that DFSR resource is checking the validity of the path on each physical disk until it finds the one the replicated folder is on (the last entry) and then tries to create the checkpoint file which already exists. Does anyone know why it keeps scanning through all the disks and not just the relevant disk? Also is there a way to stop it spamming the log with this information every 5 minutes if it is normal behaviour? This is happening on all our nodes and resource groups with DFSR configured.
Note I have truncated the GUIDs:
00001924.00003fb4::2014/12/16-05:06:00.769 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_D0A.XML is not on the disk
00001924.00003fb4::2014/12/16-05:06:00.769 ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 117.
00000804.000073e4::2014/12/16-05:06:00.769 WARN [RCM] ResourceControl(STORAGE_IS_PATH_VALID) to Cluster Disk 117 returned 161.
00003738.000048e8::2014/12/16-05:06:00.769 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_D0A.XML is not on the disk
00003738.000048e8::2014/12/16-05:06:00.769 ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 77.
00000804.000073e4::2014/12/16-05:06:00.769 WARN [RCM] ResourceControl(STORAGE_IS_PATH_VALID) to Cluster Disk 77 returned 161.
000036fc.000042c8::2014/12/16-05:06:00.785 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_D0A.XML is not on the disk
000036fc.000042c8::2014/12/16-05:06:00.785 ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 76.
00000804.000073e4::2014/12/16-05:06:00.785 WARN [RCM] ResourceControl(STORAGE_IS_PATH_VALID) to Cluster Disk 76 returned 161.
000038d4.00001d54::2014/12/16-05:06:00.785 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_D0A.XML is not on the disk
000038d4.00001d54::2014/12/16-05:06:00.785 ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 80.
00000804.000073e4::2014/12/16-05:06:00.785 WARN [RCM] ResourceControl(STORAGE_IS_PATH_VALID) to Cluster Disk 80 returned 161.
00001bb8.000050d8::2014/12/16-05:06:00.785 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_D0A.XML is not on the disk
00001bb8.000050d8::2014/12/16-05:06:00.785 ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 16.
00000804.000073e4::2014/12/16-05:06:00.785 WARN [RCM] ResourceControl(STORAGE_IS_PATH_VALID) to Cluster Disk 16 returned 161.
00001aec.00001658::2014/12/16-05:06:00.800 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_D0A.XML is not on the disk
00001aec.00001658::2014/12/16-05:06:00.800 ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 14.
00000804.000073e4::2014/12/16-05:06:00.800 WARN [RCM] ResourceControl(STORAGE_IS_PATH_VALID) to Cluster Disk 14 returned 161.
000038fc.00003508::2014/12/16-05:06:00.800 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_D0A.XML is not on the disk
000038fc.00003508::2014/12/16-05:06:00.800 ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 81.
00000804.000073e4::2014/12/16-05:06:00.800 WARN [RCM] ResourceControl(STORAGE_IS_PATH_VALID) to Cluster Disk 81 returned 161.
00001884.00002120::2014/12/16-05:06:00.800 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_D0A.XML is not on the disk
00001884.00002120::2014/12/16-05:06:00.800 ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 116.
00000804.000073e4::2014/12/16-05:06:00.800 WARN [RCM] ResourceControl(STORAGE_IS_PATH_VALID) to Cluster Disk 116 returned 161.
000037d8.00005ed4::2014/12/16-05:06:00.816 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_D0A.XML is not on the disk
000037d8.00005ed4::2014/12/16-05:06:00.816 ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 78.
00000804.000073e4::2014/12/16-05:06:00.816 WARN [RCM] ResourceControl(STORAGE_IS_PATH_VALID) to Cluster Disk 78 returned 161.
00001b90.00007524::2014/12/16-05:06:00.816 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_D0A.XML is not on the disk
00001b90.00007524::2014/12/16-05:06:00.816 ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 15.
00000804.000073e4::2014/12/16-05:06:00.816 WARN [RCM] ResourceControl(STORAGE_IS_PATH_VALID) to Cluster Disk 15 returned 161.
000019f0.00001b84::2014/12/16-05:06:00.816 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_D0A.XML is not on the disk
000019f0.00001b84::2014/12/16-05:06:00.816 ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 119.
00000804.000073e4::2014/12/16-05:06:00.816 WARN [RCM] ResourceControl(STORAGE_IS_PATH_VALID) to Cluster Disk 119 returned 161.
000016c0.00001a80::2014/12/16-05:06:00.832 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_D0A.XML can be on the disk
00000804.000073e4::2014/12/16-05:06:00.832 INFO [GUM] Node 11: Processing RequestLock 11:46479
00000804.000025c4::2014/12/16-05:06:00.832 INFO [GUM] Node 11: Processing GrantLock to 11 (sent by 6 gumid: 7595767)
00000804.000073e4::2014/12/16-05:06:01.190 ERR [RCM] rcm::RcmResControl::DoResourceControl: ERROR_ALREADY_EXISTS(183)' because of 'Key System\CurrentControlSet\Services\DFSR\Parameters\Replication Groups\D0A is already being checkpointed for resource Cluster Disk 111. Key name 603c.'
00000804.000073e4::2014/12/16-05:06:01.190 WARN [RCM] ResourceControl(ADD_REGISTRY_CHECKPOINT) to Cluster Disk 111 returned 183.
00001924.00006330::2014/12/16-05:06:03.499 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_D0A.XML is not on the disk
00001924.00006330::2014/12/16-05:06:03.499 ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 117.
00000804.000071d8::2014/12/16-05:06:03.499 WARN [RCM] ResourceControl(STORAGE_IS_PATH_VALID) to Cluster Disk 117 returned 161.
00003738.000072fc::2014/12/16-05:06:03.499 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_D0A.XML is not on the disk
00003738.000072fc::2014/12/16-05:06:03.499 ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 77.
00000804.000071d8::2014/12/16-05:06:03.499 WARN [RCM] ResourceControl(STORAGE_IS_PATH_VALID) to Cluster Disk 77 returned 161.
000036fc.00005464::2014/12/16-05:06:03.515 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_D0A.XML is not on the disk
000036fc.00005464::2014/12/16-05:06:03.515 ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 76.
00000804.000071d8::2014/12/16-05:06:03.515 WARN [RCM] ResourceControl(STORAGE_IS_PATH_VALID) to Cluster Disk 76 returned 161.
000038d4.00005150::2014/12/16-05:06:03.530 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_D0A.XML is not on the disk
000038d4.00005150::2014/12/16-05:06:03.530 ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 80.
00000804.000071d8::2014/12/16-05:06:03.530 WARN [RCM] ResourceControl(STORAGE_IS_PATH_VALID) to Cluster Disk 80 returned 161.
00001bb8.000050d8::2014/12/16-05:06:03.530 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_D0A.XML is not on the disk
00001bb8.000050d8::2014/12/16-05:06:03.530 ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 16.
00000804.000071d8::2014/12/16-05:06:03.530 WARN [RCM] ResourceControl(STORAGE_IS_PATH_VALID) to Cluster Disk 16 returned 161.
00001aec.00001658::2014/12/16-05:06:03.530 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_D0A.XML is not on the disk
00001aec.00001658::2014/12/16-05:06:03.530 ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 14.
00000804.000071d8::2014/12/16-05:06:03.530 WARN [RCM] ResourceControl(STORAGE_IS_PATH_VALID) to Cluster Disk 14 returned 161.
000038fc.00001498::2014/12/16-05:06:03.546 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_D0A.XML is not on the disk
000038fc.00001498::2014/12/16-05:06:03.546 ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 81.
00000804.000071d8::2014/12/16-05:06:03.546 WARN [RCM] ResourceControl(STORAGE_IS_PATH_VALID) to Cluster Disk 81 returned 161.
00001884.000012fc::2014/12/16-05:06:03.546 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_D0A.XML is not on the disk
00001884.000012fc::2014/12/16-05:06:03.546 ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 116.
00000804.000071d8::2014/12/16-05:06:03.546 WARN [RCM] ResourceControl(STORAGE_IS_PATH_VALID) to Cluster Disk 116 returned 161.
000037d8.00005ed4::2014/12/16-05:06:03.562 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_D0A.XML is not on the disk
000037d8.00005ed4::2014/12/16-05:06:03.562 ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 78.
00000804.000071d8::2014/12/16-05:06:03.562 WARN [RCM] ResourceControl(STORAGE_IS_PATH_VALID) to Cluster Disk 78 returned 161.
00001b90.000058bc::2014/12/16-05:06:03.562 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_D0A.XML is not on the disk
00001b90.000058bc::2014/12/16-05:06:03.562 ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 15.
00000804.000071d8::2014/12/16-05:06:03.562 WARN [RCM] ResourceControl(STORAGE_IS_PATH_VALID) to Cluster Disk 15 returned 161.
000019f0.00003558::2014/12/16-05:06:03.562 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_D0A.XML is not on the disk
000019f0.00003558::2014/12/16-05:06:03.562 ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 119.
00000804.000071d8::2014/12/16-05:06:03.562 WARN [RCM] ResourceControl(STORAGE_IS_PATH_VALID) to Cluster Disk 119 returned 161.
000016c0.00001a80::2014/12/16-05:06:03.577 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_D0A.XML can be on the disk
00000804.000073e4::2014/12/16-05:06:03.593 ERR [RCM] rcm::RcmResControl::DoResourceControl: ERROR_ALREADY_EXISTS(183)' because of 'Key System\CurrentControlSet\Services\DFSR\Access Checks\Replication Groups\D0A is already being checkpointed for resource Cluster Disk 111. Key name ca5d2.'
00000804.000073e4::2014/12/16-05:06:03.593 WARN [RCM] ResourceControl(ADD_REGISTRY_CHECKPOINT) to Cluster Disk 111 returned 183.
00001924.00003fb4::2014/12/16-05:06:05.886 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_e377.XML is not on the disk
00001924.00003fb4::2014/12/16-05:06:05.886 ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 117.
00000804.00001de0::2014/12/16-05:06:05.886 WARN [RCM] ResourceControl(STORAGE_IS_PATH_VALID) to Cluster Disk 117 returned 161.
00003738.000048e8::2014/12/16-05:06:05.886 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_e377.XML is not on the disk
00003738.000048e8::2014/12/16-05:06:05.886 ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 77.
00000804.00001de0::2014/12/16-05:06:05.902 WARN [RCM] ResourceControl(STORAGE_IS_PATH_VALID) to Cluster Disk 77 returned 161.
000036fc.000042c8::2014/12/16-05:06:05.902 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_e377.XML is not on the disk
000036fc.000042c8::2014/12/16-05:06:05.902 ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 76.
00000804.00001de0::2014/12/16-05:06:05.902 WARN [RCM] ResourceControl(STORAGE_IS_PATH_VALID) to Cluster Disk 76 returned 161.
000038d4.00001d54::2014/12/16-05:06:05.902 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_e377.XML is not on the disk
000038d4.00001d54::2014/12/16-05:06:05.902 ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 80.
00000804.00001de0::2014/12/16-05:06:05.902 WARN [RCM] ResourceControl(STORAGE_IS_PATH_VALID) to Cluster Disk 80 returned 161.
00001bb8.000050d8::2014/12/16-05:06:05.917 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_e377.XML is not on the disk
00001bb8.000050d8::2014/12/16-05:06:05.917 ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 16.
00000804.00001de0::2014/12/16-05:06:05.917 WARN [RCM] ResourceControl(STORAGE_IS_PATH_VALID) to Cluster Disk 16 returned 161.
00001aec.00007554::2014/12/16-05:06:05.917 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_e377.XML is not on the disk
00001aec.00007554::2014/12/16-05:06:05.917 ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 14.
00000804.00001de0::2014/12/16-05:06:05.917 WARN [RCM] ResourceControl(STORAGE_IS_PATH_VALID) to Cluster Disk 14 returned 161.
000038fc.00003508::2014/12/16-05:06:05.933 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_e377.XML is not on the disk
000038fc.00003508::2014/12/16-05:06:05.933 ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 81.
00000804.00001de0::2014/12/16-05:06:05.933 WARN [RCM] ResourceControl(STORAGE_IS_PATH_VALID) to Cluster Disk 81 returned 161.
00001884.000012fc::2014/12/16-05:06:05.933 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_e377.XML is not on the disk
00001884.000012fc::2014/12/16-05:06:05.933 ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 116.
00000804.00001de0::2014/12/16-05:06:05.933 WARN [RCM] ResourceControl(STORAGE_IS_PATH_VALID) to Cluster Disk 116 returned 161.
000037d8.00005ed4::2014/12/16-05:06:05.933 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_e377.XML is not on the disk
000037d8.00005ed4::2014/12/16-05:06:05.933 ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 78.
00000804.00001de0::2014/12/16-05:06:05.933 WARN [RCM] ResourceControl(STORAGE_IS_PATH_VALID) to Cluster Disk 78 returned 161.
00001b90.00007524::2014/12/16-05:06:05.949 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_e377.XML is not on the disk
00001b90.00007524::2014/12/16-05:06:05.949 ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 15.
00000804.00001de0::2014/12/16-05:06:05.949 WARN [RCM] ResourceControl(STORAGE_IS_PATH_VALID) to Cluster Disk 15 returned 161.
000019f0.00003558::2014/12/16-05:06:05.949 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_e377.XML is not on the disk
000019f0.00003558::2014/12/16-05:06:05.949 ERR [RHS] Error 161 from ResourceControl for resource Cluster Disk 119.
00000804.000071d8::2014/12/16-05:06:05.949 WARN [RCM] ResourceControl(STORAGE_IS_PATH_VALID) to Cluster Disk 119 returned 161.
000016c0.000006e4::2014/12/16-05:06:05.964 INFO [RES] Physical Disk: Path \\?\Volume{e377}\System Volume Information\DFSR\Config\Replica_e377.XML can be on the disk
00000804.00001de0::2014/12/16-05:06:05.980 ERR [RCM] rcm::RcmResControl::DoResourceControl: ERROR_ALREADY_EXISTS(183)' because of 'Key System\CurrentControlSet\Services\DFSR\Parameters\Volumes\e377 is already being checkpointed for resource Cluster Disk 111. Key name fedc.'
00000804.00001de0::2014/12/16-05:06:05.980 WARN [RCM] ResourceControl(ADD_REGISTRY_CHECKPOINT) to Cluster Disk 111 returned 183.