It is currently Thu Mar 28, 2024 6:26 am

All times are UTC - 7 hours [ DST ]

Recent News:



Post new topic Reply to topic  [ 2 posts ] 
Author Message
PostPosted: Thu Sep 28, 2017 1:32 am 
Offline
Newbie
Newbie

Joined: Fri Sep 22, 2017 2:12 am
Posts: 3
Thanks: 0
Thanked: 1 time in 1 post
Hello forum,

Please, help to diagnose the reboot issue during disk replace.

Symptom:
System rebooted during disk replace operation. After reboot it happens that replace passed successfully. Pool is in healthy state and is resilvering now. No errors reported.

System:
x510/2GB RAM/E7400 CPU with 4x1TB disks configured as RaidZ1 (REDPOOL - ada4/ada5/ada6/ada7)
IcyDock JBOD connected to x510 on esata with 4x1TB disks configured as RaidZ1 (ICEPOOL - ada0/ada1/ada2/ada3)
FreeNAS 11.0 U3 + emby jail powered off + plex jail running
Periodic snapshot scheduled to run 09:00-18:00 everyday. Replication from x510 to IcyDock on all datasets with periodic snapshot.

What caused the reboot:
1) In ICEPOOL I've set disk ada3 to OFFLINE
2) In REDPOOL I've set disk ada6 to OFFLINE
3) removed disks ada3 and ada6
4) installed disk ada3 in ada6 bay
5) installed disk ada6 in ada3 bay
6) initiated REPLACE to member disk ada6 in REDPOOL with force option
7) waited for REPLACE to finish. WEB gui was not responsive. Samba was not responsive. PING failed.
8) It happens that system restarted. Because later all services loaded normally
9) After restarts initiated REPLACE to member disk ada3 for pool ICEPOOL. Passed successfully without restart and resilvering now.

zpool status on both pools reports that drives are ONLINE and resilvering.

No reboot/halt messages. Cannot find out at what point system actually rebooted. Reallocation event should not cause system restart.
Last records from messages log before restart:
Sep 28 09:12:24 VAULT (aprobe3:siisch0:0:3:0): SOFT_RESET. ACB: 00 00 00 00 00 00 00 00 00 00 00 00
Sep 28 09:12:24 VAULT (aprobe3:siisch0:0:3:0): CAM status: Uncorrectable parity/CRC error
Sep 28 09:12:24 VAULT (aprobe3:siisch0:0:3:0): Error 5, Retries exhausted
Sep 28 09:12:24 VAULT (aprobe3:siisch0:0:3:0): SOFT_RESET. ACB: 00 00 00 00 00 00 00 00 00 00 00 00
Sep 28 09:12:24 VAULT (aprobe3:siisch0:0:3:0): CAM status: Uncorrectable parity/CRC error
Sep 28 09:12:24 VAULT (aprobe3:siisch0:0:3:0): Error 5, Retries exhausted
Sep 28 09:13:48 VAULT smartd[73500]: Device: /dev/ada6, Failed SMART usage Attribute: 5 Reallocated_Sector_Ct.


Top
 Profile  
Thanks  

Attention Guest: Remove this ad by Registering with the MediaSmartServer.net Forums. It's Free!
PostPosted: Fri Oct 27, 2017 9:40 am 
Offline
Max Contributor
Max Contributor
User avatar

Joined: Sat Apr 12, 2008 12:49 pm
Posts: 2226
Location: Casper Wyoming
Thanks: 81
Thanked: 256 times in 251 posts
Far from being an expert, but 40 years in computing has me looking at your logs.

I could be completely wrong, but it looks like during the switching/rebuilding the system had some problems with some bad sectors on one of the drives, retried to write to them a few times, couldn't so did a reboot and was able to reallocate "fix" the data / reallocate bad sectors.
( Failed SMART usage Attribute: 5 Reallocated_Sector_Ct )

It looks like it may have been able to repair itself. You may be good to go now.

I'm assuming you can run some kind of system disk checks when everything is done rebuilding????

Let us know if you find anything that might help others...

Good Luck

_________________
[X510 CPU/RAM/All 2 TB Red's] [X510 CPU/Sync'ed Backup/All 2 TB Hitachi's]
[X510 /2 in box]
[X710 LIAN LI DIY W2016E] Stablebit Drivepool [EX-503 LIAN LI 5-bay USB3 External]
:twisted: Fear the Cloud :twisted:


Top
 Profile  
Thanks  
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 2 posts ] 

All times are UTC - 7 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 16 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB® Forum Software © phpBB Group