Fedora Linux Support Community & Resources Center
  #1  
Old 3rd December 2011, 04:40 PM
seabird Offline
Registered User
 
Join Date: Jan 2009
Location: Den Bosch, Netherlands
Posts: 282
windows_7ie
RAID problem

Hi everyone,

I inflicted a bit of a problem on myself. Doing some hardware organizing I started my RAID 6 with only 4 disks (2 were not connected properly). So far no problem. Luckily I am allowed to lose 2 drives.
After connecting the drives again, it tells me:
Code:
[root@server ~]# cat /proc/mdstat
Personalities : [raid6] [raid5] [raid4]
md0 : active raid6 sdc1[2] sda1[0] sdd1[3] sdb1[1]
      7814045696 blocks super 1.2 level 6, 1024k chunk, algorithm 2 [6/4] [UUUU__]

unused devices: <none>
[root@server ~]#
So, all drives are there but it is not resyncing, rebuilding etc. How to fix this problem before one of my 4 drives go???

I tried adding the drives again, but no luck
Code:
[root@server ~]# mdadm --add /dev/md0 /dev/sdf1
mdadm: /dev/sdf1 reports being an active member for /dev/md0, but a --re-add fails.
mdadm: not performing --add as that would convert /dev/sdf1 in to a spare.
mdadm: To make this a spare, use "mdadm --zero-superblock /dev/sdf1" first.
[root@server ~]#
fdisk -l?? What went wrong on sdf1 and sdg1???
Code:
[root@server ~]# fdisk -l

Disk /dev/sda: 2000.4 GB, 2000398934016 bytes
255 heads, 63 sectors/track, 243201 cylinders, total 3907029168 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x000916bc

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1            2048  3907028991  1953513472   fd  Linux raid autodetect

Disk /dev/sdb: 2000.4 GB, 2000398934016 bytes
255 heads, 63 sectors/track, 243201 cylinders, total 3907029168 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x000353cf

   Device Boot      Start         End      Blocks   Id  System
/dev/sdb1            2048  3907028991  1953513472   fd  Linux raid autodetect

Disk /dev/sdd: 2000.4 GB, 2000398934016 bytes
255 heads, 63 sectors/track, 243201 cylinders, total 3907029168 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x0007dbd7

   Device Boot      Start         End      Blocks   Id  System
/dev/sdd1            2048  3907028991  1953513472   fd  Linux raid autodetect

Disk /dev/sdc: 2000.4 GB, 2000398934016 bytes
255 heads, 63 sectors/track, 243201 cylinders, total 3907029168 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x000d068b

   Device Boot      Start         End      Blocks   Id  System
/dev/sdc1            2048  3907028991  1953513472   fd  Linux raid autodetect

Disk /dev/sde: 160.0 GB, 160041885696 bytes
255 heads, 63 sectors/track, 19457 cylinders, total 312581808 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x7923f3ac

   Device Boot      Start         End      Blocks   Id  System
/dev/sde1   *        2048     1026047      512000   83  Linux
/dev/sde2         1026048   312580095   155777024   8e  Linux LVM

WARNING: GPT (GUID Partition Table) detected on '/dev/sdf'! The util fdisk doesn't support GPT. Use GNU Parted.


Disk /dev/sdf: 2000.4 GB, 2000398934016 bytes
81 heads, 63 sectors/track, 765633 cylinders, total 3907029168 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disk identifier: 0x00000000

   Device Boot      Start         End      Blocks   Id  System
/dev/sdf1            2048  3907029167  1953513560   fd  Linux raid autodetect

WARNING: GPT (GUID Partition Table) detected on '/dev/sdg'! The util fdisk doesn't support GPT. Use GNU Parted.


Disk /dev/sdg: 2000.4 GB, 2000398934016 bytes
81 heads, 63 sectors/track, 765633 cylinders, total 3907029168 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disk identifier: 0x00000000

   Device Boot      Start         End      Blocks   Id  System
/dev/sdg1            2048  3907029167  1953513560   fd  Linux raid autodetect

Disk /dev/mapper/vg_server-lv_swap: 3959 MB, 3959422976 bytes
255 heads, 63 sectors/track, 481 cylinders, total 7733248 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x00000000

Disk /dev/mapper/vg_server-lv_swap doesn't contain a valid partition table

Disk /dev/mapper/vg_server-lv_root: 155.5 GB, 155524792320 bytes
255 heads, 63 sectors/track, 18908 cylinders, total 303759360 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x00000000

Disk /dev/mapper/vg_server-lv_root doesn't contain a valid partition table

Disk /dev/md0: 8001.6 GB, 8001582792704 bytes
2 heads, 4 sectors/track, 1953511424 cylinders, total 15628091392 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 1048576 bytes / 4194304 bytes
Disk identifier: 0x00000000

Disk /dev/md0 doesn't contain a valid partition table


---------- Post added at 05:40 PM ---------- Previous post was at 04:56 PM ----------

ok, worked around it and now it is resyncing. Used fedora setup to reformat the 2 drives (and a spare disk I had laying around just as operating formatted). After doing this the added again and now it is rebuilding (for the next 6 weeks???) hahaha
__________________
OS: Fedora 16
Casing: Chenbro RM21508B
Mainboard: ATX D2778
Processor: Intel Xeon W3550 (8 core)
Memory: 6Gb DDR3, ECC, 1333 MHz, PC3-10600
HD #1: OCZ Vertex 3 60Gb
Storage Drives: 4x 2Tb WD20EARS + 2x 2Tb WD20EARX
Graphics: Nvidia GeForce 210 Silent
PCI Card: Promise FastTrak TX4
Reply With Quote
  #2  
Old 4th December 2011, 10:11 AM
seabird Offline
Registered User
 
Join Date: Jan 2009
Location: Den Bosch, Netherlands
Posts: 282
windows_7ie
Re: RAID problem

Ok, so the rebuild is a succes and almost completed. All seems fine.

But why is there still a difference between /dev/sd[a-d] and /dev/sd[f-g]??
Code:
[root@server ~]# fdisk -l

Disk /dev/sda: 2000.4 GB, 2000398934016 bytes
255 heads, 63 sectors/track, 243201 cylinders, total 3907029168 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x000916bc

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1            2048  3907028991  1953513472   fd  Linux raid autodetect

Disk /dev/sdb: 2000.4 GB, 2000398934016 bytes
255 heads, 63 sectors/track, 243201 cylinders, total 3907029168 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x000353cf

   Device Boot      Start         End      Blocks   Id  System
/dev/sdb1            2048  3907028991  1953513472   fd  Linux raid autodetect

Disk /dev/sdc: 2000.4 GB, 2000398934016 bytes
255 heads, 63 sectors/track, 243201 cylinders, total 3907029168 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x000d068b

   Device Boot      Start         End      Blocks   Id  System
/dev/sdc1            2048  3907028991  1953513472   fd  Linux raid autodetect

Disk /dev/sdd: 2000.4 GB, 2000398934016 bytes
255 heads, 63 sectors/track, 243201 cylinders, total 3907029168 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x0007dbd7

   Device Boot      Start         End      Blocks   Id  System
/dev/sdd1            2048  3907028991  1953513472   fd  Linux raid autodetect

Disk /dev/sde: 160.0 GB, 160041885696 bytes
255 heads, 63 sectors/track, 19457 cylinders, total 312581808 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x7923f3ac

   Device Boot      Start         End      Blocks   Id  System
/dev/sde1   *        2048     1026047      512000   83  Linux
/dev/sde2         1026048   312580095   155777024   8e  Linux LVM

WARNING: GPT (GUID Partition Table) detected on '/dev/sdf'! The util fdisk doesn't support GPT. Use GNU Parted.


Disk /dev/sdf: 2000.4 GB, 2000398934016 bytes
255 heads, 63 sectors/track, 243201 cylinders, total 3907029168 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disk identifier: 0x00000000

   Device Boot      Start         End      Blocks   Id  System
/dev/sdf1               1  3907029167  1953514583+  ee  GPT
Partition 1 does not start on physical sector boundary.

WARNING: GPT (GUID Partition Table) detected on '/dev/sdg'! The util fdisk doesn't support GPT. Use GNU Parted.

Disk /dev/sdg: 2000.4 GB, 2000398934016 bytes
255 heads, 63 sectors/track, 243201 cylinders, total 3907029168 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disk identifier: 0x00000000

   Device Boot      Start         End      Blocks   Id  System
/dev/sdg1               1  3907029167  1953514583+  ee  GPT
Partition 1 does not start on physical sector boundary.

Disk /dev/mapper/vg_server-lv_swap: 3959 MB, 3959422976 bytes
255 heads, 63 sectors/track, 481 cylinders, total 7733248 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x00000000

Disk /dev/mapper/vg_server-lv_swap doesn't contain a valid partition table

Disk /dev/mapper/vg_server-lv_root: 155.5 GB, 155524792320 bytes
255 heads, 63 sectors/track, 18908 cylinders, total 303759360 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x00000000

Disk /dev/mapper/vg_server-lv_root doesn't contain a valid partition table

Disk /dev/md0: 8001.6 GB, 8001582792704 bytes
2 heads, 4 sectors/track, 1953511424 cylinders, total 15628091392 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 1048576 bytes / 4194304 bytes
Disk identifier: 0x00000000

Disk /dev/md0 doesn't contain a valid partition table
Anything I can do to fix this?
__________________
OS: Fedora 16
Casing: Chenbro RM21508B
Mainboard: ATX D2778
Processor: Intel Xeon W3550 (8 core)
Memory: 6Gb DDR3, ECC, 1333 MHz, PC3-10600
HD #1: OCZ Vertex 3 60Gb
Storage Drives: 4x 2Tb WD20EARS + 2x 2Tb WD20EARX
Graphics: Nvidia GeForce 210 Silent
PCI Card: Promise FastTrak TX4
Reply With Quote
  #3  
Old 5th December 2011, 12:30 PM
seabird Offline
Registered User
 
Join Date: Jan 2009
Location: Den Bosch, Netherlands
Posts: 282
windows_7ie
Re: RAID problem

Ok, back to square one. I scrapped all the disks and set up a new array. (backup of all my data was hell).
Code:
[root@server md]# fdisk -u -l /dev/sd[b-g]

Disk /dev/sdb: 2000.4 GB, 2000398934016 bytes
218 heads, 56 sectors/track, 320038 cylinders, total 3907029168 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x000916bc

   Device Boot      Start         End      Blocks   Id  System
/dev/sdb1            2048  3907029167  1953513560   fd  Linux raid autodetect

Disk /dev/sdc: 2000.4 GB, 2000398934016 bytes
218 heads, 56 sectors/track, 320038 cylinders, total 3907029168 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x000d068b

   Device Boot      Start         End      Blocks   Id  System
/dev/sdc1            2048  3907029167  1953513560   fd  Linux raid autodetect

Disk /dev/sdd: 2000.4 GB, 2000398934016 bytes
218 heads, 56 sectors/track, 320038 cylinders, total 3907029168 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x000353cf

   Device Boot      Start         End      Blocks   Id  System
/dev/sdd1            2048  3907029167  1953513560   fd  Linux raid autodetect

Disk /dev/sde: 2000.4 GB, 2000398934016 bytes
218 heads, 56 sectors/track, 320038 cylinders, total 3907029168 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x0007dbd7

   Device Boot      Start         End      Blocks   Id  System
/dev/sde1            2048  3907029167  1953513560   fd  Linux raid autodetect

Disk /dev/sdf: 2000.4 GB, 2000398934016 bytes
218 heads, 56 sectors/track, 320038 cylinders, total 3907029168 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disk identifier: 0x000377c7

   Device Boot      Start         End      Blocks   Id  System
/dev/sdf1            2048  3907029167  1953513560   fd  Linux raid autodetect

Disk /dev/sdg: 2000.4 GB, 2000398934016 bytes
218 heads, 56 sectors/track, 320038 cylinders, total 3907029168 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disk identifier: 0x0001ccde

   Device Boot      Start         End      Blocks   Id  System
/dev/sdg1            2048  3907029167  1953513560   fd  Linux raid autodetect
Since new hardware was installed I re-arranged the connections so the numbers are sequential. The format looks fine now.

When trying to optimize this array I used the following commands:
Code:
echo 16384 > /sys/block/md0/md/stripe_cache_size
blockdev --setra 16384 /dev/md0
I also wanted to try 8192 to see if it was different but something went wrong there
Code:
[root@server md]# echo 8192 > /sys/block/md0/md/stripe_cache_size
[root@server md]# cat stripe_cache_size
16295
[root@server md]# echo 16384 > /sys/block/md0/md/stripe_cache_size
[root@server md]# cat stripe_cache_size
16384
Why does it not accept 8192 as a value?????
Current performance is a little slower then I hoped:
Code:
[root@server md]# cat /proc/mdstat
Personalities : [raid0] [raid6] [raid5] [raid4]
md0 : active raid6 sdg1[5] sdf1[4] sde1[3] sdd1[2] sdc1[1] sdb1[0]
      7814045696 blocks super 1.2 level 6, 1024k chunk, algorithm 2 [6/6] [UUUUUU]
      [=>...................]  resync =  7.6% (148806852/1953511424) finish=664.3min speed=45277K/sec
Anything else I can do to improve this?
__________________
OS: Fedora 16
Casing: Chenbro RM21508B
Mainboard: ATX D2778
Processor: Intel Xeon W3550 (8 core)
Memory: 6Gb DDR3, ECC, 1333 MHz, PC3-10600
HD #1: OCZ Vertex 3 60Gb
Storage Drives: 4x 2Tb WD20EARS + 2x 2Tb WD20EARX
Graphics: Nvidia GeForce 210 Silent
PCI Card: Promise FastTrak TX4
Reply With Quote
Reply

Tags
problem, raid

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
mounting degraded RAID 5 from hardware raid into softare raid staffmm Servers & Networking 1 22nd October 2009 10:46 PM
Fedora 7 install problem (nVidia SATA raid problem?) jdmclemore Installation, Upgrades and Live Media 12 23rd July 2007 04:03 PM
Raid Problem brunoadm Using Fedora 1 1st November 2006 08:04 PM
Software RAID problem (RAID is gone after create process finishes) michal Using Fedora 4 16th November 2005 12:24 PM
Raid Problem Fedora Core 3, RAID LOST DISKS ALWAYS icatalan Hardware & Laptops 1 15th September 2005 04:26 PM


Current GMT-time: 11:54 (Wednesday, 23-07-2014)

TopSubscribe to XML RSS for all Threads in all ForumsFedoraForumDotOrg Archive
logo

All trademarks, and forum posts in this site are property of their respective owner(s).
FedoraForum.org is privately owned and is not directly sponsored by the Fedora Project or Red Hat, Inc.

Privacy Policy | Term of Use | Posting Guidelines | Archive | Contact Us | Founding Members

Powered by vBulletin® Copyright ©2000 - 2012, vBulletin Solutions, Inc.

FedoraForum is Powered by RedHat