Jump to content
Welcome to our new Citrix community!
  • 0

XenServer 6.0.2 SR "dead" after powerloss


Stefan Schaudt

Question

Hi, everybody!
The following setting:
Intel Modular Server (Kind of bladeserver. Shared local storage via Hardware HBA), accidental powerloss (elecritian cut off the powersupply), 1 XenServer 6.0.2, 1 storage repository on SSDs in the server (degraded RAID due to a defective SSD after powerloss) still working. There are all primary partitions of the VMs on it.
A second SR (2TB with almost all data on it), wich is not accessible. To get the DC running, I detached the second SR. But I am not able to reattach the SR.
While trying, I used several "cookbooks". I could disable multipathing, forget the SR, but I couldn't recreate a SR. Neither on XenCenter (see picture) nor on CLI. If I do a vgscan I get the following:
>>

[root@xen-srv1 ~]# vgscan
  Reading all physical volumes.  This may take a while...
  /dev/sdc: read failed after 0 of 1024 at 0: Input/output error
  /dev/sdc: read failed after 0 of 1024 at 2494989336576: Input/output error
  /dev/sdc: read failed after 0 of 1024 at 2494989443072: Input/output error
  /dev/sdc: read failed after 0 of 1024 at 0: Input/output error
  /dev/sdc: read failed after 0 of 1024 at 4096: Input/output error
  /dev/sdc: read failed after 0 of 2048 at 0: Input/output error
  Found volume group "VG_XenStorage-4a4b2811-74a2-d7db-8c2c-6e48c15db97e" using metadata type lvm2
  Found volume group "VG_XenStorage-b80414f2-b617-9012-fb02-96b986ed6573" using metadata type lvm2
[root@xen-srv1 ~]# pvscan
  /dev/sdc: read failed after 0 of 1024 at 0: Input/output error
  /dev/sdc: read failed after 0 of 1024 at 2494989336576: Input/output error
  /dev/sdc: read failed after 0 of 1024 at 2494989443072: Input/output error
  /dev/sdc: read failed after 0 of 1024 at 0: Input/output error
  /dev/sdc: read failed after 0 of 1024 at 4096: Input/output error
  /dev/sdc: read failed after 0 of 2048 at 0: Input/output error
  PV /dev/sda3   VG VG_XenStorage-4a4b2811-74a2-d7db-8c2c-6e48c15db97e   lvm2 [61.99 GB / 61.73 GB free]
  PV /dev/dm-0   VG VG_XenStorage-b80414f2-b617-9012-fb02-96b986ed6573   lvm2 [1.17 TB / 115.82 GB free]
  Total: 2 [1.23 TB] / in use: 2 [1.23 TB] / in no VG: 0 [0   ]

<<

/dec/sdc was the volume before all the bad things happend.... :-(

 

Right now I am a bit desperate how I could get the volume back to work.
All this happens while the customer (the father of my godchild) is bankrupt and under administration by a
bankruptcy lawyer. So this puts extra pressure on me.

 

Has anyone any ideas how to fix this?

I already fixed several storage issues on XenServer, but this exceeds my skills...

 

Thank you, Stefan
 

Before anyone starts with it:

I know how important backups are. We do multistage backups at (almost) all of our customers, to prevent such situations.
I also know how important actual versions of software are. All other customers had several upgrades of their XenServers and run on 7.x now (much better than on 6.0, 6.2 or 6.5 by the way)

HBA_1.PNG

Link to comment

3 answers to this question

Recommended Posts

  • 0

If the disk is still alive in some capacity, I would start by seeing if a simple fsck (file system check) on any volume is needed/ need to see if any bad blocks first get repaired before you can move on to the LVM part, which can be complicated and tricky. If no VG shows up, usually the first thing I try is "vgchange -ay" to see if the volume group can be put on-line again. Check the Red Hat docs for all sorts of useful LVM troubleshooting guides. Depending on what happened, there are of course no guarantees, but it's worth investing some effort trying to recover if possible.

 

However, the sdc read errors would indicate it cannot read the disk at all, which may indicate a physical disk error. Can you check this out with the BIOS on that system?

 

-=Tobias

  • Like 2
Link to comment

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...