Error After Upgrading SAN Firmware 3

[khalidaaa]

Hi Folks,

After upgrading the SAN Controller Firmware + NVRAM + Drivers. I Started to get these errors when i booted the machine. Any idea what is this?

#  errpt -a -l 190
---------------------------------------------------------------------------
LABEL:          FCP_ARRAY_ERR6
IDENTIFIER:     B9735AF4

Date/Time:       Tue Jul  4 17:31:35 SAUS
Sequence Number: 190
Machine Id:      00C5C1EB4C00
Node Id:         s2edms
Class:           H
Type:            PERM
Resource Name:   hdisk2          
Resource Class:  disk
Resource Type:   array
Location:        U7879.001.DQDNZFK-P1-C6-T1-W200300A0B817BAC1-L0

Description
SUBSYSTEM COMPONENT FAILURE

Probable Causes
ARRAY DASD MEDIA
POWER OR FAN COMPONENT

Failure Causes
ARRAY DASD MEDIA
POWER OR FAN COMPONENT

        Recommended Actions
        PERFORM PROBLEM DETERMINATION PROCEDURES

Detail Data
SENSE DATA
0600 0308 0000 FF00 0000 0004 0000 0000 0000 0000 0000 0000 0000 0000 7000 0600 
0000 0098 0000 0000 A100 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 8000 
0008 3000 0000 0000 0000 0000 0000 0000 0000 3154 3530 3232 3336 3732 2020 2020 
2020 0612 2700 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 
0001 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 
0000 0000 0001 6022 3037 3034 3036 2F30 3930 3833 3900 0000 0000 0000 0000 0000 
0000 0000 32F1 0000 F605 2606 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 
0000 0000

regards,
Khalid

 

[khalidaaa]

Sorry i just had an urgent thing to be done. I'm looking into that for now. Just something i'm not quite sure of.

You just said that when you assigned the disk to another LPAR, you didn't get the disk over there as well?!? strange! it should show it in there!

Any way, as you said that you removed the device using the id which is fine but how come now hdisk1 is not available? hdisk1 for now should be one of the disks connected to SAN isn't it? so it should show the lqueryvg information for it?!?

Cheers

 

[khalidaaa]

What's the output of lsvg -p rootvg for now?

how about after you run cfgmgr?

Regards,
Khalid

 

[J1gh2]

root@newlpar:/$ lsvg -p rootvg
rootvg:
PV_NAME PV STATE TOTAL PPs FREE PPs FREE DISTRIBUTION
hdisk0 active 546 238 109..16..00..04..109

Same after cfgmgr

Cheers

 

[khalidaaa]

what's the lspv shows for now? does it show the hdisk1 (on the SAN)?

could you post as well the prtconf again?

Is it a production server?

 

[J1gh2]

lspv
hdisk0 00c543efe8ada10a rootvg active
hdisk1 none None
hdisk2 none None
hdisk3 none None
hdisk4 none None
hdisk5 none None
hdisk6 none None
hdisk7 none None
hdisk8 none None

yes, hdisk1 is still the SAN disk

prtconf:
System Model: IBM,9117-570
Machine Serial Number: 65543EF
Processor Type: PowerPC_POWER5
Number Of Processors: 1
Processor Clock Speed: 1656 MHz
CPU Type: 64-bit
Kernel Type: 64-bit
LPAR Info: 6 newlpar_Standby_Failover_LPAR
Memory Size: 1536 MB
Good Memory Size: 1536 MB
Platform Firmware level: Not Available
Firmware Version: IBM,SF230_126
Console Login: enable
Auto Restart: true
Full Core: false

Network Information
Host Name: newlpar
Domain Name: national.core.c.co.uk

Paging Space Information
Total Paging Space: 4608MB
Percent Used: 1%

Volume Groups Information
==============================================================================
rootvg:
PV_NAME PV STATE TOTAL PPs FREE PPs FREE DISTRIBUTION
hdisk0 active 546 238 109..16..00..04..109
==============================================================================

INSTALLED RESOURCE LIST

The following resources are installed on the machine.
+/- = Added or deleted from Resource List.
* = Diagnostic support not available.

Model Architecture: chrp
Model Implementation: Multiple Processor, PCI bus

+ sys0 System Object
+ sysplanar0 System Planar
* vio0 Virtual I/O Bus
* vsa0 U9117.570.65543EF-V6-C0 LPAR Virtual Serial Adapter
* vty0 U9117.570.65543EF-V6-C0-L0 Asynchronous Terminal
* pci2 U7311.D20.6502EBB-CB1 PCI Bus
* pci7 U7311.D20.6502EBB-CB1 PCI Bus
Standard input
The following resources are installed on the machine.
+/- = Added or deleted from Resource List.
* = Diagnostic support not available.

Model Architecture: chrp
Model Implementation: Multiple Processor, PCI bus

+ sys0 System Object
+ sysplanar0 System Planar
* vio0 Virtual I/O Bus
* vsa0 U9117.570.65543EF-V6-C0 LPAR Virtual Serial Adapter
* vty0 U9117.570.65543EF-V6-C0-L0 Asynchronous Terminal
* pci2 U7311.D20.6502EBB-CB1 PCI Bus
* pci7 U7311.D20.6502EBB-CB1 PCI Bus
+ ent2 U7311.D20.6502EBB-CB1-C01-T1 2-Port 10/100/1000 Base-TX PCI-X Adapter (14108902)
+ ent3 U7311.D20.6502EBB-CB1-C01-T2 2-Port 10/100/1000 Base-TX PCI-X Adapter (14108902)
* pci8 U7311.D20.6502EBB-CB1 PCI Bus
+ fcs1 U7311.D20.6502EBB-CB1-C02-T1 FC Adapter
* fcnet1 U7311.D20.6502EBB-CB1-C02-T1 Fibre Channel Network Protocol Device
* fscsi1 U7311.D20.6502EBB-CB1-C02-T1 FC SCSI I/O Controller Protocol Device
* pci1 U7311.D20.6502EBB-CB1 PCI Bus
* pci4 U7311.D20.6502EBB-CB1 PCI Bus
+ ent0 U7311.D20.6502EBB-CB1-C06-T1 2-Port 10/100/1000 Base-TX PCI-X Adapter (14108902)
+ ent1 U7311.D20.6502EBB-CB1-C06-T2 2-Port 10/100/1000 Base-TX PCI-X Adapter (14108902)
* pci5 U7311.D20.6502EBB-CB1 PCI Bus
+ fcs0 U7311.D20.6502EBB-CB1-C07-T1 FC Adapter
* fcnet0 U7311.D20.6502EBB-CB1-C07-T1 Fibre Channel Network Protocol Device
* fscsi0 U7311.D20.6502EBB-CB1-C07-T1 FC SCSI I/O Controller Protocol Device
* dac0 U7311.D20.6502EBB-CB1-C07-T1-W201400A0B8113424 fcparray Disk Array Controller
* pci6 U7311.D20.6502EBB-CB1 PCI Bus
+ sisscsia0 U7311.D20.6502EBB-CB1-C08 PCI-X Dual Channel Ultra320 SCSI Adapter
+ scsi0 U7311.D20.6502EBB-CB1-C08-T1 PCI-X Dual Channel Ultra320 SCSI Adapter bus
+ scsi1 U7311.D20.6502EBB-CB1-C08-T2 PCI-X Dual Channel Ultra320 SCSI Adapter bus
+ hdisk0 U7311.D20.6502EBB-CB1-C08-T2-L8-L0 16 Bit LVD SCSI Disk Drive (73400 MB)
* ses0 U7311.D20.6502EBB-CB1-C08-T2-L15-L0 SCSI Enclosure Services Device
* pci0 U7879.001.DQD3C3N-P1 PCI Bus
* pci3 U7879.001.DQD3C3N-P1 PCI Bus
* ide0 U7879.001.DQD3C3N-P1-T15 ATA/IDE Controller Device
+ cd0 U7879.001.DQD3C3N-P4-D1 IDE DVD-ROM Drive
+ L2cache0 L2 Cache
+ mem0 Memory
+ proc0 Processor
+ hdisk1 U7311.D20.6502EBB-CB1-C07-T1-W201400A0B8113424-L0 fcparray Disk Array Device
+ hdisk2 U7311.D20.6502EBB-CB1-C07-T1-W201400A0B8113424-L1000000000000 fcparray Disk Array Device
+ hdisk3 U7311.D20.6502EBB-CB1-C07-T1-W201400A0B8113424-L2000000000000 fcparray Disk Array Device
+ hdisk4 U7311.D20.6502EBB-CB1-C07-T1-W201400A0B8113424-L3000000000000 fcparray Disk Array Device
+ hdisk5 U7311.D20.6502EBB-CB1-C07-T1-W201400A0B8113424-L4000000000000 fcparray Disk Array Device
+ hdisk6 U7311.D20.6502EBB-CB1-C07-T1-W201400A0B8113424-L5000000000000 fcparray Disk Array Device
+ hdisk7 U7311.D20.6502EBB-CB1-C07-T1-W201400A0B8113424-L6000000000000 fcparray Disk Array Device
+ hdisk8 U7311.D20.6502EBB-CB1-C07-T1-W201400A0B8113424-L7000000000000 fcparray Disk Array Device
Standard input: END

 

[khalidaaa]

see That's the output of prtconf on our production system

# prtconf
System Model: IBM,9117-570
Machine Serial Number: 65F359F
Processor Type: PowerPC_POWER5
Number Of Processors: 1
Processor Clock Speed: 1654 MHz
CPU Type: 64-bit
Kernel Type: 32-bit
LPAR Info: 2 S1CDBP
Memory Size: 4096 MB
Good Memory Size: 4096 MB
Platform Firmware level: Not Available
Firmware Version: IBM,SF240_202
Console Login: enable
Auto Restart: true
Full Core: false
 
Network Information
 
Paging Space Information
        Total Paging Space: 4096MB
        Percent Used: 1%
 
Volume Groups Information
============================================================================== 
rootvg:
PV_NAME           PV STATE          TOTAL PPs   FREE PPs    FREE DISTRIBUTION
hdisk1            active            546         386         109..13..78..109..77
hdisk0            active            546         363         55..44..78..109..77
============================================================================== 
 
oravg:
PV_NAME           PV STATE          TOTAL PPs   FREE PPs    FREE DISTRIBUTION
hdisk2            active            868         430         72..00..11..173..174
hdisk3            active            868         264         46..00..00..44..174
============================================================================== 
 
INSTALLED RESOURCE LIST

The following resources are installed on the machine.
+/- = Added or deleted from Resource List.
*   = Diagnostic support not available.

  Model Architecture: chrp
  Model Implementation: Multiple Processor, PCI bus

+ sys0                                                                          System Object
+ sysplanar0                                                                    System Planar
* vio0                                                                          Virtual I/O Bus
* vsa0             U9117.570.65F359F-V2-C0                                      LPAR Virtual Serial Adapter
* vty0             U9117.570.65F359F-V2-C0-L0                                   Asynchronous Terminal
* pci2             U7879.001.DQDGAFT-P1                                         PCI Bus
* pci7             U7879.001.DQDGAFT-P1                                         PCI Bus
+ ent1             U7879.001.DQDGAFT-P1-C1-T1                                   10/100/1000 Base-TX PCI-X Adapter (14106902)
* pci8             U7879.001.DQDGAFT-P1                                         PCI Bus
+ fcs1             U7879.001.DQDGAFT-P1-C2-T1                                   FC Adapter
* fcnet1           U7879.001.DQDGAFT-P1-C2-T1                                   Fibre Channel Network Protocol Device
* fscsi1           U7879.001.DQDGAFT-P1-C2-T1                                   FC SCSI I/O Controller Protocol Device
* dac2             U7879.001.DQDGAFT-P1-C2-T1-W200200A0B817BAC1                 1742-900 (900) Disk Array Controller
* dac3             U7879.001.DQDGAFT-P1-C2-T1-W200300A0B817BAC2                 1742-900 (900) Disk Array Controller
* pci1             U7879.001.DQDGAFT-P1                                         PCI Bus
* pci9             U7879.001.DQDGAFT-P1                                         PCI Bus
* pci10            U7879.001.DQDGAFT-P1-C3                                      PCI Bus
+ lai0             U7879.001.DQDGAFT-P1-C3-T1                                   GXT135P Graphics Adapter
* pci4             U7879.001.DQDGAFT-P1                                         PCI Bus
+ ent0             U7879.001.DQDGAFT-P1-C5-T1                                   10/100/1000 Base-TX PCI-X Adapter (14106902)
* pci5             U7879.001.DQDGAFT-P1                                         PCI Bus
+ fcs0             U7879.001.DQDGAFT-P1-C6-T1                                   FC Adapter
* fcnet0           U7879.001.DQDGAFT-P1-C6-T1                                   Fibre Channel Network Protocol Device
* fscsi0           U7879.001.DQDGAFT-P1-C6-T1                                   FC SCSI I/O Controller Protocol Device
* dac0             U7879.001.DQDGAFT-P1-C6-T1-W200300A0B817BAC1                 1742-900 (900) Disk Array Controller
* dac1             U7879.001.DQDGAFT-P1-C6-T1-W200200A0B817BAC2                 1742-900 (900) Disk Array Controller
* pci0             U7879.001.DQDGAFT-P1                                         PCI Bus
* pci3             U7879.001.DQDGAFT-P1                                         PCI Bus
+ sisscsia0        U7879.001.DQDGAFT-P1                                         PCI-X Ultra320 SCSI Adapter
+ scsi0            U7879.001.DQDGAFT-P1-T14                                     PCI-X Ultra320 SCSI Adapter bus
+ hdisk0           U7879.001.DQDGAFT-P1-T14-L4-L0                               16 Bit LVD SCSI Disk Drive (73400 MB)
+ hdisk1           U7879.001.DQDGAFT-P1-T14-L5-L0                               16 Bit LVD SCSI Disk Drive (73400 MB)
+ ses0             U7879.001.DQDGAFT-P1-T14-L15-L0                              SCSI Enclosure Services Device
* pci11            U7879.001.DQDGAFT-P1                                         PCI Bus
+ usbhc0           U7879.001.DQDGAFT-P1                                         USB Host Controller (33103500)
+ usbhc1           U7879.001.DQDGAFT-P1                                         USB Host Controller (33103500)
+ L2cache0                                                                      L2 Cache
+ mem0                                                                          Memory
+ proc0                                                                         Processor
* kbd0             U7879.001.DQDGAFT-P1-T4-L1-L3                                USB keyboard
* mouse1           U7879.001.DQDGAFT-P1-T4-L1-L4                                USB mouse
* mouse0           U7879.001.DQDGAFT-P1-T4-L1-L4                                USB mouse
+ hdisk2           U7879.001.DQDGAFT-P1-C2-T1-W200200A0B817BAC1-L0              1742-900 (900) Disk Array Device
+ hdisk3           U7879.001.DQDGAFT-P1-C2-T1-W200200A0B817BAC1-L1000000000000  1742-900 (900) Disk Array Device

If you can see disk0 and disk1 are on the same scsi0 controller!

In your prtconf hdisk0 is on an integrated adapter T2
Mine is on T14. But mine is having two disks added with the T14 slot right? so i don't know why yours is showing one only!

I'll tell you what. I've not yet completed my reading but try reading in this link about "rvgrecover"

http://www.unet.univie.ac.at/aix/aixprob/prbslvgd/recovervgs.htm

Regards,
Khalid

 

[khalidaaa]

oh by the way, how could you assign this slot to a different LPAR when you said previously?

This is the hdisk0 on this current LPAR so i believe you have do shutdown this LPAR right?

 

[khalidaaa]

I've been looking all around, i think this is not going to be fixed today i'm gonna leave now but i will come tomorrow to continue chapter 3 with this problem

can you go ahead and try to see man mkdev?

may be this could work

mkdev -c disk -l hdisk#

worth trying as well!

oh by the way what was in hdisk1? what does it contain?

bye

 

[J1gh2]

Sorry I was in a meeting.

thanks again for spending all your day on this. I think i have now completely messed up the system (lsvg now does not even display rootvg but the system is still up!!!).

have a good evening

 

[khalidaaa]

Good Morning J1gh2

Oh no Not good news

Do you have a recent backup?

what does the command (odmget -q name="rootvg" CuDv) and (lqueryvg -p hdisk0 -At)

I think you messed up the ODM dude

I'm not sure that your system will boot if you try to reboot it!

Regards,
Khalid

 

[J1gh2]

Morning mate

Thanks for checking.

I came across a tip on how to restore a previous copy of rootvg which advised restoring some files in /etc/onjrepos. I backed up the existing files and then restored the old copies as the guy advised and when I ran cfgmgr rootvg disappeared!!! I have never seen it before where lsvg did not even return rootvg. Thankfully, the system was still running so I re-installed some base level filesets this morning and rootvg came back. Phew! but the second disk still hasn`t come back so I am chasing up IBM for a call that I logged with them since Monday.

I am tempted to go and physically power that disk off and power it back on to see if that would jumpstart the scsi adapter.

By the way, you were asking in your other post: "how could you assign this slot to a different LPAR when you said previously?"

On the HMC, I removed the slot from selected the active profile of the lpar (under "physical I/O tab) and added the slot to another lpar. (since the disk i snot showing in the odm anymore and is not listed with lspv, I did not run rmdev). I then logged on to the other lpar and ran cfgmgr. All these should be done on the fly so I did not reboot.

lsvg and lqueryvg are now normal:

root@newlpar:/$ odmget -q name="rootvg" CuDv

CuDv:
name = "rootvg"
status = 0
chgstatus = 1
ddins = ""
location = ""
parent = ""
connwhere = ""
PdDvLn = "logical_volume/vgsubclass/vgtype"
root@newlpar:/$ lqueryvg -p hdisk0 -At
Max LVs: 256
PP Size: 27
Free PPs: 236
LV count: 17
PV count: 1
Total VGDAs: 2
Conc Allowed: 0
MAX PPs per PV 1016
MAX PVs: 32
Conc Autovaryo 0
Varied on Conc 0
Logical: 00c543ef00004c000000010aad9767e5.1 hd5 1
00c543ef00004c000000010aad9767e5.2 hd6 1
00c543ef00004c000000010aad9767e5.3 hd8 1
00c543ef00004c000000010aad9767e5.4 hd4 1
00c543ef00004c000000010aad9767e5.5 hd2 1
00c543ef00004c000000010aad9767e5.6 hd9var 1
00c543ef00004c000000010aad9767e5.7 hd3 1
00c543ef00004c000000010aad9767e5.8 hd1 1
00c543ef00004c000000010aad9767e5.9 hd10opt 1
00c543ef00004c000000010aad9767e5.10 fslv00 1
00c543ef00004c000000010aad9767e5.11 loglv00 1
00c543ef00004c000000010aad9767e5.12 tftpbootlv 1
00c543ef00004c000000010aad9767e5.13 exportlv 1
00c543ef00004c000000010aad9767e5.14 spotlv 1
00c543ef00004c000000010aad9767e5.15 lpp_sourcelv 1
00c543ef00004c000000010aad9767e5.16 mksysblv 1
00c543ef00004c000000010aad9767e5.17 paging00 1
Physical: 00c543efe8ada10a 2 0
Total PPs: 546
LTG size: 128
HOT SPARE: 0
AUTO SYNC: 0
VG PERMISSION: 0
SNAPSHOT VG: 0
IS_PRIMARY VG: 0
PSNFSTPP: 4352
VARYON MODE: 0
VG Type: 0
Max PPs: 32512

 

[khalidaaa]

ok, but if you just put the selected disk on the LPAR's profile and run cfgmgr it will not pick it! you should do it thru DLPAR or shutdown and restart the other LPAR to pick the disk!

The reason for me asking this question in the other post is that i showed you my LPAR configuration as in this

+ sisscsia0        U7879.001.DQDGAFT-P1                                         PCI-X Ultra320 SCSI Adapter
+ scsi0            U7879.001.DQDGAFT-P1-T14                                     PCI-X Ultra320 SCSI Adapter bus
+ hdisk0           U7879.001.DQDGAFT-P1-T14-L4-L0                               16 Bit LVD SCSI Disk Drive (73400 MB)
+ hdisk1           U7879.001.DQDGAFT-P1-T14-L5-L0                               16 Bit LVD SCSI Disk Drive (73400 MB)
+ ses0             U7879.001.DQDGAFT-P1-T14-L15-L0                              SCSI Enclosure Services Device

As you can see my hdisk1 and hdisk0 are on the same slot (T14 attached to one scsi) and i'm using the same expansion pack as yours i believe 7311 and the same 570 machine i guess 9117 and in your post hdisk0 shows this

+ sisscsia0        U7311.D20.6502EBB-CB1-C08                                      PCI-X Dual Channel Ultra320 SCSI Adapter
+ scsi0            U7311.D20.6502EBB-CB1-C08-T1                                   PCI-X Dual Channel Ultra320 SCSI Adapter bus
+ scsi1            U7311.D20.6502EBB-CB1-C08-T2                                   PCI-X Dual Channel Ultra320 SCSI Adapter bus
+ hdisk0           U7311.D20.6502EBB-CB1-C08-T2-L8-L0                             16 Bit LVD SCSI Disk Drive (73400 MB)
* ses0             U7311.D20.6502EBB-CB1-C08-T2-L15-L0                            SCSI Enclosure Services Device

so i was just wondering again whether yours (hdisk0 and hdisk1) are on the same integrated slot as mine. Never mind.

Can you do this again, assigning the disk to another LPAR. If you did it using the other LPAR's profile then you have to reboot that LPAR in order for the profile to be activated

Regards
Khalid

 

[J1gh2]

Hi Khalid

I can reallocate cpu and memory through DLPAR but I do not have the same option with the storage controller. I only get the CD drive as the option to move through DLPAR. Presumably, this is because it is the only resource that is added "as desired". The other LPAR is being used so I cannot reboot it unless I plan for downtime.

Despite my high priority call, IBM haven`t come back yet so I might yet do that to test this out.

Cheers

 

[khalidaaa]

hmmm but even if you did that and it worked then we will just be testing that this hdisk is working right? so it is not at all indication that it will work on your current test lpar right?

any way, what was the content of the hdisk1 before it disappeared? do you remember? was it a mirror of hdisk0?

Regards,
Khalid

 

[J1gh2]

You are right with both questions. Assigning the disk to another lpar is still a test that I would like to do, even if just to be clear that the problem is restricted to the current test lpar. And, yes, hdisk1 was a mirror of hdisk0

Regards

 

[khalidaaa]

well, the problem is that hdisk1 has dissapeared from both ODM and the VGDA for now! so it doesn't exist any more in the configuration and it doesn't want to show after cfgmgr!


hmmm

have you tried this command

synclvodm -v rootvg

Cheers

 

[J1gh2]

hi mate

Yes, I have just done that now as well. It basically goes through and updates all the logical volumes in rootvg. I have run cfgmgr afterwards but no changes...

Never mind. I will chase up IBM tomorrow and see what happens.

Best regards

 

[khalidaaa]

well, i'm really sorry my freind for all of that!

I was really trying to help but it seems that we are missing something somewhere

I will try to think of something else and i will be waiting to hear from you the solution hopefully

Cheers,
Khalid

 

[J1gh2]

Khalid,

Are you "really sorry"? come on. You have personalised this issue so much that I can only pray that if you ever need help or assistance with anything, the help will be chasing you down with the solution.

I can`t thank you enough and hope that I have an opportunity to help you as well with something down the line.

Best regards

 

[J1gh2]

Hi Khalid

Problem solved and I thought you might like to know the solution.

IBM analysed the snap filed and identified that the scsi adapter with hdisk1 on it was defined but not available. So we went through the following checks:

1) On WebSm --> server management --> see the properties of the server and see what the adapter is assigned to. (When I did this, I saw that it was “unassigned”)
2) However, on the properties of the active profile for the test lpar, it said that it was assigned to the lpar. The IBM guy said it was not activated and that there are two ways to activate the profile: i) add the disk through DLPAR (path: DLPAR --> Physical adapter resources --> add). Or ii) actually shutdown the lpar and re-activate. (I had just been rebooting)
3) I added the adapter through DLPAR as above. Then we went through the following steps:
i) cfgmgr –l sisscsia1 (which has hdisk1 on it. I had tried that on scs1 but it didn`t work)
ii) cfgmgr (which completed and lspv shows that the disk came back as hdisk9 but I wanted to re-order my disk numbering so we did)
iii) rmdev –R –dl dar0 to remove the SAN disks
iv) rmdev –dl hdisk9
v) re-run cfgmgr –l sisscsia1 (which reconfigured the internal disk as hdisk1)
vi) then ran cfgmgr without options and this picked up the SAN disks
vii) To fool proof this, I have actually shut down the lpar and re-acted it and the disk is still there.

Well, like I said yesterday, thank you very much for your help and time.

Have a great weekend.