| InfoDoc ID |
|
Synopsis |
|
Date |
| 23402 |
|
RM6 - Editing the /usr/lib/osa/rdac_address file to get lad and format matched |
|
14 Nov 2000 |
In our setup we have the following:
* 2 E4500s running Cluster 2.2/RM 6.22
- db01
- db03
* 3 A3500s
- DB03_001
- DB03_002
- DB01_001
* 6 controllers per side used for RM6:
- c2
- c3
- c4
- c6
- c7
- c8
- c0 (boot disks)
- c5 (boot disks)
* 3 LUNs per A3500:
- 0,1,2
If we run /usr/lib/osa/bin/lad on one of our systems you can see that the LUNs and controllers don't line up.
Some controllers in lad don't even show up in format:
db01(sh) # lad
c2t5d0 1T01700238 LUNS: 0
c3t5d0 1T92401370 LUNS: 0 2
c4t4d1 1T01700248 LUNS: 1 2
c6t5d0 1T92401060 LUNS: 0 2
c7t4d1 1T92401101 LUNS: 1
c8t4d1 1T94600456 LUNS: 1
db01(sh) # format
Searching for disks...done
AVAILABLE DISK SELECTIONS:
0. c0t8d0 <SUN18G cyl 7506 alt 2 hd 19 sec 248>
/sbus@2,0/QLGC,isp@2,10000/sd@8,0
1. c0t9d0 <SUN18G cyl 7506 alt 2 hd 19 sec 248>
/sbus@2,0/QLGC,isp@2,10000/sd@9,0
2. c2t5d0 <Symbios-StorEDGEA3000-0205 cyl 51701 alt 2 hd 64 sec 64>
/pseudo/rdnexus@2/rdriver@5,0
3. c2t5d1 <Symbios-StorEDGEA3000-0205 cyl 51701 alt 2 hd 64 sec 64>
/pseudo/rdnexus@2/rdriver@5,1
4. c2t5d2 <Symbios-StorEDGEA3000-0301 cyl 17232 alt 2 hd 64 sec 64>
/pseudo/rdnexus@2/rdriver@5,2
5. c3t5d0 <Symbios-StorEDGEA3000-0301 cyl 48 alt 2 hd 64 sec 64>
/pseudo/rdnexus@3/rdriver@5,0
6. c3t5d1 <Symbios-StorEDGEA3000-0301 cyl 51701 alt 2 hd 64 sec 64>
/pseudo/rdnexus@3/rdriver@5,1
7. c3t5d2 <Symbios-StorEDGEA3000-0301 cyl 51651 alt 2 hd 64 sec 64>
/pseudo/rdnexus@3/rdriver@5,2
8. c5t8d0 <SUN18G cyl 7506 alt 2 hd 19 sec 248>
/sbus@e,0/QLGC,isp@2,10000/sd@8,0
9. c5t9d0 <SUN18G cyl 7506 alt 2 hd 19 sec 248>
/sbus@e,0/QLGC,isp@2,10000/sd@9,0
10. c6t5d0 <Symbios-StorEDGEA3000-0205 cyl 48 alt 2 hd 64 sec 64>
/pseudo/rdnexus@6/rdriver@5,0
11. c6t5d1 <Symbios-StorEDGEA3000-0205 cyl 51701 alt 2 hd 64 sec 64>
/pseudo/rdnexus@6/rdriver@5,1
12. c6t5d2 <Symbios-StorEDGEA3000-0301 cyl 51651 alt 2 hd 64 sec 64>
/pseudo/rdnexus@6/rdriver@5,2
Specify disk (enter its number): ^D
db01(sh) #
By default our rdac_address looks like:
db01(sh) # cat /usr/lib/osa/rdac_address
db03_002:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:
db03_001:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:
db01_001:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:A:
To fix this problem we need to dump the module profile for each A3500.
- /usr/lib/osa/bin/rm6
- Select configuration
- File->Save Module Profile
- give the selection box a filename (sugg.: use the name of A3500 for this filename)
- click save
Here is a our 3 files (trimmed):
########################################################################
Profile for db03_001
Profile Generated By: RAID Manager Release 06.22.01.14
Host: db03
Controllers:
Name Serial Number Mode Logical Units
A (c2t5d0) 1T92401370 Active 2
B (c4t4d1) 1T92401101 Active 1
.
.
.
Logical Units (LUNs):
Detailed LUN Information for db03_001
Capacity
LUN Controller (MB) RAID Level
0 c2t5d0 100 0
1 c4t4d1 103407 0
2 c2t5d2 103307 0
########################################################################
Profile for db01_001
Profile Generated By: RAID Manager Release 06.22.01.14
Host: db03
Controllers:
Name Serial Number Mode Logical Units
A (c7t5d0) 1T01700238 Active 1
B (c8t4d1) 1T01700248 Active 2
.
.
.
Logical Units (LUNs):
Detailed LUN Information for db01_001
Capacity
LUN Controller (MB) RAID Level
0 c7t5d0 103407 0
1 c8t4d1 103407 0
2 c8t4d2 34469 0
########################################################################
Profile for db03_002
Profile Generated By: RAID Manager Release 06.22.01.14
Host: db03
Controllers:
Name Serial Number Mode Logical Units
A (c3t5d0) 1T92401060 Active 2
B (c6t4d1) 1T94600456 Active 1
.
.
.
Logical Units (LUNs):
Detailed LUN Information for db03_002
Capacity
LUN Controller (MB) RAID Level
0 c3t5d0 100 0
1 c6t4d1 103407 0
2 c3t5d2 103307 0
########################################################################
We can take the above info and create a new /usr/lib/osa/rdac_address file.
Looking at the profile for "db03_001" it shows that c2t5d0 is tied to "A" and c4t4d1 to "B".
Lower in the profile we can see the LUN order 0,1,2 with one controller per LUN. If we add the
letter associated with each controller above, we come up with:
LUN Controller Letter
0 c2t5d0 A
1 c4t4d1 B
2 c2t5d2 A
Take this ordering and create your new line. In our instance it would be:
db03_001:A:B:A:A:B:A:A:B:A:A:B:A:A:B:A:A:B:A:A:B:A:A:B:A:A:B:A:A:B:A:A:B:A:
When we are all done, the file will look like:
db01(sh) # cat /usr/lib/osa/rdac_address
db03_002:A:B:A:A:B:A:A:B:A:A:B:A:A:B:A:A:B:A:A:B:A:A:B:A:A:B:A:A:B:A:A:B:A:
db03_001:A:B:A:A:B:A:A:B:A:A:B:A:A:B:A:A:B:A:A:B:A:A:B:A:A:B:A:A:B:A:A:B:A:
db01_001:A:B:B:A:B:B:A:B:B:A:B:B:A:B:B:A:B:B:A:B:B:A:B:B:A:B:B:A:B:B:A:B:B:
Once you have created your new rdac_address file, follow the next steps to clean up /dev and /devices:
(the c numbers are derived from the lad output)
cd /dev/dsk
rm c2* c3* c4* c6* c7* c8*
cd /dev/rdsk
rm c2* c3* c4* c6* c7* c8*
cd /dev
rm -r osa
cd /devices/pseudo
rm -r rdnexus*
(reboot 2 times)
db01(sh) # reboot -- -r
db01(sh) # reboot -- -r
After the 2nd reboot we can see that both format and lad sync up.
db01(sh) # lad
c2t5d0 1T01700238 LUNS: 0
c3t5d0 1T92401370 LUNS: 0 2
c4t4d1 1T01700248 LUNS: 1 2
c6t5d0 1T92401060 LUNS: 0 2
c7t4d1 1T92401101 LUNS: 1
c8t4d1 1T94600456 LUNS: 1
db01(sh) # format
Searching for disks...done
AVAILABLE DISK SELECTIONS:
0. c0t8d0 <SUN18G cyl 7506 alt 2 hd 19 sec 248>
/sbus@2,0/QLGC,isp@2,10000/sd@8,0
1. c0t9d0 <SUN18G cyl 7506 alt 2 hd 19 sec 248>
/sbus@2,0/QLGC,isp@2,10000/sd@9,0
2. c2t5d0 <Symbios-StorEDGEA3000-0205 cyl 51701 alt 2 hd 64 sec 64>
/pseudo/rdnexus@2/rdriver@5,0
3. c3t5d0 <Symbios-StorEDGEA3000-0301 cyl 48 alt 2 hd 64 sec 64>
/pseudo/rdnexus@3/rdriver@5,0
4. c3t5d2 <Symbios-StorEDGEA3000-0301 cyl 51651 alt 2 hd 64 sec 64>
/pseudo/rdnexus@3/rdriver@5,2
5. c4t4d1 <Symbios-StorEDGEA3000-0205 cyl 51701 alt 2 hd 64 sec 64>
/pseudo/rdnexus@4/rdriver@4,1
6. c4t4d2 <Symbios-StorEDGEA3000-0301 cyl 17232 alt 2 hd 64 sec 64>
/pseudo/rdnexus@4/rdriver@4,2
7. c5t8d0 <SUN18G cyl 7506 alt 2 hd 19 sec 248>
/sbus@e,0/QLGC,isp@2,10000/sd@8,0
8. c5t9d0 <SUN18G cyl 7506 alt 2 hd 19 sec 248>
/sbus@e,0/QLGC,isp@2,10000/sd@9,0
9. c6t5d0 <Symbios-StorEDGEA3000-0205 cyl 48 alt 2 hd 64 sec 64>
/pseudo/rdnexus@6/rdriver@5,0
10. c6t5d2 <Symbios-StorEDGEA3000-0301 cyl 51651 alt 2 hd 64 sec 64>
/pseudo/rdnexus@6/rdriver@5,2
11. c7t4d1 <Symbios-StorEDGEA3000-0301 cyl 51701 alt 2 hd 64 sec 64>
/pseudo/rdnexus@7/rdriver@4,1
12. c8t4d1 <Symbios-StorEDGEA3000-0205 cyl 51701 alt 2 hd 64 sec 64>
/pseudo/rdnexus@8/rdriver@4,1
Specify disk (enter its number): ^D
db01(sh) #
INTERNAL SUMMARY:
Internal Summary
Douglas R. Mauro
Professional Services Project Engineer
345 Woodcliff Drive, Fairport, NY 14450
Phone: 716.385.5010 (internal x25010)
Email: douglas.mauro@east.sun.com
Internal Bugs: 4198033 4354182 4346881 4208955
SUBMITTER: Douglas R. Mauro
BUG REPORT ID: 4198033, 4354182, 4346881, 4208955
APPLIES TO: Storage/RAID Manager, AFO Vertical Team Docs/Storage
ATTACHMENTS:
Copyright (c) 1997-2003 Sun Microsystems, Inc.