Các câu lệnh kiểm tra, giám sát, khắc phục lỗi storage trên Solaris

 Mục đích: Hướng dẫn các câu lệnh kiểm tra, giám sát, khắc phục lỗi storage trên Solaris (phần tạo các File system có mục riềng)

1.Scan để nhận phân vùng SAN (2 node)	echo |format root@dbaviet # luxadm -e port /devices/pci@400/pci@2/pci@0/pci@4/SUNW,emlxs@0/fp@0,0:devctl  NOT CONNECTED /devices/pci@400/pci@2/pci@0/pci@4/SUNW,emlxs@0,1/fp@0,0:devctl CONNECTED /devices/pci@500/pci@2/pci@0/pci@a/SUNW,emlxs@0/fp@0,0:devctl  NOT CONNECTED /devices/pci@500/pci@2/pci@0/pci@a/SUNW,emlxs@0,1/fp@0,0:devctl CONNECTED -- Nhan phan vung moi luxadm -e forcelip /devices/pci@400/pci@2/pci@0/pci@4/SUNW,emlxs@0,1/fp@0,0:devctl luxadm -e forcelip /devices/pci@500/pci@2/pci@0/pci@a/SUNW,emlxs@0,1/fp@0,0:devctl devfsadm -Cv echo |format fcinfo hba-port -l 10000000c9b0a311 Echo |format |grep 00000036
2.Check thông tin phân vùng SAN	root@dbaviet # echo |format Searching for disks...done AVAILABLE DISK SELECTIONS:     0. c0t35B6ABAAA5339684d0 <LSI-LogicalVolume-3000 cyl 65533 alt 2 hd 32 sec 557>           /pci@400/pci@1/pci@0/pci@0/LSI,sas@0/iport@v0/disk@w35b6abaaa5339684,0     1. c0t3086A5C588639079d0 <LSI-LogicalVolume-3000 cyl 65533 alt 2 hd 32 sec 557>           /pci@400/pci@1/pci@0/pci@0/LSI,sas@0/iport@v0/disk@w3086a5c588639079,0     2. c2t3BC2581E333FE460d0 <LSI-LogicalVolume-3000 cyl 65533 alt 2 hd 32 sec 557>           /pci@700/pci@1/pci@0/pci@0/LSI,sas@0/iport@v0/disk@w3bc2581e333fe460,0     3. c2t3E41E2D0DDBE6F6Ed0 <LSI-LogicalVolume-3000 cyl 65533 alt 2 hd 32 sec 557>           /pci@700/pci@1/pci@0/pci@0/LSI,sas@0/iport@v0/disk@w3e41e2d0ddbe6f6e,0     4. c15t60060E8004A53B000000A53B00000040d0 <HITACHI-OPEN-V  -SUN-5009-1.83TB>  fpayu01           /scsi_vhci/ssd@g60060e8004a53b000000a53b00000040     5. c15t60060E8004A53B000000A53B00000220d0 <HITACHI-OPEN-V  -SUN-5009-1.83TB>  fpays01           /scsi_vhci/ssd@g60060e8004a53b000000a53b00000220 Specify disk (enter its number): Specify disk (enter its number):   -- Check logical path root@dbaviet # luxadm probe No Network Array enclosures found in /dev/es Found Fibre Channel device(s):   Node WWN:50060e8004a53b00  Device Type:Disk device Logical Path:/dev/rdsk/c15t60060E8004A53B000000A53B00000040d0s2   Node WWN:50060e8004a53b00  Device Type:Disk device Logical Path:/dev/rdsk/c15t60060E8004A53B000000A53B00000220d0s2 -- Cổng vật lý: 4 cổng -- Serial Number: Khác nhau thể hiện 4 Card, mỗi card 1 cổng root@dbaviet # fcinfo hba-port HBA Port WWN: 10000000c9a0d2a1      OS Device Name: /dev/cfg/c3      Manufacturer: Emulex      Model: LPe11000-S      Firmware Version: 2.82a4 (Z3D2.82A4)      FCode/BIOS Version: Boot:5.02a1 Fcode:1.50a9      Serial Number: 0999BT0-1013000CYV      Driver Name: emlxs      Driver Version: 2.60k (2011.03.24.16.45)      Type: N-port      State: online      Supported Speeds: 1Gb 2Gb 4Gb      Current Speed: 4Gb      Node WWN: 20000000c9a0d2a1 HBA Port WWN: 10000000c9a0d291      OS Device Name: /dev/cfg/c1      Manufacturer: Emulex      Model: LPe11000-S      Firmware Version: 2.82a4 (Z3D2.82A4)      FCode/BIOS Version: Boot:5.02a1 Fcode:1.50a9      Serial Number: 0999BT0-1013000CZV      Driver Name: emlxs      Driver Version: 2.60k (2011.03.24.16.45)      Type: N-port      State: online      Supported Speeds: 1Gb 2Gb 4Gb      Current Speed: 4Gb      Node WWN: 20000000c9a0d291 HBA Port WWN: 10000000c9a0d271      OS Device Name: /dev/cfg/c4      Manufacturer: Emulex      Model: LPe11000-S      Firmware Version: 2.82a4 (Z3D2.82A4)      FCode/BIOS Version: Boot:5.02a1 Fcode:1.50a9      Serial Number: 0999BT0-1013000D26      Driver Name: emlxs      Driver Version: 2.60k (2011.03.24.16.45)      Type: unknown      State: offline      Supported Speeds: 1Gb 2Gb 4Gb      Current Speed: not established      Node WWN: 20000000c9a0d271 HBA Port WWN: 10000000c9a0d255      OS Device Name: /dev/cfg/c5      Manufacturer: Emulex      Model: LPe11000-S      Firmware Version: 2.82a4 (Z3D2.82A4)      FCode/BIOS Version: Boot:5.02a1 Fcode:1.50a9      Serial Number: 0999BT0-1013000CYS      Driver Name: emlxs      Driver Version: 2.60k (2011.03.24.16.45)      Type: unknown      State: offline      Supported Speeds: 1Gb 2Gb 4Gb      Current Speed: not established      Node WWN: 20000000c9a0d255   -- Serial Number: Khác nhau thể hiện 2 Card, mỗi card 2 cổng root@dbaviet # fcinfo hba-port HBA Port WWN: 10000000c963ab60      OS Device Name: /dev/cfg/c2      Manufacturer: Emulex      Model: LP10000DC-S      Firmware Version: 1.92a1 (T2D1.92A1)      FCode/BIOS Version: Boot:5.02a1 Fcode:1.50a9      Serial Number: 0999BG0-07150000RP      Driver Name: emlxs      Driver Version: 2.60k (2011.03.24.16.45)      Type: N-port      State: online      Supported Speeds: 1Gb 2Gb      Current Speed: 2Gb      Node WWN: 20000000c963ab60 --> Đại diện cho port HBA HBA Port WWN: 10000000c963ab61      OS Device Name: /dev/cfg/c5      Manufacturer: Emulex      Model: LP10000DC-S      Firmware Version: 1.92a1 (T2D1.92A1)      FCode/BIOS Version: Boot:5.02a1 Fcode:1.50a9      Serial Number: 0999BG0-07150000RP      Driver Name: emlxs      Driver Version: 2.60k (2011.03.24.16.45)      Type: N-port      State: online      Supported Speeds: 1Gb 2Gb      Current Speed: 2Gb      Node WWN: 20000000c963ab61 HBA Port WWN: 10000000c963a9da      OS Device Name: /dev/cfg/c8      Manufacturer: Emulex      Model: LP10000DC-S      Firmware Version: 1.92a1 (T2D1.92A1)      FCode/BIOS Version: Boot:5.02a1 Fcode:1.50a9      Serial Number: 0999BG0-07150000NW      Driver Name: emlxs      Driver Version: 2.60k (2011.03.24.16.45)      Type: N-port      State: online      Supported Speeds: 1Gb 2Gb      Current Speed: 2Gb      Node WWN: 20000000c963a9da HBA Port WWN: 10000000c963a9db      OS Device Name: /dev/cfg/c9      Manufacturer: Emulex      Model: LP10000DC-S      Firmware Version: 1.92a1 (T2D1.92A1)      FCode/BIOS Version: Boot:5.02a1 Fcode:1.50a9      Serial Number: 0999BG0-07150000NW      Driver Name: emlxs      Driver Version: 2.60k (2011.03.24.16.45)      Type: N-port      State: online      Supported Speeds: 1Gb 2Gb      Current Speed: 2Gb      Node WWN: 20000000c963a9db -- Check số đường đi và thông tin phân vùng khác loại SAN, số controller, WWN, -- 4 đường (4 dòng Controller và ở trạng thái ONLINE-Đang sử dụng) (Nếu Offline là không được kích hoạt, hoặc ONLINE-Disable I/O) root@dbaviet # luxadm display /dev/rdsk/c6t6005076307FFD2BD000000000000001Fd0s2 DEVICE PROPERTIES for disk: /dev/rdsk/c6t6005076307FFD2BD000000000000001Fd0s2   Vendor:           IBM --> IBM DS8700   Product ID:       2107900       Revision:         1400   Serial Num:       75FDZ81001F   Unformatted capacity: 1843200.000 MBytes   Write Cache:      Enabled   Read Cache:       Enabled Minimum prefetch:   0x0 Maximum prefetch:   0x16   Device Type:      Disk device   Path(s):     /dev/rdsk/c6t6005076307FFD2BD000000000000001Fd0s2   /devices/scsi_vhci/ssd@g6005076307ffd2bd000000000000001f:c,raw   Controller           /devices/pci@1,700000/SUNW,emlxs@0/fp@0,0 Device Address          50050763070812bd,0 Host controller port WWN 10000000c9a0d291 Class                   primary State                   ONLINE   Controller           /devices/pci@1,700000/SUNW,emlxs@0/fp@0,0 Device Address          50050763070312bd,0 Host controller port WWN 10000000c9a0d291 Class                   primary State                   ONLINE   Controller           /devices/pci@5,700000/SUNW,emlxs@0/fp@0,0 Device Address          50050763070892bd,0 Host controller port WWN 10000000c9a0d2a1 Class                   primary State                   ONLINE      Controller           /devices/pci@5,700000/SUNW,emlxs@0/fp@0,0 Device Address          50050763070392bd,0 Host controller port WWN 10000000c9a0d2a1 Class                   primary State                   ONLINE State                   ONLINE 8 đường: root@mobicard2 # luxadm display /dev/rdsk/c7t60060E801663D800000163D800000300d0s2 DEVICE PROPERTIES for disk: /dev/rdsk/c7t60060E801663D800000163D800000300d0s2   Vendor:           HITACHI   Product ID:       OPEN-V  -SUN   Revision:         7006   Serial Num:       50 163D80300   Unformatted capacity: 1888256.250 MBytes   Write Cache:      Enabled   Read Cache:       Enabled Minimum prefetch:   0x0 Maximum prefetch:   0x0   Device Type:      Disk device   Path(s):     /dev/rdsk/c7t60060E801663D800000163D800000300d0s2   /devices/scsi_vhci/ssd@g60060e801663d800000163d800000300:c,raw     Controller           /devices/ssm@0,0/pci@19,700000/SUNW,emlxs@1/fp@0,0 Device Address          50060e801663d822,0 Host controller port WWN 10000000c963a97c Class                   primary State                   ONLINE     Controller           /devices/ssm@0,0/pci@19,700000/SUNW,emlxs@1/fp@0,0 Device Address          50060e801663d851,0 Host controller port WWN 10000000c963a97c Class                   primary State                   ONLINE     Controller           /devices/ssm@0,0/pci@18,600000/SUNW,emlxs@1,1/fp@0,0 Device Address          50060e801663d812,0 Host controller port WWN 10000000c963aac3 Class                   primary State                   ONLINE     Controller           /devices/ssm@0,0/pci@18,600000/SUNW,emlxs@1,1/fp@0,0 Device Address          50060e801663d800,0 Host controller port WWN 10000000c963aac3 Class                   primary State                   ONLINE     Controller           /devices/ssm@0,0/pci@19,700000/SUNW,emlxs@1,1/fp@0,0 Device Address          50060e801663d822,0 Host controller port WWN 10000000c963a97d Class                   primary State                   ONLINE     Controller           /devices/ssm@0,0/pci@19,700000/SUNW,emlxs@1,1/fp@0,0 Device Address          50060e801663d851,0 Host controller port WWN 10000000c963a97d Class                   primary State                   ONLINE     Controller           /devices/ssm@0,0/pci@18,600000/SUNW,emlxs@1/fp@0,0 Device Address          50060e801663d812,0 Host controller port WWN 10000000c963aac2 Class                   primary State                   ONLINE     Controller           /devices/ssm@0,0/pci@18,600000/SUNW,emlxs@1/fp@0,0 Device Address          50060e801663d800,0 Host controller port WWN 10000000c963aac2 Class                   primary State                   ONLINE   Check số đường trên 1 máy chủ SAN đi qua: count số đường, ít dùng root@dbaviet # mpathadm list lu /dev/rdsk/c7t60060E80056F530000006F5300000004d0s2 mpath-support:  libmpscsi_vhci.so         /dev/rdsk/c7t60060E80056F530000006F5300000004d0s2             Total Path Count: 8             Operational Path Count: 8 root@dbaviet # mpathadm list lu         /dev/rdsk/c7t60060E80056F530000006F5300000004d0s2             Total Path Count: 8             Operational Path Count: 8         /dev/rdsk/c7t60060E8004A53B000000A53B00000212d0s2             Total Path Count: 3             Operational Path Count: 3         /dev/rdsk/c7t60060E801663D800000163D800000402d0s2             Total Path Count: 8             Operational Path Count: 8         /dev/rdsk/c7t60060E801663D800000163D800000401d0s2             Total Path Count: 8             Operational Path Count: 8         /dev/rdsk/c7t60060E801663D800000163D800000400d0s2             Total Path Count: 8             Operational Path Count: 8         /dev/rdsk/c7t60060E801663D800000163D800000306d0s2             Total Path Count: 8             Operational Path Count: 8         /dev/rdsk/c7t60060E801663D800000163D800000305d0s2             Total Path Count: 8             Operational Path Count: 8         /dev/rdsk/c7t60060E801663D800000163D800000304d0s2             Total Path Count: 8             Operational Path Count: 8         /dev/rdsk/c7t60060E801663D800000163D800000303d0s2             Total Path Count: 8             Operational Path Count: 8         /dev/rdsk/c7t60060E801663D800000163D800000302d0s2             Total Path Count: 8             Operational Path Count: 8         /dev/rdsk/c7t60060E801663D800000163D800000301d0s2             Total Path Count: 8             Operational Path Count: 8         /dev/rdsk/c7t60060E801663D800000163D800000300d0s2             Total Path Count: 8             Operational Path Count: 8         /dev/rdsk/c7t60060E801026C5B00511448B00000001d0s2             Total Path Count: 3             Operational Path Count: 3         /dev/rdsk/c7t60060E801026C5B00511448B00000000d0s2             Total Path Count: 3             Operational Path Count: 3         /dev/rdsk/c7t60060E801026C5B00511448B0000005Bd0s2             Total Path Count: 3             Operational Path Count: 3         /dev/rdsk/c7t60060E801036ABE0057DAEEE000001F8d0s2             Total Path Count: 4             Operational Path Count: 4 multipath den VSP 8 path anh nhe   # mpathadm show lu /dev/rdsk/c7t6000B08414B30303336313930300000Bd0s2 Logical Unit:  /dev/rdsk/c7t6000B08414B30303336313930300000Bd0s2         mpath-support:  libmpscsi_vhci.so         Vendor:  Oracle         Product:  Oracle FS1-2         Revision:  6203         Name Type:  unknown type         Name:  6000b08414b30303336313930300000b         Asymmetric:  yes         Current Load Balance:  round-robin         Logical Unit Group ID:  NA         Auto Failback:  off         Auto Probing:  NA           Paths:                 Initiator Port Name:  10000000c96dd78e                 Target Port Name:  2100000e1ec7cde1                 Override Path:  NA                 Path State:  OK                 Disabled:  no                   Initiator Port Name:  10000000c96dd78e                 Target Port Name:  2100000e1ec7d181                 Override Path:  NA                 Path State:  OK                 Disabled:  no                   Initiator Port Name:  10000000c96dd78e                 Target Port Name:  2100000e1ec7ce11                 Override Path:  NA                 Path State:  OK                 Disabled:  no                   Initiator Port Name:  10000000c96dd78e                 Target Port Name:  2100000e1ec78991                 Override Path:  NA                 Path State:  OK                 Disabled:  no                   Initiator Port Name:  10000000c96dd78e                 Target Port Name:  2100000e1ec7ce51                 Override Path:  NA                 Path State:  OK                 Disabled:  no                   Initiator Port Name:  10000000c96dd78e                 Target Port Name:  2100000e1ec78981                 Override Path:  NA                 Path State:  OK                 Disabled:  no                   Initiator Port Name:  10000000c96dd7e2                 Target Port Name:  2100000e1ec7cde0                 Override Path:  NA                 Path State:  OK                 Disabled:  no                   Initiator Port Name:  10000000c96dd7e2                 Target Port Name:  2100000e1ec7d180                 Override Path:  NA                 Path State:  OK                 Disabled:  no                   Initiator Port Name:  10000000c96dd7e2                 Target Port Name:  2100000e1ec7ce10                 Override Path:  NA                 Path State:  OK                 Disabled:  no                   Initiator Port Name:  10000000c96dd7e2                 Target Port Name:  2100000e1ec78990                 Override Path:  NA                 Path State:  OK                 Disabled:  no                   Initiator Port Name:  10000000c96dd7e2                 Target Port Name:  2100000e1ec7ce50                 Override Path:  NA                 Path State:  OK                 Disabled:  no                   Initiator Port Name:  10000000c96dd7e2                 Target Port Name:  2100000e1ec78980                 Override Path:  NA                 Path State:  OK                 Disabled:  no           Target Port Groups:                 ID:  2                 Explicit Failover:  no                 Access State:  active optimized                 Target Ports:                         Name:  2100000e1ec7cde1                         Relative ID:  69                           Name:  2100000e1ec7d181                         Relative ID:  65                           Name:  2100000e1ec7ce11                         Relative ID:  67                           Name:  2100000e1ec7cde0                         Relative ID:  68                           Name:  2100000e1ec7d180                         Relative ID:  64                           Name:  2100000e1ec7ce10                         Relative ID:  66                   ID:  1                 Explicit Failover:  no                 Access State:  active not optimized                 Target Ports:                         Name:  2100000e1ec78991                         Relative ID:  33                           Name:  2100000e1ec7ce51                         Relative ID:  35                           Name:  2100000e1ec78981                         Relative ID:  37                           Name:  2100000e1ec78990                         Relative ID:  32                           Name:  2100000e1ec7ce50                         Relative ID:  34                           Name:  2100000e1ec78980                         Relative ID:  36
Check LUN được cấp từ SAN tập trung nào	-- Check LUN được cấp từ SAN tập trung nào root@dbaviet:~# luxadm display /dev/rdsk/c0t60060E80056F530000006F5300000000d0s2 DEVICE PROPERTIES for disk: /dev/rdsk/c0t60060E80056F530000006F5300000000d0s2   Vendor:           HITACHI   Product ID:       OPEN-V  -SUN   Revision:         6008 --> ST9990v; 7006 là VSP; 5009 ST9985;  Oracle FS1-2 6203. Đối soát   Serial Num:       50 06F530000   Unformatted capacity: 1017177.000 MBytes   Read Cache:       Enabled Minimum prefetch:   0x0 Maximum prefetch:   0x0   Device Type:      Disk device   Path(s):     /dev/rdsk/c0t60060E80056F530000006F5300000000d0s2   /devices/scsi_vhci/ssd@g60060e80056f530000006f5300000000:c,raw    Controller           /devices/pci@300/pci@1/pci@0/pci@4/SUNW,emlxs@0/fp@0,0 Device Address          50060e80056f5362,4 Host controller port WWN 10000090fa6d736a Class                   primary State                   ONLINE
Check HBA	WWN của cặp server cài DB RAC:  root@dbaviet:~# fcinfo hba-port HBA Port WWN: 10000090fa9b6ca0 HBA Port WWN: 10000090fa9b6ca1   root@dbaviet:~# fcinfo hba-port HBA Port WWN: 10000090fa0d31bc HBA Port WWN: 10000090fa0d31bd
Controller A, B trên Storage	Storage có 2 controller A & B. Nhưng theo cấu hình hiện tại chỉ có 1 controller A được cấu hình đi qua san switch (controller B hiện tại ko được dùng).   Do vậy để đảm bảo tính dự phòng trong trường hợp controller A bị reset thì hệ thống vẫn hoạt động được. Phương án như sau:  1. Bổ sung thêm 2 dây quang sau đó kết nối tới 2 san swich. Cấu hình zoning cho hệ thống để bổ sung controller B   Sơ đồ hiện tại và bổ sung thêm dây quang như sau:       Storage hiện tại đang dùng firmware version 7xxx vẫn đang hoạt động ổn định.
3.Check dung lượng metadata	root@app-01 # samcmd m   Mass storage status samcmd 4.6.85 00:38:00 Feb  1 2013 samcmd on app-01   ty  eq  status   use state  ord   capacity  free ra  part high low   ma     810  m----2c--r-   1% on            1.796T 1.796T 1M    16   80% 70%  mm     811               1% on   0   40.000G   39.991G  [83867104 inodes]  mr     812               1% on   1    1.796T 1.796T   ma     820  m----2c--r-   1% on            1.796T 1.796T 1M    16   80% 70%  mm     821               1% on       0   40.000G   39.991G  [83867104 inodes]  mr     822               1% on   1    1.796T 1.796T   ma     830  m----2c--r-   1% on            1.796T 1.796T 1M    16   80% 70%  mm     831               1% on   0   40.000G   39.991G  [83867104 inodes]  mr     832               1% on   1    1.796T 1.796T
Check thông tin các partition	# format -- chọn 1 đĩa format> pa partition> pr
Disable	dbaviet, Bước 1: disable 2 đường này (1 port vật lý tương đương với 2 đường logic; Card1 có 2 Card HBA, mỗi port 2 port) mpathadm disable path -i 10000000c963ab61 -t 50060e80056f5325 –l /dev/rdsk/c7t60060E80056F530000006F5300000004d0s2 mpathadm disable path -i 10000000c963ab61 -t 50060e80056f5307 –l /dev/rdsk/c7t60060E80056F530000006F5300000004d0s2 (10000000c963ab61 là WWN của 1 port trên 1 card)   root@dbaviet # luxadm probe No Network Array enclosures found in /dev/es   Found Fibre Channel device(s):   Node WWN:50060e8004a53b34  Device Type:Disk device Logical Path:/dev/rdsk/c7t60060E8004A53B000000A53B00000212d0s2   Node WWN:50060e80056f5335  Device Type:Disk device Logical Path:/dev/rdsk/c7t60060E80056F530000006F5300000004d0s2   Node WWN:50060e801026c5b2  Device Type:Disk device Logical Path:/dev/rdsk/c7t60060E801026C5B00511448B00000000d0s2   Node WWN:50060e801026c5b2  Device Type:Disk device Logical Path:/dev/rdsk/c7t60060E801026C5B00511448B00000001d0s2   Node WWN:50060e801026c5b2  Device Type:Disk device Logical Path:/dev/rdsk/c7t60060E801026C5B00511448B0000005Bd0s2   Node WWN:50060e801036abe2  Device Type:Disk device Logical Path:/dev/rdsk/c7t60060E801036ABE0057DAEEE000001F8d0s2   Node WWN:50060e801663d812  Device Type:Disk device Logical Path:/dev/rdsk/c7t60060E801663D800000163D800000300d0s2   Node WWN:50060e801663d812  Device Type:Disk device Logical Path:/dev/rdsk/c7t60060E801663D800000163D800000301d0s2   Node WWN:50060e801663d812  Device Type:Disk device Logical Path:/dev/rdsk/c7t60060E801663D800000163D800000302d0s2   Node WWN:50060e801663d812  Device Type:Disk device Logical Path:/dev/rdsk/c7t60060E801663D800000163D800000303d0s2   Node WWN:50060e801663d812  Device Type:Disk device Logical Path:/dev/rdsk/c7t60060E801663D800000163D800000304d0s2   Node WWN:50060e801663d812  Device Type:Disk device Logical Path:/dev/rdsk/c7t60060E801663D800000163D800000305d0s2   Node WWN:50060e801663d812  Device Type:Disk device Logical Path:/dev/rdsk/c7t60060E801663D800000163D800000306d0s2   Node WWN:50060e801663d812  Device Type:Disk device Logical Path:/dev/rdsk/c7t60060E801663D800000163D800000400d0s2   Node WWN:50060e801663d812  Device Type:Disk device Logical Path:/dev/rdsk/c7t60060E801663D800000163D800000401d0s2   Node WWN:50060e801663d812  Device Type:Disk device Logical Path:/dev/rdsk/c7t60060E801663D800000163D800000402d0s2   root@dbaviet # luxadm display /dev/rdsk/c7t60060E80056F530000006F5300000004d0s2 DEVICE PROPERTIES for disk: /dev/rdsk/c7t60060E80056F530000006F5300000004d0s2   Vendor:           HITACHI   Product ID:       OPEN-V  -SUN   Revision:         6008   Serial Num:       50 06F530004   Unformatted capacity: 1520435.250 MBytes   Write Cache:      Enabled   Read Cache:       Enabled Minimum prefetch:   0x0 Maximum prefetch:   0x0   Device Type:      Disk device   Path(s):     /dev/rdsk/c7t60060E80056F530000006F5300000004d0s2   /devices/scsi_vhci/ssd@g60060e80056f530000006f5300000004:c,raw      Controller           /devices/ssm@0,0/pci@18,600000/SUNW,emlxs@1/fp@0,0 Device Address          50060e80056f5335,0 Host controller port WWN 10000000c963a9da Class                   primary State                   ONLINE      Controller           /devices/ssm@0,0/pci@18,600000/SUNW,emlxs@1/fp@0,0 Device Address          50060e80056f5317,0 Host controller port WWN 10000000c963a9da Class                   primary State                   ONLINE      Controller           /devices/ssm@0,0/pci@18,600000/SUNW,emlxs@1,1/fp@0,0 Device Address          50060e80056f5317,0 Host controller port WWN 10000000c963a9db Class                   primary State                   ONLINE      Controller           /devices/ssm@0,0/pci@18,600000/SUNW,emlxs@1,1/fp@0,0 Device Address          50060e80056f5335,0 Host controller port WWN 10000000c963a9db Class                   primary State                   ONLINE      Controller           /devices/ssm@0,0/pci@19,700000/SUNW,emlxs@1/fp@0,0 Device Address          50060e80056f5325,0 Host controller port WWN 10000000c963ab60 Class                   primary State                   ONLINE      Controller           /devices/ssm@0,0/pci@19,700000/SUNW,emlxs@1/fp@0,0 Device Address          50060e80056f5307,0 Host controller port WWN 10000000c963ab60 Class                   primary State                   ONLINE      Controller           /devices/ssm@0,0/pci@19,700000/SUNW,emlxs@1,1/fp@0,0 Device Address          50060e80056f5325,0 Host controller port WWN 10000000c963ab61 Class                   primary State                   ONLINE     I/Os disabled on this ONLINE path      Controller           /devices/ssm@0,0/pci@19,700000/SUNW,emlxs@1,1/fp@0,0 Device Address          50060e80056f5307,0 Host controller port WWN 10000000c963ab61 Class                   primary State                   ONLINE I/Os disabled on this ONLINE path   -- Disable cả port 10000000c963ab61  (trên server) trên tất cả các phân vùng: mpathadm disable path -i 10000000c963ab61 -t 50060e801036abea -l /dev/rdsk/c7t60060E801036ABE0057DAEEE000001F8d0s2     mpathadm disable path -i 10000000c963ab61 -t 50060e801663d851 -l /dev/rdsk/c7t60060E801663D800000163D800000300d0s2 mpathadm disable path -i 10000000c963ab61 -t 50060e801663d822 -l /dev/rdsk/c7t60060E801663D800000163D800000300d0s2   mpathadm disable path -i 10000000c963ab61 -t 50060e801663d851 -l /dev/rdsk/c7t60060E801663D800000163D800000301d0s2 mpathadm disable path -i 10000000c963ab61 -t 50060e801663d822 -l /dev/rdsk/c7t60060E801663D800000163D800000301d0s2   mpathadm disable path -i 10000000c963ab61 -t 50060e801663d851 -l /dev/rdsk/c7t60060E801663D800000163D800000302d0s2 mpathadm disable path -i 10000000c963ab61 -t 50060e801663d822 -l /dev/rdsk/c7t60060E801663D800000163D800000302d0s2   mpathadm disable path -i 10000000c963ab61 -t 50060e801663d851 -l /dev/rdsk/c7t60060E801663D800000163D800000303d0s2 mpathadm disable path -i 10000000c963ab61 -t 50060e801663d822 -l /dev/rdsk/c7t60060E801663D800000163D800000303d0s2   mpathadm disable path -i 10000000c963ab61 -t 50060e801663d851 -l /dev/rdsk/c7t60060E801663D800000163D800000304d0s2 mpathadm disable path -i 10000000c963ab61 -t 50060e801663d822 -l /dev/rdsk/c7t60060E801663D800000163D800000304d0s2   mpathadm disable path -i 10000000c963ab61 -t 50060e801663d851 -l /dev/rdsk/c7t60060E801663D800000163D800000305d0s2 mpathadm disable path -i 10000000c963ab61 -t 50060e801663d822 -l /dev/rdsk/c7t60060E801663D800000163D800000305d0s2   mpathadm disable path -i 10000000c963ab61 -t 50060e801663d851 -l /dev/rdsk/c7t60060E801663D800000163D800000306d0s2 mpathadm disable path -i 10000000c963ab61 -t 50060e801663d822 -l /dev/rdsk/c7t60060E801663D800000163D800000306d0s2   mpathadm disable path -i 10000000c963ab61 -t 50060e801663d851 -l /dev/rdsk/c7t60060E801663D800000163D800000400d0s2 mpathadm disable path -i 10000000c963ab61 -t 50060e801663d822 -l /dev/rdsk/c7t60060E801663D800000163D800000400d0s2   mpathadm disable path -i 10000000c963ab61 -t 50060e801663d851 -l /dev/rdsk/c7t60060E801663D800000163D800000401d0s2 mpathadm disable path -i 10000000c963ab61 -t 50060e801663d822 -l /dev/rdsk/c7t60060E801663D800000163D800000401d0s2   mpathadm disable path -i 10000000c963ab61 -t 50060e801663d851 -l /dev/rdsk/c7t60060E801663D800000163D800000402d0s2 mpathadm disable path -i 10000000c963ab61 -t 50060e801663d822 -l /dev/rdsk/c7t60060E801663D800000163D800000402d0s2   mpathadm disable path -i 10000000c963ab61 -t 50060e80056f5307 -l /dev/rdsk/c7t60060E80056F530000006F5300000004d0s2 mpathadm disable path -i 10000000c963ab61 -t 50060e80056f5325 -l /dev/rdsk/c7t60060E80056F530000006F5300000004d0s2
4.Đặt tên cho phân vùng (volname)	root@poc:/export/home/guds# format Searching for disks...done     AVAILABLE DISK SELECTIONS:     0. c0t5000C500480FAF33d0 <SEAGATE-ST960005SSUN600G-0606-558.91GB>           /scsi_vhci/disk@g5000c500480faf33           /dev/chassis/SYS/SASBP/HDD0/disk     1. c0t5000C50047831DD7d0 <SEAGATE-ST960005SSUN600G-0606-558.91GB>           /scsi_vhci/disk@g5000c50047831dd7           /dev/chassis/SYS/SASBP/HDD1/disk Specify disk (enter its number): 0 selecting c0t5000C500480FAF33d0 [disk formatted] /dev/dsk/c0t5000C500480FAF33d0s0 is part of active ZFS pool rpool. Please see zpool(1M).     FORMAT MENU:      disk   - select a disk      type   - select (define) a disk type         partition  - select (define) a partition table      current - describe the current disk      format - format and analyze the disk      repair - repair a defective sector      label  - write label to the disk      analyze - surface analysis      defect - defect list management      backup - search for backup labelsve      verify - read and display labels      inquiry - show disk ID      volname - set 8-character volume name         !<cmd> - execute <cmd>, then return      quit format> vol Enter 8-character volume name (remember quotes)[""]:"OS" Ready to label disk, continue? y   format> ve   Volume name = <      OS> ascii name  = <SEAGATE-ST960005SSUN600G-0606-558.91GB> bytes/sector    =  512 sectors = 1172123567 accessible sectors = 1172123534 Part  Tag Flag     First Sector      Size      Last Sector   0    usr    wm           256   558.90GB       1172107150   1 unassigned wm             0        0            0   2 unassigned wm             0        0            0   3 unassigned wm             0        0            0   4 unassigned wm             0        0            0   5 unassigned wm             0        0            0   6 unassigned wm             0        0            0   8   reserved    wm    1172107151     8.00MB       1172123534   format> q root@poc:/export/home/guds# format Searching for disks...done
5.Format	4.1.Label: Format lại ổ đĩa mới hoặc ổ đĩa cũ   EFI Label (>=1TB chỉ định dạng như sau) SMI Label (<1TB) root@dbaviet # format -e  --> Chọn đĩa  8 chang han   /dev/rdsk/c6t60060E801663D800000163D800000034d0s2 selecting /dev/rdsk/c6t60060E801663D800000163D800000034d0s2: Billu07   format> la [0] SMI Label [1] EFI Label Specify Label type[0]: 1 --> y   format> pa   partition> pr Volume:  GGATE Current partition table (original): Total disk sectors available: 3113834871 + 16384 (reserved sectors)   Part  Tag    Flag First Sector      Size      Last Sector   0        usr wm            34    20.00GB       41943073   1        usr wu      41943074     1.43TB       3113834870   2 unassigned wm             0        0            0   3 unassigned wm             0        0            0   4 unassigned wm             0        0            0   5 unassigned wm             0        0            0   6 unassigned wm             0        0            0   7 unassigned wm             0        0            0   8   reserved wm    3113834871     8.00MB       3113851254 (Lãng phí 20G -->Nếu add vào ASM partition lại bỏ 33 sector đầu tiên, sử dụng từ sector 34) Thực hiện bước Partition bên dưới root@dbaviet # format -e /dev/rdsk/c6t60060E801663D800000163D800000034d0s2 selecting /dev/rdsk/c6t60060E801663D800000163D800000034d0s2: Billu07   format> la [0] SMI Label [1] EFI Label Specify Label type[0]: 0 -> y   format> pa   partition> pr   -- Theo cylinder: s6 Volume:  data1 (FastPay) Current partition table (original): Total disk cylinders available: 57598 + 2 (reserved cylinders)   Part  Tag    Flag Cylinders     Size        Blocks   0       root wm   0 - 7      128.00MB (8/0/0)     262144   1       swap wu   8 - 15      128.00MB (8/0/0)     262144   2     backup wu   0 - 57597  899.97GB (57598/0/0) 1887371264   3 unassigned wm       0            0     (0/0/0)          0   4 unassigned wm       0            0     (0/0/0)          0   5 unassigned wm       0            0     (0/0/0)          0   6        usr wm  16 - 57597  899.72GB (57582/0/0) 1886846976   7 unassigned wm       0            0     (0/0/0)          0   Partition: Thực hiện trên 1 node --ASM: Bỏ 33 sector đầu tiên, sử dụng từ sector 34 partition> 0 Part  Tag    Flag First Sector      Size      Last Sector   0        usr wm            34    20.00GB       41943073   Enter partition id tag[usr]: Enter partition permission flags[wm]: Enter new starting Sector[34]: Enter partition size[41943040b, 41943073e, 20480mb, 20gb, 0tb]: $   partition> 1 Part  Tag    Flag First Sector      Size      Last Sector   1        usr wu      41943074     1.43TB       3113834870   Enter partition id tag[usr]: Enter partition permission flags[wu]: Enter new starting Sector[41943074]: Enter partition size[3071891797b, 3113834870e, 1499947mb, 1464gb, 1tb]: 0   partition> p Volume:  mcdata4 Current partition table (unnamed): Total disk sectors available: 3113834871 + 16384 (reserved sectors)   partition> q format> type --> Chọn 0. Auto configure   Format> p Partition> p   Part  Tag    Flag First Sector      Size      Last Sector   0        usr wm            34     1.45TB       3113834870   1 unassigned wu             0        0            0   2 unassigned wm             0        0            0   3 unassigned wm             0        0            0   4 unassigned wm             0        0            0   5 unassigned wm             0        0            0   6 unassigned wm             0        0            0   8   reserved wm    3113834871     8.00MB       3113851254   Có thể phát sinh khi quit ra ngoài thì bị mất thông tin vừa cấu hình thì phải thực hiện cách 2 (modify partition)   m --> chia partition --> label   (m: Chon tiep partition> m Select partitioning base:      0. Current partition table (original)      1. All Free Hog Choose base (enter number) [0]?  --> Enter   Do you wish to continue creating a new partition table based on above table[yes]? --> Enter Free Hog partition[6]? --> Enter Enter size of partition 0 [0b, 33e, 0mb, 0gb, 0tb]: 0 Enter size of partition 1 [0b, 33e, 0mb, 0gb, 0tb]: 0 Enter size of partition 2 [0b, 33e, 0mb, 0gb, 0tb]: 0 Enter size of partition 3 [0b, 33e, 0mb, 0gb, 0tb]: 0 Enter size of partition 4 [0b, 33e, 0mb, 0gb, 0tb]: 0 Enter size of partition 5 [0b, 33e, 0mb, 0gb, 0tb]: 0 Enter size of partition 6 [0b, 33e, 0mb, 0gb, 0tb]: $ Enter size of partition 7 [0b, 33e, 0mb, 0gb, 0tb]: 0   partition> p Volume:  mcdata4 Current partition table (original): Total disk sectors available: 3113834871 + 16384 (reserved sectors)   Part  Tag    Flag First Sector      Size      Last Sector   0 unassigned wm             0        0            0   1 unassigned wm             0        0            0   2 unassigned wm             0        0            0   3 unassigned wm             0        0            0   4 unassigned wm             0        0            0   5 unassigned wm             0        0            0   6        usr wm            34     1.45TB       3113834870   8   reserved wm    3113834871     8.00MB       3113851254       --QFS: Dùng 50GB đầu tiên cho thông tin của QFS, 8MB cuối cho metadata partition> 0 Part  Tag    Flag First Sector      Size      Last Sector   0        usr wm            34     1.76TB       3774857182   Enter partition id tag[usr]: Enter partition permission flags[wm]: Enter new starting Sector[34]: Enter partition size[3774857149b, 3774857182e, 1843191mb, 1799gb, 1tb]: 50gb   partition> 1 Part  Tag    Flag First Sector      Size      Last Sector   1 unassigned wm             0        0            0   Enter partition id tag[usr]: Enter partition permission flags[wm]: Enter new starting Sector[104857634]:  Enter partition size[0b, 104857633e, 0mb, 0gb, 0tb]: $   partition> p Current partition table (unnamed): Total disk sectors available: 3774857182 + 16384 (reserved sectors)     Part  Tag    Flag First Sector      Size      Last Sector   0        usr wm            34    50.00GB       104857633   1        usr wm     104857634     1.71TB       3774857181   2 unassigned wm             0        0            0   3 unassigned wm             0        0            0   4 unassigned wm             0        0            0   5 unassigned wm             0        0            0   6 unassigned wm             0        0            0   7 unassigned wm             0        0            0   8   reserved wm    3774857183     8.00MB       3774873566   -- ZFS, UFS: Dùng hết trừ 8MB cuối cho metadata partition> 0 Part  Tag    Flag First Sector      Size      Last Sector   0        usr wm            34     1.76TB       3774857182   Enter partition id tag[usr]: Enter partition permission flags[wm]: Enter new starting Sector[34]: Enter partition size[3774857149b, 3774857182e, 1843191mb, 1799gb, 1tb]: $   Volume:  bg2gprs Current partition table (original): Total disk sectors available: 1887420382 + 16384 (reserved sectors)   Part  Tag    Flag First Sector      Size      Last Sector   0        usr wm           256   899.99GB       1887420382   1 unassigned wm             0        0            0   2 unassigned wm             0        0            0   3 unassigned wm             0        0            0   4 unassigned wm             0        0            0   5 unassigned wm             0        0            0   6 unassigned wm             0        0            0   8   reserved wm    1887420383     8.00MB       1887436766   -- Đánh nhãn lại sau khi format format>volname   Cách 2: Partition modify (chưa test) Format —>select disk -->type --> 0. Auto configure   Format —select disk —> p --> p --> m --> chia partition --> label   (m: Chon tiep partition> m Select partitioning base:      0. Current partition table (original)      1. All Free Hog Choose base (enter number) [0]?  --> Next --> Partition 0: 20.00gb --> Partition 1: $  --> Next (5 lan) --> label (Y) ) -- Partition nao chua OK thi format lai: Chon so partition 6 (chang han) --> size 0   -- Sau kh partition xong đảm bảo: format --> Chọn đĩa (6) --> p --> p
6.Mount	Theo các loại file system
7.Umount	umount /dev/dsk/c0t2d0s7   umount: /dev/dsk/c0t2d0s7: device is busy    # fuser -u /dev/dsk/c0t2d0s7   /dev/dsk/c0t2d0s7: 1313co(oracle) 1223c(root)   # fuser -k /dev/dsk/c0t2d0s7   /dev/dsk/c0t2d0s7: 1313co    1223c   From <http://www.idevelopment.info/data/Unix/General_UNIX/GENERAL_Troubleshootingthedeviceisbusy.shtml>
8.Xác định tiến trình đang sử dụng SAN	fuser
9.Giả lập tải IO
	Read: dd if=/dev/rdsk/c7t60060E80056F530000006F5300000560d0s0 of=/dev/null bs=1024k count=1000000 iostat -xncpzM 3 iostat -xnd 3
	Write: dd if=/dev/zero of=/dev/rdsk/c7t60060E80056F530000006F5300000560d0s0 bs=1024kb count=1024*100 & Iostat -xnd 5
10.Troubleshooting IO	# uname -a # pagesize # echo ::memstat | mdb -k # df -h # echo | format # zpool list # zfs list # zpool iostat 5 10 # vmstat 5 10 # vmstat -s # sar -rbc 5 10 # sar -d 5 10
Monitoring	iostat -xncpzM 3
	May 27 03:11:03 dbaviet scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e801036abe0057daeee000001f8 (ssd32): --> Phân vùng 01f8 (s05) May 27 03:11:03 dbaviet   Error for Command: write(10)           Error Level: Retryable May 27 03:11:03 dbaviet scsi: [ID 107833 kern.notice]     Requested Block: 2038930082            Error Block: 2038930082 May 27 03:11:03 dbaviet scsi: [ID 107833 kern.notice]     Vendor: HITACHI                        Serial Number: 9212286201F8 May 27 03:11:03 dbaviet scsi: [ID 107833 kern.notice]     Sense Key: Aborted_Command May 27 03:11:03 dbaviet scsi: [ID 107833 kern.notice]     ASC: 0x4b (data phase error), ASCQ: 0x0, FRU: 0x0 --> Bị lỗi block, nếu liên tục thì thường DB có vấn đề, còn thi thoảng gặp cảnh báo thì không sao do SAN đã sử dụng > 95% nên có thể sẽ phát sinh
	May 27 11:52:38 dbaviet       /scsi_vhci/ssd@g60060e801663d800000163d800000304 (ssd20): Command failed to complete (3) on path fp0/ssd@w50060e801663d822,4 --> đường đi qua cổng 50060e801663d822 của SAN Director   May 27 11:52:38 dbaviet scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e801663d800000163d800000304 (ssd20): May 27 11:52:38 dbaviet   SCSI transport failed: reason 'tran_err': retrying command May 27 11:52:38 dbaviet scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0): May 27 11:52:38 dbaviet       /scsi_vhci/ssd@g60060e801663d800000163d800000305 (ssd19): Command failed to complete (3) on path fp0/ssd@w50060e801663d822,5 May 27 11:55:58 dbaviet scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0): May 27 11:55:58 dbaviet       /scsi_vhci/ssd@g60060e801663d800000163d800000303 (ssd21): Command failed to complete (3) on path fp0/ssd@w50060e801663d822,3 May 27 11:55:58 dbaviet scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e801663d800000163d800000303 (ssd21): May 27 11:55:58 dbaviet   SCSI transport failed: reason 'tran_err': retrying command May 27 11:55:58 dbaviet scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0): May 27 11:55:58 dbaviet       /scsi_vhci/ssd@g60060e801663d800000163d800000305 (ssd19): Command failed to complete (3) on path fp0/ssd@w50060e801663d822,5 May 27 11:55:58 dbaviet scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0): May 27 11:55:58 dbaviet       /scsi_vhci/ssd@g60060e801663d800000163d800000304 (ssd20): Command failed to complete (3) on path fp0/ssd@w50060e801663d822,4 May 27 11:58:54 dbaviet scsi: [ID 243001 kern.warning] WARNING: /scsi_vhci (scsi_vhci0): May 27 11:58:54 dbaviet       /scsi_vhci/ssd@g60060e801663d800000163d800000304 (ssd20): Command Timeout on path fp0/ssd@w50060e801663d822,4 May 27 12:02:18 dbaviet scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0): May 27 12:02:18 dbaviet       /scsi_vhci/ssd@g60060e801663d800000163d800000303 (ssd21): Command failed to complete (3) on path fp0/ssd@w50060e801663d822,3 May 27 12:02:18 dbaviet scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0): May 27 12:02:18 dbaviet       /scsi_vhci/ssd@g60060e801663d800000163d800000304 (ssd20): Command failed to complete (3) on path fp0/ssd@w50060e801663d822,4 May 27 12:02:18 dbaviet scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e801663d800000163d800000304 (ssd20): May 27 12:02:18 dbaviet   SCSI transport failed: reason 'tran_err': retrying command May 27 12:04:42 dbaviet scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0): May 27 12:04:42 dbaviet       /scsi_vhci/ssd@g60060e801663d800000163d800000304 (ssd20): Command failed to complete (3) on path fp0/ssd@w50060e801663d822,4 May 27 12:04:42 dbaviet scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0): May 27 12:04:42 dbaviet       /scsi_vhci/ssd@g60060e801663d800000163d800000303 (ssd21): Command failed to complete (3) on path fp0/ssd@w50060e801663d822,3 May 27 12:04:42 dbaviet scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0): May 27 12:04:42 dbaviet       /scsi_vhci/ssd@g60060e801663d800000163d800000305 (ssd19): Command failed to complete (3) on path fp0/ssd@w50060e801663d822,5 May 27 12:06:05 dbaviet scsi: [ID 243001 kern.warning] WARNING: /scsi_vhci (scsi_vhci0): May 27 12:06:05 dbaviet       /scsi_vhci/ssd@g60060e801663d800000163d800000304 (ssd20): Command Timeout on path fp0/ssd@w50060e801663d822,4 May 27 12:06:05 dbaviet scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e801663d800000163d800000304 (ssd20): May 27 12:06:05 dbaviet   SCSI transport failed: reason 'timeout': retrying command May 27 12:07:13 dbaviet scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e801036abe0057daeee000001f8 (ssd32): May 27 12:07:13 dbaviet   Error for Command: write(10)           Error Level: Retryable May 27 12:07:13 dbaviet scsi: [ID 107833 kern.notice]     Requested Block: 112772434             Error Block: 112772434 May 27 12:07:13 dbaviet scsi: [ID 107833 kern.notice]     Vendor: HITACHI                        Serial Number: 9212286201F8 May 27 12:07:13 dbaviet scsi: [ID 107833 kern.notice]     Sense Key: Aborted_Command May 27 12:07:13 dbaviet scsi: [ID 107833 kern.notice]     ASC: 0x4b (data phase error), ASCQ: 0x0, FRU: 0x0 May 27 12:09:23 dbaviet scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0): May 27 12:09:23 dbaviet       /scsi_vhci/ssd@g60060e801663d800000163d800000304 (ssd20): Command failed to complete (3) on path fp0/ssd@w50060e801663d822,4 May 27 12:09:23 dbaviet scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e801663d800000163d800000304 (ssd20): May 27 12:09:23 dbaviet   SCSI transport failed: reason 'tran_err': retrying command May 27 12:09:23 dbaviet scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0): May 27 12:09:23 dbaviet       /scsi_vhci/ssd@g60060e801663d800000163d800000303 (ssd21): Command failed to complete (3) on path fp0/ssd@w50060e801663d822,3 May 27 12:15:29 dbaviet scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0): May 27 12:15:29 dbaviet       /scsi_vhci/ssd@g60060e801663d800000163d800000304 (ssd20): Command failed to complete (3) on path fp0/ssd@w50060e801663d822,4 May 27 12:15:29 dbaviet scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0): May 27 12:15:29 dbaviet       /scsi_vhci/ssd@g60060e801663d800000163d800000305 (ssd19): Command failed to complete (3) on path fp0/ssd@w50060e801663d822,5   --> Phân vùng 0305 đi qau cổng trên SAN Director 50060e801663d822 bị fail, nếu nhiều là có vấn đề, UD timeout (trường device Address trong luxadm display <path>) grep "Command failed to complete"  messages  |more
	oracle@dbaviet$ grep 10000000c963ab61 messages May 27 03:12:25 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric --> 1 port trên cạc HBA Card1 (fcinfo hba-port) May 27 03:12:26 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 27 03:23:27 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 27 03:23:29 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 27 06:32:55 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 27 07:09:07 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 27 07:26:40 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 27 07:42:58 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 27 08:26:51 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 27 08:39:34 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 28 03:52:01 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 28 03:52:03 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 28 05:02:20 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 28 05:02:22 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 29 03:07:34 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 29 03:07:35 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 29 04:28:01 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 29 04:28:02 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 29 17:10:44 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 29 17:10:46 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 30 01:11:49 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 reappeared in fabric May 30 01:46:26 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 30 01:46:28 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 30 04:15:11 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 30 04:15:13 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 30 04:53:13 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 30 04:53:14 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 30 21:18:09 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 30 21:18:11 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 30 21:20:02 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 reappeared in fabric May 30 21:25:00 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 30 21:25:02 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 30 23:10:50 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 31 00:29:22 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 31 00:29:48 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 31 01:02:29 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 31 01:03:04 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 31 01:30:49 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 31 01:30:50 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 31 02:18:23 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 31 02:18:24 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 31 02:48:44 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 31 02:48:45 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 reappeared in fabric May 31 02:50:46 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 31 03:20:48 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 31 03:20:49 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 31 05:22:06 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 31 05:22:08 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 reappeared in fabric May 31 08:06:34 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 31 08:14:52 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric May 31 08:14:54 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric Jun  1 03:12:00 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric Jun  1 03:12:26 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric -->

 

*****

- Server DBAViet iện tại băng thông sẽ đạt 250MB/s theo lý thuyết, do các card HBA đang kết nối đên Bus B Controller1. Nên tốc độc restore trên mobicard đặt tốc độ 150Mb ( write vsp) + 30MB ( read sata) là gần đúng lý     thuyết. Ngoài ra việc đọc trên phân vùng SATA chậm cũng ảnh hưởng đến việc write trên VSP nên kết quả report bởi lệnh iostat là bình thường.

- Kiểm tra hoạt động trên VSP thời điểm mobicard restore, các chỉ số performance đều ở mức bình thường của storage: cache write pending 5%, disk busy 20%, iops 300.

- Để đạt được băng thông cao hơn cần chuyển một card HBA qua Slot5 hoặc slot1 của server. Khi chuyển qua các slot1 ( Bus B, controller ) sẻ ảnh hưởng đến băng thông đường mạng, khi chuyển qua slot5 sẻ ảnh hưởng đến truy nhập ổ cứng internal. Nên để tăng băng thông có thể chọn option lắp vào slot5 ( Bus A) để tăng băng thông đến storage.

 

Các thông tin tham khảo:

- Vị trí các slot đã sử dụng trên e2900

 

- Tốc độ các Bus system trong hệ thống:

 

Link: http://docs.oracle.com/cd/E19095-01/sfe2900.srvr/817-5233-10/troubleshooting.html

=============================
* KHOÁ HỌC ORACLE DATABASE A-Z ENTERPRISE trực tiếp từ tôi giúp bạn bước đầu trở thành những chuyên gia DBA, đủ kinh nghiệm đi thi chứng chỉ OA/OCP, đặc biệt là rất nhiều kinh nghiệm, bí kíp thực chiến trên các hệ thống Core tại VN chỉ sau 1 khoá học.
* CÁCH ĐĂNG KÝ: Gõ (.) hoặc để lại số điện thoại hoặc inbox https://m.me/tranvanbinh.vn hoặc Hotline/Zalo 090.29.12.888
* Chi tiết tham khảo:
https://bit.ly/oaz_w
=============================
KẾT NỐI VỚI CHUYÊN GIA TRẦN VĂN BÌNH:
📧 Mail: binhoracle@gmail.com
☎️ Mobile: 0902912888
⚡️ Skype: tranbinh48ca
👨 Facebook: https://www.facebook.com/BinhOracleMaster
👨 Inbox Messenger: https://m.me/101036604657441 (profile)
👨 Fanpage: https://www.facebook.com/tranvanbinh.vn
👨 Inbox Fanpage: https://m.me/tranvanbinh.vn
👨👩 Group FB: https://www.facebook.com/groups/DBAVietNam
👨 Website: https://www.tranvanbinh.vn
👨 Blogger: https://tranvanbinhmaster.blogspot.com
🎬 Youtube: http://bit.ly/ytb_binhoraclemaster
👨 Tiktok: https://www.tiktok.com/@binhoraclemaster?lang=vi
👨 Linkin: https://www.linkedin.com/in/binhoracle
👨 Twitter: https://twitter.com/binhoracle
👨 Địa chỉ: Tòa nhà Sun Square - 21 Lê Đức Thọ - Phường Mỹ Đình 1 - Quận Nam Từ Liêm - TP.Hà Nội

=============================
học oracle database, Tự học Oracle, Tài liệu Oracle 12c tiếng Việt, Hướng dẫn sử dụng Oracle Database, Oracle SQL cơ bản, Oracle SQL là gì, Khóa học Oracle Hà Nội, Học chứng chỉ Oracle ở đầu, Khóa học Oracle online,khóa học pl/sql, học dba, học dba ở việt nam, khóa học dba, khóa học dba sql, tài liệu học dba oracle, Khóa học Oracle online, học oracle sql, học oracle ở đâu tphcm, học oracle bắt đầu từ đâu, học oracle ở hà nội, oracle database tutorial, oracle database 12c, oracle database là gì, oracle database 11g, oracle download, oracle database 19c, oracle dba tutorial, oracle tunning, sql tunning , oracle 12c, oracle multitenant, Container Databases (CDB), Pluggable Databases (PDB), oracle cloud, oracle security, oracle fga, audit_trail, oracle dataguard, oracle goldengate, mview, oracle exadata, oracle oca, oracle ocp, oracle ocm , oracle weblogic, middleware, hoc solaris, hoc linux, hoc aix, unix, securecrt, xshell, mobaxterm, putty