ML310G4 Centos7のインストーラでRaidコントローラが認識しない #1

IMGP1951

※写真と本文は関係ありません。

サーバ：HP ML310G4
Raidコントローラ：HP E200
※古いサーバをバックアップ用に流用しようとセットアップ

Summary
インストール直後はhpsaドライバでうまくいったけど、kernelUpdateしたらHP製のraid管理コマンドが使えなくなったので、ccissドライバでインストールし直した。セットアップ中に気づいてよかったね。

CentOS7をDL360G5にインストールメモ – tkr0429 blog
を参考に。
→ hpsaドライバにオプション付けると動くらしい。

インストール時のgrubオプションで

hpsa.hpsa_simple_mode=1 hpsa.hpsa_allow_any=1

を追記

インストール後にレスキューモードでインストールされたgrubに同様に追記する

# chroot /mnt/sysimage
# vi /etc/default/grub
# grub2-mkconfig -o /boot/grub2/grub.cfg

※yum で kernel Updateしてもgrubオプションはそのまま引き継がれる。

インストール直後
hpssacliコマンド成功

[root@localhost ~]# hpssacli controller all show
Smart Array E200 in Slot 4 

[root@localhost ~]# hpssacli controller slot=4 logicaldrive all show
Smart Array E200 in Slot 4
   array A
      logicaldrive 1 (232.9 GB, RAID 1, OK)

[root@localhost ~]# hpssacli controller slot=4 physicaldrive  all show
Smart Array E200 in Slot 4
   array A
      physicaldrive 1I:1:3 (port 1I:box 1:bay 3, SATA, 250 GB, OK)
      physicaldrive 1I:1:4 (port 1I:box 1:bay 4, SATA, 250 GB, OK)

インストール直後のkernel

[root@localhost ~]# uname -a
Linux localhost.localdomain 3.10.0-327.el7.x86_64 #1 SMP Thu Nov 19 22:10:57 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux

dmesgの様子 → 問題なさそう

[root@localhost ~]# dmesg |grep hpsa
[    0.000000] Command line: BOOT_IMAGE=/vmlinuz-3.10.0-327.el7.x86_64 root=/dev/mapper/centos-root ro crashkernel=auto rd.lvm.lv=centos/root rd.lvm.lv=centos/swap rhgb quiet hpsa.hpsa_simple_mode=1 hpsa.hpsa_allow_any=1
[    0.000000] Kernel command line: BOOT_IMAGE=/vmlinuz-3.10.0-327.el7.x86_64 root=/dev/mapper/centos-root ro crashkernel=auto rd.lvm.lv=centos/root rd.lvm.lv=centos/swap rhgb quiet hpsa.hpsa_simple_mode=1 hpsa.hpsa_allow_any=1
[    1.341105] TECH PREVIEW: hpsa: this controller (0x3212) may not be fully supported.
[    1.341124] TECH PREVIEW: hpsa: this controller (0x3212) may not be fully supported.
[    1.341294] hpsa 0000:03:08.0: MSI capable controller
[    1.341333] hpsa 0000:03:08.0: irq 28 for MSI/MSI-X
[    1.341383] hpsa 0000:03:08.0: Physical aborts not supported
[    1.341389] hpsa 0000:03:08.0: Logical aborts not supported
[    1.341392] hpsa 0000:03:08.0: HP SSD Smart Path aborts not supported
[    1.376372] scsi host0: hpsa
[    1.443338] hpsa 0000:03:08.0: scsi 0:0:0:0: added Direct-Access     HP       LOGICAL VOLUME   RAID-1(+0) SSDSmartPathCap- En- Exp=3
[    1.443345] hpsa 0000:03:08.0: scsi 0:3:0:0: added RAID              HP       E200             RAID-UNKNOWN SSDSmartPathCap- En- Exp=3

読み込んでるモジュール

[root@localhost ~]# lsmod |grep hpsa
hpsa                   90197  2 

[root@localhost ~]# lsmod |grep sg
sg                     40721  0 

[root@localhost ~]# modinfo hpsa
filename:       /lib/modules/3.10.0-327.el7.x86_64/kernel/drivers/scsi/hpsa.ko
license:        GPL
version:        3.4.10-0-RH1
description:    Driver for HP Smart Array Controller version 3.4.10-0-RH1
author:         Hewlett-Packard Company
rhelversion:    7.2
srcversion:     C6C5536A08D5A5511E57F47
depends:        
intree:         Y
vermagic:       3.10.0-327.el7.x86_64 SMP mod_unload modversions 
signer:         CentOS Linux kernel signing key
sig_key:        79:AD:88:6A:11:3C:A0:22:35:26:33:6C:0F:82:5B:8A:94:29:6A:B3
sig_hashalgo:   sha256
parm:           hpsa_allow_any:Allow hpsa driver to access unknown HP Smart Array hardware (int)
parm:           hpsa_simple_mode:Use 'simple mode' rather than 'performant mode' (int)

[root@localhost ~]# modinfo sg
filename:       /lib/modules/3.10.0-327.el7.x86_64/kernel/drivers/scsi/sg.ko
alias:          char-major-21-*
version:        3.5.36
license:        GPL
description:    SCSI generic (sg) driver
author:         Douglas Gilbert
rhelversion:    7.2
srcversion:     759875EB812408E6B48E598
depends:        
intree:         Y
vermagic:       3.10.0-327.el7.x86_64 SMP mod_unload modversions 
signer:         CentOS Linux kernel signing key
sig_key:        79:AD:88:6A:11:3C:A0:22:35:26:33:6C:0F:82:5B:8A:94:29:6A:B3
sig_hashalgo:   sha256
parm:           scatter_elem_sz:scatter gather element size (default: max(SG_SCATTER_SZ, PAGE_SIZE)) (int)
parm:           def_reserved_size:size of buffer reserved for each fd (int)
parm:           allow_dio:allow direct I/O (default: 0 (disallow)) (int)

yum update 後ダメになる → kernel戻すと問題ないのでkernelUpdateが原因だと思う

[root@localhost ~]# hpssacli controller all show

Error: No controllers detected. Possible causes:
       	- The driver for the installed controller(s) is not loaded.
       	- On LINUX, the scsi_generic (sg) driver module is not loaded.
       	See the README file for more details.

scsi_generic (sg) driver をloadせよって言われるけどloadされてる

[root@localhost ~]# lsmod |grep sg
sg                     40721  0 

[root@localhost ~]# lsmod |grep hpsa
hpsa                   99212  2 
scsi_transport_sas     41224  1 hpsa # これが増えてる

新kernel

[root@localhost ~]# uname -a
Linux localhost.localdomain 3.10.0-514.2.2.el7.x86_64 #1 SMP Tue Dec 6 23:06:41 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux

モジュールの様子

[root@localhost ~]# modinfo hpsa
filename:       /lib/modules/3.10.0-514.2.2.el7.x86_64/kernel/drivers/scsi/hpsa.ko
license:        GPL
version:        3.4.14-0-RH1
description:    Driver for HP Smart Array Controller version 3.4.14-0-RH1
author:         Hewlett-Packard Company
rhelversion:    7.3
srcversion:     927254528BE993F86394D5B
depends:        scsi_transport_sas
intree:         Y
vermagic:       3.10.0-514.2.2.el7.x86_64 SMP mod_unload modversions 
signer:         CentOS Linux kernel signing key
sig_key:        54:CE:18:D5:47:AB:70:33:F7:FE:23:16:22:13:74:77:98:1A:31:81
sig_hashalgo:   sha256
parm:           hpsa_allow_any:Allow hpsa driver to access unknown HP Smart Array hardware (int)
parm:           hpsa_simple_mode:Use 'simple mode' rather than 'performant mode' (int)

[root@localhost ~]# modinfo sg
filename:       /lib/modules/3.10.0-514.2.2.el7.x86_64/kernel/drivers/scsi/sg.ko
alias:          char-major-21-*
version:        3.5.36
license:        GPL
description:    SCSI generic (sg) driver
author:         Douglas Gilbert
rhelversion:    7.3
srcversion:     A41F7696E3AB081A2F088FA
depends:        
intree:         Y
vermagic:       3.10.0-514.2.2.el7.x86_64 SMP mod_unload modversions 
signer:         CentOS Linux kernel signing key
sig_key:        54:CE:18:D5:47:AB:70:33:F7:FE:23:16:22:13:74:77:98:1A:31:81
sig_hashalgo:   sha256
parm:           scatter_elem_sz:scatter gather element size (default: max(SG_SCATTER_SZ, PAGE_SIZE)) (int)
parm:           def_reserved_size:size of buffer reserved for each fd (int)
parm:           allow_dio:allow direct I/O (default: 0 (disallow)) (int)

[root@localhost ~]# modinfo scsi_transport_sas
filename:       /lib/modules/3.10.0-514.2.2.el7.x86_64/kernel/drivers/scsi/scsi_transport_sas.ko
license:        GPL
description:    SAS Transport Attributes
author:         Christoph Hellwig
rhelversion:    7.3
srcversion:     FECED383F23470E722B4D39
depends:        
intree:         Y
vermagic:       3.10.0-514.2.2.el7.x86_64 SMP mod_unload modversions 
signer:         CentOS Linux kernel signing key
sig_key:        54:CE:18:D5:47:AB:70:33:F7:FE:23:16:22:13:74:77:98:1A:31:81
sig_hashalgo:   sha256

scsi_transport_sas は新カーネルから追加されてる

[root@localhost ~]# rpm -qf /lib/modules/3.10.0-514.2.2.el7.x86_64/kernel/drivers/scsi/scsi_transport_sas.ko
kernel-3.10.0-514.2.2.el7.x86_64

新kernelのdmesg → エラーがある

[root@localhost ~]# dmesg |grep hpsa
[    0.000000] Command line: BOOT_IMAGE=/vmlinuz-3.10.0-514.2.2.el7.x86_64 root=/dev/mapper/centos-root ro crashkernel=auto rd.lvm.lv=centos/root rd.lvm.lv=centos/swap rhgb quiet hpsa.hpsa_simple_mode=1 hpsa.hpsa_allow_any=1 LANG=ja_JP.UTF-8
[    0.000000] Kernel command line: BOOT_IMAGE=/vmlinuz-3.10.0-514.2.2.el7.x86_64 root=/dev/mapper/centos-root ro crashkernel=auto rd.lvm.lv=centos/root rd.lvm.lv=centos/swap rhgb quiet hpsa.hpsa_simple_mode=1 hpsa.hpsa_allow_any=1 LANG=ja_JP.UTF-8
[    1.256447] TECH PREVIEW: hpsa: this controller (0x3212) may not be fully supported.
[    1.256463] TECH PREVIEW: hpsa: this controller (0x3212) may not be fully supported.
[    1.256588] hpsa 0000:03:08.0: MSI capable controller
[    1.256623] hpsa 0000:03:08.0: irq 28 for MSI/MSI-X
[    1.256665] hpsa 0000:03:08.0: Physical aborts not supported
[    1.256668] hpsa 0000:03:08.0: Logical aborts not supported
[    1.256671] hpsa 0000:03:08.0: HP SSD Smart Path aborts not supported
[    1.315446] scsi host1: hpsa
[    1.385371] hpsa 0000:03:08.0: scsi 1:0:0:0: masked Direct-Access     ATA      ST3250620NS      PHYS DRV SSDSmartPathCap- En- Exp=0
[    1.385379] hpsa 0000:03:08.0: scsi 1:0:1:0: masked Direct-Access     ATA      ST3250620NS      PHYS DRV SSDSmartPathCap- En- Exp=0
[    1.385384] hpsa 0000:03:08.0: scsi 1:1:0:0: added Direct-Access     HP       LOGICAL VOLUME   RAID-1(+0) SSDSmartPathCap- En- Exp=1
[    1.385388] hpsa 0000:03:08.0: scsi 1:0:0:0: added RAID              HP       E200             controller SSDSmartPathCap- En- Exp=1
[    1.399183] hpsa 0000:03:08.0: addition failed -19, device not added.
[   31.392078] hpsa 0000:03:08.0: scsi 1:0:0:0: added RAID              HP       E200             controller SSDSmartPathCap- En- Exp=1
[   31.392240] hpsa 0000:03:08.0: addition failed -19, device not added.
[   61.472031] hpsa 0000:03:08.0: scsi 1:0:0:0: added RAID              HP       E200             controller SSDSmartPathCap- En- Exp=1
[   61.472171] hpsa 0000:03:08.0: addition failed -19, device not added.
[   91.551965] hpsa 0000:03:08.0: scsi 1:0:0:0: added RAID              HP       E200             controller SSDSmartPathCap- En- Exp=1
[   91.552126] hpsa 0000:03:08.0: addition failed -19, device not added.

ダメなのでccissドライバを使用することにする → 続く