Difference between revisions of "Devices and storage"
From Alessandro's Wiki
(Reverted edits by Ypebezimyx (Talk) to last version by 127.0.0.1) |
Porcelinux (talk | contribs) |
||
(11 intermediate revisions by 2 users not shown) | |||
Line 1: | Line 1: | ||
== devices in Linux== | |||
=== dmidecode === | |||
* gives you a lot of information about bus and bios | |||
=== I/O analisys === | |||
* vmstat | |||
* iostat | |||
* vopstat | |||
* sysstat (package) | |||
* iotop | |||
** kernel "unusual" options needed | |||
** CONFIG_TASK_IO_ACCOUNTING: is not set when it should be. | |||
** CONFIG_TASK_DELAY_ACCT: is not set when it should be. | |||
** CONFIG_TASKSTATS: is not set when it should be. | |||
=== udev === | |||
* udev manages the /dev filesystem interacting with the kernel and its modules | |||
* | * disk conncted through udev | ||
ls -lR /dev/disk | ls -lR /dev/disk | ||
* | * udev information dump | ||
udevinfo -a -p /sys/block/sdb/ | udevinfo -a -p /sys/block/sdb/ | ||
== | === lshal === | ||
* commang to list the whole Hardware Abstraction Layer | |||
<pre> | |||
Processor DRAM Controller' (string) | |||
pci.product_id = 64 (0x40) (int) | |||
pci.subsys_product_id = 64 (0x40) (int) | |||
pci.subsys_vendor = 'Intel Corporation' (string) | |||
pci.subsys_vendor_id = 32902 (0x8086) (int) | |||
pci.vendor = 'Intel Corporation' (string) | |||
pci.vendor_id = 32902 (0x8086) (int) | |||
Dumped 165 device(s) from the Global Device List. | |||
</pre> | |||
=== hdparm === | === hdparm === | ||
* sets and gets information from a block device | |||
# hdparm -I /dev/hda | |||
/dev/hda: | /dev/hda: | ||
Line 69: | Line 104: | ||
CBLID- above Vih | CBLID- above Vih | ||
Device num = 0 determined by the jumper | Device num = 0 determined by the jumper | ||
Checksum: correct | Checksum: correct | ||
=== | === Hard disk naming === | ||
* behind the hard disks naming, as WD3200JD, there's lot of info about the device: | |||
http://forums.storagereview.net/index.php?showtopic=22131 | http://forums.storagereview.net/index.php?showtopic=22131 | ||
Sample: WD3200JD-00KLB0 | Sample: WD3200JD-00KLB0 | ||
Line 100: | Line 137: | ||
i = Firmware version (probably): | i = Firmware version (probably): | ||
* 0/1/2=larger is newer (if the preceeding letter is same). | * 0/1/2=larger is newer (if the preceeding letter is same). | ||
=== Disktype === | === Disktype === | ||
disktype /dev/sda | disktype /dev/sda | ||
Line 122: | Line 160: | ||
/dev/sda: WDC WD3200KS-00PFB0: 42 C or F | /dev/sda: WDC WD3200KS-00PFB0: 42 C or F | ||
==== | ==== extend hddtemp database ==== | ||
* file '''/usr/share/hddtemp/hddtemp.db''' | |||
"ST3320620AS" 194 C "Seagate ST3320620AS" | "ST3320620AS" 194 C "Seagate ST3320620AS" | ||
"WDC WD3200KS-00PFB0" 194 C "Western Digital WD3200KS-00PFB0" | "WDC WD3200KS-00PFB0" 194 C "Western Digital WD3200KS-00PFB0" | ||
Line 133: | Line 170: | ||
/dev/sdc: WDC WD3200KS-00PFB0: 41 C | /dev/sdc: WDC WD3200KS-00PFB0: 41 C | ||
/dev/sdd: ST3750330AS: 41 C | /dev/sdd: ST3750330AS: 41 C | ||
=== NCQ === | |||
* http://en.wikipedia.org/wiki/Native_Command_Queuing | |||
== megarais_sas == | |||
* controller SAS interno: | |||
http://www.lsi.com/storage_home/products_home/internal_raid/megaraid_sas/entry_line/megaraid_sas_9240-8i/index.html#Miscellaneous | |||
rpm -Uvh MegaCli-8.00.29-1.i386.rpm --nodeps | |||
rpm -Uvh Lib_Utils-1.00-08.noarch.rpm --nodeps | |||
* come usarlo: | |||
http://hwraid.le-vert.net/wiki/LSIMegaRAIDSAS | |||
http://hwraid.le-vert.net/wiki/LSIMegaRAID | |||
http://tools.rapidsoft.de/perc/perc-cheat-sheet.html | |||
/opt/MegaRAID/MegaCli/MegaCli -PdInfo -PhysDrv \[\?:1\] -aAll | |||
* current virtual disk: | |||
<pre> | |||
femmes:~/megaraid# /opt/MegaRAID/MegaCli/MegaCli -LDInfo -LALL -aALL | |||
Adapter 0 -- Virtual Drive Information: | |||
Virtual Drive: 0 (Target Id: 0) | |||
Name :Virtual Disk 0 | |||
RAID Level : Primary-1, Secondary-0, RAID Level Qualifier-0 | |||
Size : 136.125 GB | |||
State : Optimal | |||
Strip Size : 64 KB | |||
Number Of Drives : 2 | |||
Span Depth : 1 | |||
Default Cache Policy: WriteBack, ReadAheadNone, Direct, No Write Cache if Bad BBU | |||
Current Cache Policy: WriteBack, ReadAheadNone, Direct, No Write Cache if Bad BBU | |||
Access Policy : Read/Write | |||
Disk Cache Policy : Disk's Default | |||
Encryption Type : None | |||
</pre> | |||
*; physical disks: | |||
<pre> | |||
:~/megaraid# /opt/MegaRAID/MegaCli/MegaCli -PDList a0 | |||
Adapter #0 | |||
Enclosure Device ID: 32 | |||
Slot Number: 0 | |||
Device Id: 0 | |||
Sequence Number: 2 | |||
Media Error Count: 0 | |||
Other Error Count: 0 | |||
Predictive Failure Count: 0 | |||
Last Predictive Failure Event Seq Number: 0 | |||
PD Type: SAS | |||
Raw Size: 136.732 GB [0x11177328 Sectors] | |||
Non Coerced Size: 136.232 GB [0x11077328 Sectors] | |||
Coerced Size: 136.125 GB [0x11040000 Sectors] | |||
Firmware state: Online, Spun Up | |||
SAS Address(0): 0x5000cca00d047fd5 | |||
SAS Address(1): 0x0 | |||
Connected Port Number: 0(path0) | |||
Inquiry Data: HITACHI HUS153014VLS300 A4C2JFV2GPZC | |||
FDE Capable: Not Capable | |||
FDE Enable: Disable | |||
Secured: Unsecured | |||
Locked: Unlocked | |||
Needs EKM Attention: No | |||
Foreign State: None | |||
Device Speed: Unknown | |||
Link Speed: Unknown | |||
Media Type: Hard Disk Device | |||
Enclosure Device ID: 32 | |||
Slot Number: 1 | |||
Device Id: 1 | |||
Sequence Number: 2 | |||
Media Error Count: 0 | |||
Other Error Count: 0 | |||
Predictive Failure Count: 0 | |||
Last Predictive Failure Event Seq Number: 0 | |||
PD Type: SAS | |||
Raw Size: 136.732 GB [0x11177328 Sectors] | |||
Non Coerced Size: 136.232 GB [0x11077328 Sectors] | |||
Coerced Size: 136.125 GB [0x11040000 Sectors] | |||
Firmware state: Online, Spun Up | |||
SAS Address(0): 0x5000cca00d04908d | |||
SAS Address(1): 0x0 | |||
Connected Port Number: 1(path0) | |||
Inquiry Data: HITACHI HUS153014VLS300 A4C2JFV2HUHC | |||
FDE Capable: Not Capable | |||
FDE Enable: Disable | |||
Secured: Unsecured | |||
Locked: Unlocked | |||
Needs EKM Attention: No | |||
Foreign State: None | |||
Device Speed: Unknown | |||
Link Speed: Unknown | |||
Media Type: Hard Disk Device | |||
</pre> | |||
*; battery status: | |||
<pre> | |||
/opt/MegaRAID/MegaCli/MegaCli -AdpBbuCmd -aALL | |||
BBU status for Adapter: 0 | |||
BatteryType: BBU | |||
Voltage: 4040 mV | |||
Current: 0 mA | |||
Temperature: 25 C | |||
[...] | |||
</pre> | |||
*; Find unused disks | |||
<pre> | |||
/opt/MegaRAID/MegaCli/MegaCli -PDList -a0 | grep -B14 Unconfigured | grep -e '^Enclosure Device ID:' -e '^Slot Number:' | |||
Enclosure Device ID: 32 | |||
Slot Number: 2 | |||
Enclosure Device ID: 32 | |||
Slot Number: 3 | |||
</pre> | |||
*; Silence active alarm | |||
MegaCli -AdpSetProp AlarmSilence -aALL | |||
*; Disable alarm | |||
MegaCli -AdpSetProp AlarmDsbl -aALL | |||
*; Enable alarm | |||
MegaCli -AdpSetProp AlarmEnbl -aALL | |||
*; Create Raid 1 Volume (in femmes, creato array secondario con 2 dischi da 2TB) | |||
MegaCli -CfgLdAdd -r1 [32:2,32:3] -a1 | |||
* ''comando effettuato il 5 maggio 2011'' | |||
<pre> | |||
# /opt/MegaRAID/MegaCli/MegaCli -CfgLdAdd -r1 [32:2,32:3] -a0 | |||
Adapter 0: Created VD 1 | |||
Adapter 0: Configured the Adapter!! | |||
Exit Code: 0x00 | |||
</pre> | |||
*; Create RAID 0, 1, 5 drive | |||
MegaCli -CfgLdAdd -r(0|1|5) [E:S, E:S, ...] -aN | |||
*; Create RAID 10 drive | |||
MegaCli -CfgSpanAdd -r10 -Array0[E:S,E:S] -Array1[E:S,E:S] -aN | |||
*; Remove drive | |||
MegaCli -CfgLdDel -Lx -aN | |||
*; | |||
== HP Smart Array == | |||
* checking arrays on the controller | |||
<source lang=bash> | |||
$ cat /proc/driver/cciss/cciss* | |||
cciss0: HP Smart Array P400i Controller | |||
Board ID: 0x000000 | |||
Firmware Version: 5.26 | |||
IRQ: 1271 | |||
Logical drives: 2 | |||
Current Q depth: 0 | |||
Current # commands on controller: 0 | |||
Max Q depth since init: 31 | |||
Max # commands on controller since init: 51 | |||
Max SG entries since init: 31 | |||
Sequential access devices: 0 | |||
cciss/c0d0: 73.37GB RAID 1(1+0) | |||
cciss/c0d1: 146.77GB RAID 1(1+0) | |||
</source> |
Latest revision as of 13:37, 27 August 2013
devices in Linux
dmidecode
- gives you a lot of information about bus and bios
I/O analisys
- vmstat
- iostat
- vopstat
- sysstat (package)
- iotop
- kernel "unusual" options needed
- CONFIG_TASK_IO_ACCOUNTING: is not set when it should be.
- CONFIG_TASK_DELAY_ACCT: is not set when it should be.
- CONFIG_TASKSTATS: is not set when it should be.
udev
- udev manages the /dev filesystem interacting with the kernel and its modules
- disk conncted through udev
ls -lR /dev/disk
- udev information dump
udevinfo -a -p /sys/block/sdb/
lshal
- commang to list the whole Hardware Abstraction Layer
Processor DRAM Controller' (string) pci.product_id = 64 (0x40) (int) pci.subsys_product_id = 64 (0x40) (int) pci.subsys_vendor = 'Intel Corporation' (string) pci.subsys_vendor_id = 32902 (0x8086) (int) pci.vendor = 'Intel Corporation' (string) pci.vendor_id = 32902 (0x8086) (int) Dumped 165 device(s) from the Global Device List.
hdparm
- sets and gets information from a block device
- hdparm -I /dev/hda
/dev/hda:
ATA device, with non-removable media Model Number: WDC WD2500JB-00FUA0 Serial Number: WD-WCAEP1091941 Firmware Revision: 15.05R15 Standards: Supported: 6 5 4 Likely used: 6 Configuration: Logical max current cylinders 16383 65535 heads 16 1 sectors/track 63 63 -- CHS current addressable sectors: 4128705 LBA user addressable sectors: 268435455 LBA48 user addressable sectors: 488397168 device size with M = 1024*1024: 238475 MBytes device size with M = 1000*1000: 250059 MBytes (250 GB) Capabilities: LBA, IORDY(can be disabled) Standby timer values: spec'd by Standard, with device specific minimum R/W multiple sector transfer: Max = 16 Current = 16 Recommended acoustic management value: 128, current value: 128 DMA: mdma0 mdma1 mdma2 udma0 udma1 udma2 udma3 udma4 *udma5 Cycle time: min=120ns recommended=120ns PIO: pio0 pio1 pio2 pio3 pio4 Cycle time: no flow control=120ns IORDY flow control=120ns Commands/features: Enabled Supported: * SMART feature set Security Mode feature set * Power Management feature set * Write cache * Look-ahead * Host Protected Area feature set * WRITE_BUFFER command * READ_BUFFER command * DOWNLOAD_MICROCODE SET_MAX security extension * Automatic Acoustic Management feature set * 48-bit Address feature set * Device Configuration Overlay feature set * Mandatory FLUSH_CACHE * FLUSH_CACHE_EXT * SMART error logging * SMART self-test Security: supported not enabled not locked not frozen not expired: security count not supported: enhanced erase HW reset results: CBLID- above Vih Device num = 0 determined by the jumper Checksum: correct
Hard disk naming
- behind the hard disks naming, as WD3200JD, there's lot of info about the device:
http://forums.storagereview.net/index.php?showtopic=22131 Sample: WD3200JD-00KLB0 Formula: AAbbbbCD-eeFGHi
AA = WesternDigital
bbbb = Capacity in 100MB units (GBx10)
C = Cache(buffer) size and drive's purpose: * Desktop drives: B=2MB, J=8MB, K=16MB * Enterprise drives 7200rpm: S=8MB, Y=16MB * Enterprise drives 10000rpm: G=8MB, A=16MB
D = Interface and some other specs: * B=ATA, D=SATA150, S=SATA300, R=SATA150(RaidEdition2), H=SATA150(Window)
ee = Vendor code (probably): * 00=general consumers, 01=general enterprise, 22=promotional(?), * 07/08/11/14/23/32/40/41/50/55/56/57/58/60/75/88/98=unknown (of them 55 is pretty much used)
F = May be related to platters (needs more research)
G = ??? (needs more research)
H = Related to interface/firmware and something more (needs more research): * A=ATA(Caviar over 100GB)/ATAandSATA(Caviar below 100GB), B=SATA(Caviar over 100GB), C=ATAandSATA(Caviar, newer updates), A/C/R=Generation(RaptorSATA), T=LaptopDrive
i = Firmware version (probably): * 0/1/2=larger is newer (if the preceeding letter is same).
Disktype
disktype /dev/sda --- /dev/hda Block device, size 372.6 GiB (400088457216 bytes) DOS/MBR partition map Partition 1: 372.6 GiB (400085812224 bytes, 781417602 sectors from 63, bootable) Type 0x83 (Linux) ReiserFS file system (new 3.6 format, standard journal, starts at 64 KiB) Volume name "scratch" UUID E217E2D5-0410-479E-B4C7-60116C56761E (DCE, v4) Volume size 372.6 GiB (400085811200 bytes, 97677200 blocks of 4 KiB) [...]
Hddtemp
# hddtemp /dev/sd[abcd] WARNING: Drive /dev/sda doesn't appear in the database of supported drives WARNING: But using a common value, it reports something. WARNING: Note that the temperature shown could be wrong. WARNING: See --help, --debug and --drivebase options. WARNING: And don't forget you can add your drive to hddtemp.db /dev/sda: WDC WD3200KS-00PFB0: 42 C or F
extend hddtemp database
* file /usr/share/hddtemp/hddtemp.db "ST3320620AS" 194 C "Seagate ST3320620AS" "WDC WD3200KS-00PFB0" 194 C "Western Digital WD3200KS-00PFB0"
- risultato
# hddtemp /dev/sd[abcd] /dev/sda: WDC WD3200KS-00PFB0: 42 C /dev/sdb: ST3750330AS: 36 C /dev/sdc: WDC WD3200KS-00PFB0: 41 C /dev/sdd: ST3750330AS: 41 C
NCQ
megarais_sas
- controller SAS interno:
rpm -Uvh MegaCli-8.00.29-1.i386.rpm --nodeps rpm -Uvh Lib_Utils-1.00-08.noarch.rpm --nodeps
- come usarlo:
http://hwraid.le-vert.net/wiki/LSIMegaRAIDSAS
http://hwraid.le-vert.net/wiki/LSIMegaRAID
http://tools.rapidsoft.de/perc/perc-cheat-sheet.html
/opt/MegaRAID/MegaCli/MegaCli -PdInfo -PhysDrv \[\?:1\] -aAll
- current virtual disk:
femmes:~/megaraid# /opt/MegaRAID/MegaCli/MegaCli -LDInfo -LALL -aALL Adapter 0 -- Virtual Drive Information: Virtual Drive: 0 (Target Id: 0) Name :Virtual Disk 0 RAID Level : Primary-1, Secondary-0, RAID Level Qualifier-0 Size : 136.125 GB State : Optimal Strip Size : 64 KB Number Of Drives : 2 Span Depth : 1 Default Cache Policy: WriteBack, ReadAheadNone, Direct, No Write Cache if Bad BBU Current Cache Policy: WriteBack, ReadAheadNone, Direct, No Write Cache if Bad BBU Access Policy : Read/Write Disk Cache Policy : Disk's Default Encryption Type : None
- physical disks
:~/megaraid# /opt/MegaRAID/MegaCli/MegaCli -PDList a0 Adapter #0 Enclosure Device ID: 32 Slot Number: 0 Device Id: 0 Sequence Number: 2 Media Error Count: 0 Other Error Count: 0 Predictive Failure Count: 0 Last Predictive Failure Event Seq Number: 0 PD Type: SAS Raw Size: 136.732 GB [0x11177328 Sectors] Non Coerced Size: 136.232 GB [0x11077328 Sectors] Coerced Size: 136.125 GB [0x11040000 Sectors] Firmware state: Online, Spun Up SAS Address(0): 0x5000cca00d047fd5 SAS Address(1): 0x0 Connected Port Number: 0(path0) Inquiry Data: HITACHI HUS153014VLS300 A4C2JFV2GPZC FDE Capable: Not Capable FDE Enable: Disable Secured: Unsecured Locked: Unlocked Needs EKM Attention: No Foreign State: None Device Speed: Unknown Link Speed: Unknown Media Type: Hard Disk Device Enclosure Device ID: 32 Slot Number: 1 Device Id: 1 Sequence Number: 2 Media Error Count: 0 Other Error Count: 0 Predictive Failure Count: 0 Last Predictive Failure Event Seq Number: 0 PD Type: SAS Raw Size: 136.732 GB [0x11177328 Sectors] Non Coerced Size: 136.232 GB [0x11077328 Sectors] Coerced Size: 136.125 GB [0x11040000 Sectors] Firmware state: Online, Spun Up SAS Address(0): 0x5000cca00d04908d SAS Address(1): 0x0 Connected Port Number: 1(path0) Inquiry Data: HITACHI HUS153014VLS300 A4C2JFV2HUHC FDE Capable: Not Capable FDE Enable: Disable Secured: Unsecured Locked: Unlocked Needs EKM Attention: No Foreign State: None Device Speed: Unknown Link Speed: Unknown Media Type: Hard Disk Device
- battery status
/opt/MegaRAID/MegaCli/MegaCli -AdpBbuCmd -aALL BBU status for Adapter: 0 BatteryType: BBU Voltage: 4040 mV Current: 0 mA Temperature: 25 C [...]
- Find unused disks
/opt/MegaRAID/MegaCli/MegaCli -PDList -a0 | grep -B14 Unconfigured | grep -e '^Enclosure Device ID:' -e '^Slot Number:' Enclosure Device ID: 32 Slot Number: 2 Enclosure Device ID: 32 Slot Number: 3
- Silence active alarm
MegaCli -AdpSetProp AlarmSilence -aALL
- Disable alarm
MegaCli -AdpSetProp AlarmDsbl -aALL
- Enable alarm
MegaCli -AdpSetProp AlarmEnbl -aALL
- Create Raid 1 Volume (in femmes, creato array secondario con 2 dischi da 2TB)
MegaCli -CfgLdAdd -r1 [32:2,32:3] -a1
- comando effettuato il 5 maggio 2011
# /opt/MegaRAID/MegaCli/MegaCli -CfgLdAdd -r1 [32:2,32:3] -a0 Adapter 0: Created VD 1 Adapter 0: Configured the Adapter!! Exit Code: 0x00
- Create RAID 0, 1, 5 drive
MegaCli -CfgLdAdd -r(0|1|5) [E:S, E:S, ...] -aN
- Create RAID 10 drive
MegaCli -CfgSpanAdd -r10 -Array0[E:S,E:S] -Array1[E:S,E:S] -aN
- Remove drive
MegaCli -CfgLdDel -Lx -aN
HP Smart Array
- checking arrays on the controller
$ cat /proc/driver/cciss/cciss*
cciss0: HP Smart Array P400i Controller
Board ID: 0x000000
Firmware Version: 5.26
IRQ: 1271
Logical drives: 2
Current Q depth: 0
Current # commands on controller: 0
Max Q depth since init: 31
Max # commands on controller since init: 51
Max SG entries since init: 31
Sequential access devices: 0
cciss/c0d0: 73.37GB RAID 1(1+0)
cciss/c0d1: 146.77GB RAID 1(1+0)