Compute-Cluster: Difference between revisions

From HateotU
No edit summary
(8 intermediate revisions by the same user not shown)
Line 6: Line 6:
= compute0.hateotu.de =
= compute0.hateotu.de =
* Fujitsu RX300 S4
* Fujitsu RX300 S4
* 48GB memory, 12*4GB DDR2 FB
 
* 2* E5420 (each 4+0 cores)
* SAS
** controller flashed to HBA mode
** 2* 74GB 15k 2.5"
* FC
** FC-HBA 2* ... to fcsw...
** FC-HBA 1* ... to fcsw...
  compute0.hateotu.de
  compute0.hateotu.de
  10.204.3.220
  10.204.3.220
Line 20: Line 12:
  Proxmox VE 6
  Proxmox VE 6
  SSH @ 22, HTTPS @ 8006
  SSH @ 22, HTTPS @ 8006
* 48GB memory, 12* 4GB DDR2 FB
* 2* E5420 (4+0 cores per socket, @2.5GHz)
* SAS1
** LSI SAS1068E-based controller, flashed to HBA mode
** 2* 73GB 15k 2.5"
* FC
** FC-HBA Emulex Zephyr-X 2*4G
*** 10:00:00:00:c9:77:e8:6c -> sw1-1 p1
*** 10:00:00:00:c9:77:e8:6d -> free
** FC-HBA QLogic QLE2460 1* 4G
*** 21:00:00:1b:32:09:b9:b6 -> sw2-1 p3
* storage
** OS on ZFS, mirror of 2* 73GB
** imported LUNs from storage0 via redundant FC
*** multipathd




Line 32: Line 44:
= compute1.hateotu.de =
= compute1.hateotu.de =
* Fujitsu RX300 S4
* Fujitsu RX300 S4
* 48GB memory, 12*4GB DDR2 FB
 
* 2* E5420 (each 4+0 cores)
* SAS
** controller flashed to HBA mode
** 2* 74GB 15k 2.5"
* FC
** FC-HBA 2* ... to fcsw...
** FC-HBA 1* ... to fcsw...
  compute1.hateotu.de
  compute1.hateotu.de
  10.204.3.221
  10.204.3.221
Line 46: Line 50:
  Proxmox VE 6
  Proxmox VE 6
  SSH @ 22, HTTPS @ 8006
  SSH @ 22, HTTPS @ 8006
* 48GB memory, 12* 4GB DDR2 FB
* 2* E5420 (4+0 cores per socket, @2.5GHz)
* SAS1
** LSI SAS1068E-based controller, flashed to HBA mode
** 2* 73GB 15k 2.5"
* FC
** FC-HBA Emulex Zephyr-X 2*4G
*** 10:00:00:00:c9:77:e3:90 -> sw1-1 p2
*** 10:00:00:00:c9:77:e3:91 -> free
** FC-HBA QLogic QLE2460 1* 4G
*** 21:00:00:1b:32:09:68:b2 -> sw2-1 p1
* storage
** OS on ZFS, mirror of 2* 73GB
** imported LUNs from storage0 via redundant FC
*** multipathd




Line 59: Line 81:
= compute2.hateotu.de =
= compute2.hateotu.de =
* Fujitsu RX300 S4
* Fujitsu RX300 S4
* 48GB memory, 12*4GB DDR2 FB
 
* 2* E5420 (each 4+0 cores)
* SAS
** controller flashed to HBA mode
** 2* 74GB 15k 2.5"
* FC
** FC-HBA 2* ... to fcsw...
** FC-HBA 1* ... to fcsw...
  compute2.hateotu.de
  compute2.hateotu.de
  10.204.3.222
  10.204.3.222
Line 73: Line 87:
  Proxmox VE 6
  Proxmox VE 6
  SSH @ 22, HTTPS @ 8006
  SSH @ 22, HTTPS @ 8006
* 48GB memory, 12* 4GB DDR2 FB
* 2* E5420 (4+0 cores per socket, @2.5GHz)
* SAS1
** LSI SAS1068E-based controller, flashed to HBA mode
** 2* 73GB 15k 2.5"
* FC
** FC-HBA Emulex Zephyr-X 2*4G
*** 10:00:00:00:c9:7c:95:0a -> sw1-1 p3
*** 10:00:00:00:c9:7c:95:09 -> free
** FC-HBA QLogic QLE2460 1* 4G
*** 21:00:00:1b:32:89:c4:62 -> sw2-1 p2
* storage
** OS on ZFS, mirror of 2* 73GB
** imported LUNs from storage0 via redundant FC
*** multipathd




Line 86: Line 119:
= storage0.hateotu.de =
= storage0.hateotu.de =
* Fujitsu FibreCAT SX80
* Fujitsu FibreCAT SX80
862820-0807D5276D
500C0FF0D52C7A3C
500C0FF0DA6C263C
500C0FF0DA69103C
   
   
  storage0.hateotu.de
  storage0.hateotu.de
  10.204.3.223
  10.204.3.223
00:c0:ff:d5:27:6d
  HTTPS @ 443
  HTTPS @ 443


Line 103: Line 141:
** + global spares: 2* 450GB
** + global spares: 2* 450GB
** SUM 7160 GB / 6,99 TB = 6,52 TiB
** SUM 7160 GB / 6,99 TB = 6,52 TiB
* LUNs exported via FC




<pre>
Info 2020-01-19 18:46:55 58 A1887662
Disk detected error (Channel:0 ID:37 SN:3QQ1WFJ500009004YAXC Encl:2 Slot:5) Key,Code,Qual=(01h,18h,01h) cdb:Rd 00046480 0080 Info:0004648eh CmdSpc:0h FRU:0h SnsKeySpc:800039h Recovered Error recovered data with error corr. & retries applied


Info 2020-01-21 00:27:06 58 A1887671
Disk detected error (Channel:0 ID:37 SN:3QQ1WFJ500009004YAXC Encl:2 Slot:5) Key,Code,Qual=(01h,18h,01h) cdb:Rd 00046480 0080 Info:0004648eh CmdSpc:0h FRU:0h SnsKeySpc:80003ah Recovered Error recovered data with error corr. & retries applied
</pre>


= fcsw01.hateotu.de =
= fcsw01.hateotu.de =
Line 111: Line 157:
   
   
  fcsw01.hateotu.de
  fcsw01.hateotu.de
  10.204.3.229
  10.204.3.230
00:27:f8:81:ee:a6




Line 119: Line 166:
   
   
  fcsw02.hateotu.de
  fcsw02.hateotu.de
  10.204.3.230
  10.204.3.229
00:27:f8:81:ff:ae

Revision as of 21:44, 3 March 2020



compute0.hateotu.de

  • Fujitsu RX300 S4
compute0.hateotu.de
10.204.3.220

Proxmox VE 6
SSH @ 22, HTTPS @ 8006
  • 48GB memory, 12* 4GB DDR2 FB
  • 2* E5420 (4+0 cores per socket, @2.5GHz)
  • SAS1
    • LSI SAS1068E-based controller, flashed to HBA mode
    • 2* 73GB 15k 2.5"
  • FC
    • FC-HBA Emulex Zephyr-X 2*4G
      • 10:00:00:00:c9:77:e8:6c -> sw1-1 p1
      • 10:00:00:00:c9:77:e8:6d -> free
    • FC-HBA QLogic QLE2460 1* 4G
      • 21:00:00:1b:32:09:b9:b6 -> sw2-1 p3
  • storage
    • OS on ZFS, mirror of 2* 73GB
    • imported LUNs from storage0 via redundant FC
      • multipathd



out-of-band management

irmc-compute0.hateotu.de
10.204.3.225

with KVM license


compute1.hateotu.de

  • Fujitsu RX300 S4
compute1.hateotu.de
10.204.3.221

Proxmox VE 6
SSH @ 22, HTTPS @ 8006
  • 48GB memory, 12* 4GB DDR2 FB
  • 2* E5420 (4+0 cores per socket, @2.5GHz)
  • SAS1
    • LSI SAS1068E-based controller, flashed to HBA mode
    • 2* 73GB 15k 2.5"
  • FC
    • FC-HBA Emulex Zephyr-X 2*4G
      • 10:00:00:00:c9:77:e3:90 -> sw1-1 p2
      • 10:00:00:00:c9:77:e3:91 -> free
    • FC-HBA QLogic QLE2460 1* 4G
      • 21:00:00:1b:32:09:68:b2 -> sw2-1 p1
  • storage
    • OS on ZFS, mirror of 2* 73GB
    • imported LUNs from storage0 via redundant FC
      • multipathd


out-of-band management

irmc-compute1.hateotu.de
10.204.3.226

missing KVM license



compute2.hateotu.de

  • Fujitsu RX300 S4
compute2.hateotu.de
10.204.3.222

Proxmox VE 6
SSH @ 22, HTTPS @ 8006
  • 48GB memory, 12* 4GB DDR2 FB
  • 2* E5420 (4+0 cores per socket, @2.5GHz)
  • SAS1
    • LSI SAS1068E-based controller, flashed to HBA mode
    • 2* 73GB 15k 2.5"
  • FC
    • FC-HBA Emulex Zephyr-X 2*4G
      • 10:00:00:00:c9:7c:95:0a -> sw1-1 p3
      • 10:00:00:00:c9:7c:95:09 -> free
    • FC-HBA QLogic QLE2460 1* 4G
      • 21:00:00:1b:32:89:c4:62 -> sw2-1 p2


  • storage
    • OS on ZFS, mirror of 2* 73GB
    • imported LUNs from storage0 via redundant FC
      • multipathd


out-of-band management

irmc-compute2.hateotu.de
10.204.3.227

missing KVM license



storage0.hateotu.de

  • Fujitsu FibreCAT SX80
862820-0807D5276D
500C0FF0D52C7A3C
500C0FF0DA6C263C
500C0FF0DA69103C

storage0.hateotu.de
10.204.3.223
00:c0:ff:d5:27:6d
HTTPS @ 443
  • master shelf + 2* disk shelf, 12 FC-HDDs (via interposer) 3.5" each
    • 18* 146GB
    • 18* 450GB
  • RAIDs
    • vdisk146_0: 8*146GB RAID6 -> ~880GB
    • vdisk146_1: 8*146GB RAID6 -> ~880GB
    • + global spares: 2* 146GB
    • vdisk450_0: 8*450GB RAID6 -> ~2700GB
    • vdisk450_1: 8*450GB RAID6 -> ~2700GB
    • + global spares: 2* 450GB
    • SUM 7160 GB / 6,99 TB = 6,52 TiB
  • LUNs exported via FC


Info 	2020-01-19 18:46:55 	58	A1887662 	
Disk detected error (Channel:0 ID:37 SN:3QQ1WFJ500009004YAXC Encl:2 Slot:5) Key,Code,Qual=(01h,18h,01h) cdb:Rd 00046480 0080 Info:0004648eh CmdSpc:0h FRU:0h SnsKeySpc:800039h Recovered Error recovered data with error corr. & retries applied 

Info 	2020-01-21 00:27:06 	58	A1887671 	
Disk detected error (Channel:0 ID:37 SN:3QQ1WFJ500009004YAXC Encl:2 Slot:5) Key,Code,Qual=(01h,18h,01h) cdb:Rd 00046480 0080 Info:0004648eh CmdSpc:0h FRU:0h SnsKeySpc:80003ah Recovered Error recovered data with error corr. & retries applied 

fcsw01.hateotu.de

  • Brocade 300, 8*8G FC licenced
fcsw01.hateotu.de
10.204.3.230
00:27:f8:81:ee:a6


fcsw02.hateotu.de

  • Brocade 300, 8*8G FC licenced
fcsw02.hateotu.de
10.204.3.229
00:27:f8:81:ff:ae