HP刀片服务器硬件配置安装技术规范.docx

HP刀片服务器硬件配置安装技术规范硬件配置安装技术规范Ver 1.0无锡市东盛计算机技术服务有限公司2008年5月2. 3刀片Cisco 3020网络交换机Cisco SystemsCisco Systemsno:INTERNIIT GlNf RATION图五：刀片Cisco3020视图图五：刀片Cisco3020视图编号描述1. 交换机2. 扳手3. UID LED4. SFP Module Port LED编号描述6. Gigabit EthernetPort LEDs7. Gigabit EthernetRJ-45 Ports8. 健康指示灯9. Mode Bu甘on5.5.SFP Module Ports for SX Fiber 10Switch LED PanelCisco3020交换机由Cisco Systems公司设计、制造并提供支持，可无缝集成到 用户现有的Cisco网络基础设施中。Cisco Catalyst 3020刀片交换机提供了 16个 千兆内部互连端口，8个RJ-45外部上行链路，其中4个端口可设置为光纤(SX)端 口，2个端口可设置为内部互连端口。Cisco 3020支持的网络标准:支持的网络标准描述标准_ IEEE 802.1s_IEEE802.1w_IEEE802.1x.IEEE 802.3ad_ IEEE 802.3x full duplex on 10BASE-T, 100BASE-TX, and 1000BASE-T ports_ IEEE 802.1 D Spanning Tree Protocol_ IEEE 802.1 p CoS Prioritization_ IEEE 802.1 Q VLAN_ IEEE 802.3 10BASE-T specification_ IEEE 802.3u 100BASE-TX specification_ IEEE 802.3ab 1000BASE-T specification_ IEEE 802.3z 1000BASE-X specification _1000BASE-SX_ RMON I and II standards_SNMPv1, SNMPv2c, and SNMPv32. 4刀片 Brocade 4/24 SAN 交换机BROCADEBROCADE刀片SAN交换机Brocade 4.24由Brocade公司设计制造，交换机提供1 Gb/2Gb/ 4Gb自习惯的光纤通道(FC)连接，能够通过这个光纤通道网络直通模块将 每个刀片服务器连接到SAN,每个模块能够提供16个对内高达4Gb的无堵塞光纤 通道连接链路与8个对外的4Gb连接。图六：刀片服务器与交换模块连接视图标号描述1刀片Cisco3020内置网络交换机（左）2刀片Cisco3020内置网络交换机（右）3刀片Brocade4/24内置SAN交换机（左）4刀片Brocade4/24内置SAN交换机（右）NIC1刀片服务器网卡1NIC2刀片服务器网卡2Ml（l 口）刀片服务器FC-HBA卡1 口Ml（2 口）刀片服务器FC-HBA卡2 口根据上图所示： 每台刀片服务器HP BL460c提供2个网卡（NIC1、NIC2）； 每台刀片服务器HP BL460c提供1个双通道FC-HBA卡的端口（M1-1 口与M1-2 口）; 每个C7000刀片机箱配置2个Cisco3020的网络交换机（交换机插槽1、交换机插槽2） 每个C7000刀片机箱配置2个Brocade4/24的SAN交换机（交换机插槽3、交换机插槽4）标配情况下，刀片服务器BL460c中的： NIC1连接Cisco交换机1 NIC2连接Cisco交换机2 FC-HBA1 连接 Brocade SAN 交换机 1 FC-HBA2 连接 Brocade SAN 交换机 2移去刀片机箱服务器空挡板去除刀片服务器BL460C插槽保护盖按照下图方式安装刀片服务器1Slot and Bank|Description1ASDRAM DIMM in socket 1, Bank A2CDIMM socket 2, Bank C3ASDRAM DIMM in socket 3, Bank A4CDIMM socket 4, Bank C5BDIMM socket 5, Bank B6DDIMM socket 6, Bank D7BDIMM socket 7, Bank B8DDIMM socket 8, Bank DO如图方法安装硬盘7. 1通过计算机连接交换机.八 Caution/ Do not connect the switch module to any device other than the laptop or workstation being used to configure it.1 .确认网线连接两端的网络端口的LED指示灯是否为绿色.端口的LED指示灯为绿色后，等待至少30秒后，打开计算机的WEB浏 览器（将计算机的IP地址设置为10.0.0.X）文档信息第1章刀片服务器硬件配置5第2章刀片服务器硬件描述62.1 刀片服务器机箱HPC700062.2 刀片服务器描述82.3 刀片Cisco 3020网络交换机102.4 刀片 Brocade 4/24 SAN交换机11第3章刀片服务器与机箱的连接12第4章刀片服务器的安装14第5章刀片服务器内存的配置16第6章刀片服务器硬盘的安装17第7章刀片网络交换机配置197.1 通过计算机连接交换机197.2 完成快速安装页面的设置207.3 网络连接与配置227.3.1 网络拓扑结构227.3.2 网络地址规划与端口配置表237.3.3 网络配置24第8章刀片存储交换机配置268.1 设置存储交换机IP地址268.1.1 使用串口连接进行设置268.1.2 通过超级终端命令行的方式访问存储交换机268.1.3 设置存储交换的IP地址268.2 配置存储交换机278.2.1 设置时间.278.2.2 Disahling/enahling 存储交换机.278.2.3 打开/关闭交换机端口278.3 更换交换机的 Fibre Channel domain ID288.4 检查交换机工作状态与配置信息28第9章刀片服务器的配置299.1 配置刀片机箱IP地址299.2 通过刀片机箱IP地址，登录刀片进行配置30第10章刀片服务器的检测3710.1 硬件安装配置检测3710.2 硬盘装配正常检验383.显示快速安装设置页面：配置网络参数Exprwtt tf«tupSettingsey“：fu.por.fHF.fi5"初信电电而-3(16 Jwi Jnz JlSwitch PMfword：!»Corftrm SwCch PMivrord:Optitmnl EIQing%MORT»»wt Access:Ccrftmt Te*w< PMtw«rd：1SNMP6 EnMM Ort*|pabteSM<> wrts CowntrMtY：Syrttm ConUct:|Om BradWySystem Louibor*ICCA1C017. 2完成快速安装页面的设置Exprtrt% (letup.输入下述信息在“ Network Settings ,设置页中ci. Management Interface (VLAN ID)默认为：1输入新的“ VLAN ID ”； VLAN ID区间为11001b.在IP Address栏，输入交换机的IP地址c.在IP Subn6tMeisk栏，输入交换机IP地址子网掩码d.在Default Gotewciy栏，输入默认网关e.在Switch Possword栏，输入交换机登录口令(口令为125 011Phe字符)4 .在Optional Settings中输入选项a.输入Host Name选项b.可选输入System Contact信息c. Telnet Access 栏，能够选择 Enable ,通过 Telnet 管理交 换机；假如选择Enable；务必输入Telnet Passwordd.其他选项如 SNMP、 SNMP Read Community、 SNMP Write Community可选配置e.选择Submit储存上述设置.5 .使用新的输入的交换机IP地址连接交换机Cisco 3020就会出现 Catalyst Blade Switch 3020 设备管理界面. Wntrtpoftf Port S4ttx7. 3网络连接与配置在blade server内部网卡的连接方式上，能够使用操作系统下面的网卡绑定，能够保证 在一个网卡的连接出现问题的情况下，能够自动切换到备用网卡上面。 假如3020网络交换机或者连接blade server的端口出现故障时，那么连接blade server 的网卡也会down,同样能够通过blade server内部网卡的绑定来实现冗余。 Cisco 3020与客户的外部交换机之间线路的可靠性,建议在之间的连接线路上配置trunk 与port channel,能够实现线路故障时的快速切换。在连接客户的实际生产网络时，不 建议关闭或者更换spanning tree的配置。 在考虑一台cisco 3020交换机所有对外连接失效的情况下来保证blade server对外连接， 建议使用cisco的Layer 2 Trunk Failover技术，通过配置Link-state group,能够保证在一 台3020对外连接全部实效时blade server的网络接口也能够同时失效来保证如今Blade server能够切换到备用接口通过备用交换机及其链路实现网络通信。7.3.1网络拓扑结构刀片服务器网络拓扑结构配置如图：其中每台刀片服务器各有两个网卡，分别连接到两 台刀片Cisco 3020交换机，3020交换机再各通过一条光纤线路连接到核心交换机6506（两 台）。Catalyst 6506Catalyst 6506刀片机箱系统7. 3. 2网络地址规划与端口配置表网络设备IP地址表（参考）注：上述IP地址与网关信息为示例;设备名称IP地址网关管理Vian上联端口上联设备刀片服务器01100GiO/17C6506 3/6刀片服务器02100GiO/17C6506 3/6网络设备的VTP设置VTP Domain: CCB （示例）VTP Pass:NONEVTP Mode:Client网络设备的Default passwd: Console pass: cisco Enable pass: cisco Telnet pass: cisco网络端口配置表设备名称上联端口VLANTrunk下联设备下联设备端口刀片交换机01GiO/1121No刀片服务器1EthernetlGiO/2121No刀片服务器2Ethernet 1GiO/171yesC65063/6GiO/21121NoTemp useGiO/22121NoTemp useGiO/23121NoTemp useGiO/24121NoTemp use刀片交换机02GiO/1121No刀片服务器1EthernetOGiO/2121No刀片服务器2EthernetOGiO/171yesC65062/6GiO/21121NoTemp useGiO/22121NoTemp useGiO/23121NoTemp useGiO/24121NoTemp use7. 3.3网络配置Access 端口 Vian 配置：interface GigabitEthernet0/9 switchport access vlan 121 switchport mode access speed 1000spanning-tree portfastTrunk端口配置interface GigabitEtharnatO/17switchport trunk encapsulation dotlqswitchport trunk allowed vlan 62 r100,121switchport mode trunkLink state 配置因建行的两台Blade 3020分别使用单一的联路上联到两台Corswitch 6506,无法 做到link的冗余配置，因此需要配置link state,确保在一台Switch的上联联路出 现故障时，能切断下联到主机的端口，确保主机能够切换到另一网卡，通过另一个3020提 交数据。其中主机的双网卡绑定与切换配置由操作系统下teaming工具提供（参考操作系统安 装配置手册）。*如两台交换机各使用两条联路上联到两台Switch,可不需要该配置。Link state track 1interface GigabitEthernetO/1link state group 1 downstreaminterface GigabitEthernetO/9link state group 1 downstreaminterface GigabitEthernetO/17link state group 1 upstram8.1设置存储交换机IP地址1.1使用串口连接进行设置使用随机的串口线将交换机连接到计算机；从计算机的超级终端进行连接: Bits per second - 9600Databits-8 Parity - NoneStop bits - 1 Flow control - None2通过超级终端命令行的方式访问存储交换机 默认的用户名称之：adminPassword： password进入交换机配置管理界面1. 3设置存储交换的IP地址1 . 输入命令：ipaddrset.输入需要设置的IP地址等信息2 .通过ipaddrshow命令检查IP地址信息输入是否正确.储存同时退出命令行方式，设置IP地址完毕8. 2配置存储交换机2. 1设置时间使用下述方法设置交换机日期与时间.使用Qdmin用户，登录交换机，1 .在命令行根据下述语法输入正确的日期时间：date ummddHHMMyyn2. 2Di sab ling/enabling 存储交换机默认情况下，存储交换机为enable状态，能够通过下述方法对存储交换机状态进行修改: 将交换机设为disable状态：1 .使用Qdmin用户，登录交换机，. 输入下述命令：switchDisable将交换机设为enable状态：1 .使用Qdmin用户，登录交换机，. 输入下述命令:switchEnabl8. 2. 3打开/关闭交换机端口打开指定端口:1 .使用Qdmin用户，登录交换机.2 . 输入下述命令：portEnable <portnumber>z关闭指定端口:1 .使用Qdmin用户，登录交换机.2 .输入下述命令：portDisable <portnumber>8. 3更换交换机的 Fibre Channel domain ID更换 domain ID:1 .先关闭交换机：switchDisable.输入：Configure.输入新的数值 或者选择Enter同意默认数值.2 .在"fabric parameters 出现提示的时候选择Y同时输入Enter.3 . 输入唯一的 domain ID ( 1-239).4 .完成整个过程后，输入Ctrl+D同意上述设置.重新打开交换机：switchEnable5 .确认输入的信息是否正确，能够用：fabricshow命令进行查看4检查交换机工作状态与配置信息通过下述方法检查交换机工作状况与配置信息：1 .检查交换机端口 LED指示灯，确认是否所有部件工作正常.输入命令：switchShow获得交换机与端口的状态信息2 .输入命令：fabricShow获得SAN网络的信息使用惠普 c-class blade server 的 0A 远程管理端口安装设置 onboard administrator card（此文中的 0A 代表 Onboard administrator ）1通过笼子前面的小液晶屏设置0A的IP地址：，先选中enclosure settings ;9.1配置刀片机箱IP地址Enclosure Info Blade or Port Info Turn Enclosure UID on View User Note Chat Modev I Main Menu Help2 进入 enclosure settings 后，设置 0A1 IP Address 192.168.1.1 ,设置完成后选 Accpect all;Change: OA1 IP Address Use Up/Down Arrows to Edit Right Arrow Tab, OK to Nav Bar; then press OK to AcceptInput Range: 0 - 255 OAl IP=168 ,001 .001 Mask= 255 ,255 .255 .000 Gatewy=O00 .000 .000 .000 (Accept I Cancel I What is THIS?10.3 操作系统正常安装检验3810.4 刀片服务器安装检查表39Enclosure SettingsPower Mode Limit AC Watts Power Savings OA1 IP Address OA2 IP AddressPower Mode Limit AC Watts Power Savings OA1 IP Address OA2 IP AddressAC Redundant)?Disabled!?NonresentJ?Encl NameRack NameInsight Display PIN#szdx|?CCBTESTl?v I Accept All I Settings Help9. 2通过刀片机箱IP地址，登录刀片进行配置3通过终端的IE6.0浏览器输入刀片服务器的OA 口的ip地址：；进入0A 的登陆界面；输入机器前方的纸片的出厂0A的用户名与密码登陆。HP Onboard AdministratorPasswordUser Nameszdx Primary Connection 1.20OA-0018FE2F57A2All Enclosures Connection Firmware OA Name , ，Copynght © 2006 Hewlett Packard Inc All rights reserved HP the HP Plus and the HP Logo are registered trademarks of Hewlett Packard. Inc4等录后进入Rack Overview界面，它把刀片的硬件状态很直观的以图片方式展现。网 HP Onboard AdministratorSystem StatusBWizards Options Help view LegendRack Overview - CCBTESTQSystem StatusSystems and DevicesRack OverviewEnclosure: szdxO Enclosure informationQ Enclosure SettingsQ Active Onboard Administr；O Device Bays interconnect BaysQ Power and ThermalQ Users/AuthenticationInsight DisplayRack TopologyRack Power and Thermal5假如是第一次安装c-class刀片，直接进入first time setup wizard ;WelcomeEnclosure SelectionConfiguration ManagementRacK and EnclosureSettingsAdministrator Account SetupLocal User AccountsEnclosure Bay IP AddressingDirectory SettingsOnboard AdministratorNetwork Settings Enclosure SNMPSettingsPower ManagementFinishWelcomeThis wizard will assist you tn setting up your enclosures It Is run automatically the first time the Onboard Administrator is startedSteps may De skipped when accompanied by a Skip button The settings for each step will be applied when the Next button is clicked0 Do not automatically show this wizard againNext>Can6进入Configuration Management，用它能够快速重载一个往常配制好的OA设置;7 Rack and Enclosure Settings，设置笼子的名称、口寸间、时区等;网 HP Onboard AdministratorFirst Time Setup WizardSet up ntia enclosure and server setringsStep 3 of 11WelcomeEnclosure SelectionConfigurationManagementRack and EnclosureSettingsAdministrator AccountSetupLocal User AccountsEnclosure Bay IP AddressingDirectory SettingsOnboard AdministratorNetwork SettingsEnclosure SNMPSettingsPower ManagementFinishStep 3 of 11WelcomeEnclosure SelectionConfigurationManagementRack and EnclosureSettingsAdministrator AccountSetupLocal User AccountsEnclosure Bay IP AddressingDirectory SettingsOnboard AdministratorNetwork SettingsEnclosure SNMPSettingsPower ManagementFinishRack and Enclosure SettingsYou may use the following form to provide a common name and common time settings for your rack You may also provide unique names and asset tags for each of the enclosures you selectedRack Name CCBTESTDate:12007-0215|14：4r27CST6CDTVEnclosure: szdxEnclosure Name |szdxAsset Tag |< Previous 1 Next >Skip 1 Cancel8 Administrator Account Setup 设置管理员帐户；PIN protection 能够启用、设置 PIN Code 来 给刀片笼前面的液晶屏设置密码。9 Local User Accounts 添加、管理帐户Step 4 of 11WelcomeEnclosure SelectionConfigurationManagementRack and EnclosureSettingsAdministrator AccountSetupLocal User AccountsEnclosure Bay IP AddressingDirectory SettingsOnboard AdministratorNetwork SettingsEnclosure SNMPSettingsPower ManagementFinishuser hp Home | Sian OutStep 6 Of 11WelcomeEnclosure SelectionConfiguration ManagementRack and Enclosure SettingsAdministrator Account SetupLocal User AccountsEnclosure Bay IP AddressingDirectory SettingsOnboard Administrator Network Settings Enclosure SNMP SettingsPower Management FinishEnclosure Bay IP AddressingEnclosure Bay IP Addressing (EBIPA) allows you to assign a range of static IP addresses to the device bays and/or interconnect bays in the enclosure These IP addresses win be used by the server blade ILO ports once inserted into a bay In addition an interconnect module (switch) management port will use the pre-assigned IP address once inserted into the interconnect bayNote Skip this step if your network has an external DHCP service or if you wish to manually assign static IP addresses one by one to the server blades and interconnect modulesFor more information on EBIPA click on the Help icon at the top right of this screenClick Next > to continue or Skip if you do not wish to use Enclosure Bay IP Addressing< Previous 1 Next >Skip I Cancel网 HP Onboard AdministratorFirst Time Setup WizardSet up nta enclosure and server settingsAdministrator Account SetupThe Administrator account is the master administrator account for the enclosure This account has all possible privileges for all devices in the enclosure These account settings will be applied to the built-in Administrator account for each enclosure you have selectedNote If this is your first time logging in there is a physical tag attached to the Onboard Administrator module which contains the factory-set passwordUsername AdministratorPasswordPassword Confirm 一Full Name System AdministratorContactEnabling PIN protection will require a PIN code to be entered before using the enclosure's insight Display The PIN is alpha-numeric and must have a length from one to six characters Enable insight Display PIN protectionPIIJ Code10 设置 OA IP Address ；网 HP Onboard AdministratorFirst Time Setup WizardSet up ntal enclosure and server settings11 EBIPA Settings能够启用让笼子自动给每个插在机框上的刀片分配ILO2的地址；每个插 在机框上的网络设备自动分配管理地址；First Time Setup Wizard网 HP Onboard Administrator2User hpHome | Sign OutSet up nta enclosure and server settingsStep 6.1 of 11WelcomeEnclosure SelectionConfigurationManagementRack and EnclosureSettingsAdministrator Account SetupLocal user AccountsEnclosure Bay IP AddressingEBIPA SettingsDevice Bay ILO Processor Address Range Tms function assigns static IP addresses to dezce Days Dezce Day 1 is ass gned me oeg/nn/ng address, and Days 2-16 are assigned consecutively numbered IP addresses.0 Enable Enclosure Bay IP Addressing for Device Bay iLO ProcessorsDevice SettingsRecuired Field ,Beginning Address * 192 168 £100EBIPA Settings Directory Settings Onboard Administrator Network Settings Enclosure SNMP SettingsPower Management FinishSuonet Mask ,GatewayDomainDNS Server 1DNS Server 2DNS Server 3NTP Server 1NTP Server 2255 255 255 0192 168 1 1beginning addresskBayEBIPA AddressCurrent AddressDevice Typei1192 168 1 100192 168 1 100Server Blade2192 168 1 101192 168 1.101Server Blade3N/AAbsent4192.168.1 103K/AAbsent5192 168 1 104M/AAbsent6192 168 1 105N/AAbsent7192 168 1 106N/AAbsent8192 168 1 107N/AAbsent9192 168 1 108192 168 1.108Server Blade10Server Blade11192 168 1 110N/AAbsent12192 168 1 111N/AAbsentVDevice List This list displays the IP addresses that will be ass gned to each of the