HP IBRIX X9000 Network Storage SystemInstallation GuideAbstractThis document describes how to install the X9000 File Serving Software. It is intended

5. Select a method to complete the installation:• Web UI over the network from a remote system. The URL for the IBRIX Getting StartedWizard is display

Enter the information for the blade on the Server Setup dialog box.Review the information on the Configuration Summary that appears next, and select C

10. The wizard verifies the SAS configuration. All blades should be powered on during this step.A warning appears if a controller cannot be accessed.

15. The blade is now registered with the active management console and a passive managementconsole is installed and registered on the blade.16. The GU

IMPORTANT: HP recommends that you update the firmware before continuing with theinstallation. X9730 systems have been tested with specific firmware re

6. The Verify Hostname dialog box displays a hostname generated by the management console.If the hostname is incorrect, enter the correct hostname.7.

The wizard now sets up the blade.8. The wizard performs several checks:• Verifies the VC firmware• Validates the chassis configuration• Verifies VC au

11. The Configuration Summary dialog box lists the configuration of the blade. If the informationis correct, select Commit.12. The blade is now regist

Verify vendor storageRun the Linux pvscan command on the expansion blades to verify that the operating system cansee the factory-provisioned preformat

To see the LUNs associated with the physical volumes, select Vendor Storage from the Navigatorand select the new storage expansion module from the Ven

8 Expanding an X9720 or X9320 10GbE cluster by anX9730 modulePrerequisitesThe following prerequisites must be complete before adding the expansion mod

Completing the installation in text mode — unified networkTo configure the first server, complete the following steps:1. On the Form a Cluster — Step

IMPORTANT: Use an external USB drive that has external power; do not rely on the USBbus for power to drive the device.3. Restart the blade to boot fro

2. The setup wizard verifies the firmware on the system and notifies you if a firmware update isneeded. See “Firmware updates” (page 72) for more info

5. The Verify Hostname dialog box displays a hostname generated by the management console.Enter the correct hostname and select Ok.6. The Verify Confi

On the System Date and Time dialog box, enter the system date (day/month/year) and time(24-hour format). Tab to the Time Zone field and press Enter to

Review the information on the Configuration Summary. If the information is correct, selectAccept.The wizard now configures the blade.7. The network la

When you press F2, the following screen appears.When you answer Yes to configure a dedicated management network, the Get Total Networksdialog box appe

The Active VC is by default the VC in interconnect bay 1. If the system is at factory defaults,the administrator passwords for OA and VC are on the la

sets the iLO IP addresses in the range 172.16.3.1 to 172.16.3.16 by incrementing 1 to thelast octet of the IP address.To configure the iLO IP addresse

To configure the Interconnect (IC) IP addresses in sequence, enter the first Interconnect (IC) IPaddress on the Set Interconnect IP Addresses dialog b

15. Enter the DNS and NTP server information used by the Onboard Administrator.16. The wizard now configures the OA. This process takes up to 45 minut

3. The Configuration Summary lists the configuration you have specified. Select Commit tocontinue.4. The wizard now configures the active management c

The wizard makes the following checks:• Pings the VC management IP address.• Verifies the hpspAdmin account created earlier.If a check fails, take the

23. The wizard powers off blades 2–16, applies the SAS configuration, and then reboots blade1. Log into blade 1 when the Linux login prompt appears.24

27. The Network Configuration dialog box lists the interfaces you configured earlier. The correcteth devices should be assigned, but you need to confi

28. The Configuration Summary dialog box lists the configuration of the blade. If the informationis correct, select Commit.29. The blade is now regist

IMPORTANT: HP recommends that you update the firmware before continuing with theinstallation. X9730 systems have been tested with specific firmware re

6. The Verify Hostname dialog box displays a hostname generated by the management console.Select Ok. You will enter the correct hostname later in this

Review the information on the Configuration Summary that appears next, and select Commit.The wizard now sets up the blade.8. The wizard performs sever

If the blade check fails, select Enter Manually and enter the information on the following dialogbox.9. When the Join a Cluster — Step 2 dialog box ap

On the Edit Bonded Interface dialog box, enter the IP address and netmask and specify anybond options.11. The Configuration Summary dialog box lists t

12. The blade is now registered with the active management console and a passive managementconsole is installed and registered on the blade.Using the

5. Optionally, create a template to configure the remaining nodes. To use the template, all nodesmust have identical network configurations. If you ar

The Storage panel now lists the original physical volumes and the newly discovered physicalvolumes.To discover the physical volumes from the CLI, run

Expand an existing file systemTo add any or all of the new physical volumes to an existing file system, complete these steps:• Create a mountpoint for

9 Expanding an X9320 cluster with an X9320 starter kitThe following prerequisites must be complete before adding the new couplet to the existing clust

3. The wizard scans the network for active management consoles and lists them on the JoinCluster dialog box. Select the appropriate management console

6. If you changed the hostname, select Reject, and the following screen appears. (The screenalso appears if your cluster was not found in step 3.) Sel

tag with a FSN interface. For more information, see the HP IBRIX X9000 Network StorageSystem Network Best Practices Guide.Review the information on th

3. Select the first new undefined server and click Configure.4. On the Configure File Server dialog box, enter the information for the server and clic

1. On the Join a Cluster – Step 2 dialog box, enter the requested information.NOTE: Register IP is the Fusion Manager (management console) IP, not the

On the Edit Bonded Interface dialog box, enter the IP address and netmask, specify any bondoptions, and change the slave devices as necessary.When you

On the Select Interface Type dialog box, select Ok to create a bonded interface.On the Add Bonded Interface dialog box, enter bond1 as the name for th

A configuration script now performs some tuning and imports the LUNs into the X9000 software.When the script is complete, you can install the remainin

When you select Ok, the Configure Network dialog box reappears. Select bond1, and thenselect Configure. The Edit Bonded Interface dialog box is displa

10 Using ibrixinitThe ibrixinit utility is used to install or uninstall the Fusion Manager, file serving node, andstatstool packages on a file serving

DescriptionOptionSpecifies the Cluster virtual interface network mask for Fusion Manager-m <VIF_NETMASK>Installs or uninstalls the Linux X9000 c

11 Setting up InfiniBand coupletsInfiniBand is supported for X9300 and X9320 systems. The following logical network diagramshows an InfiniBand configu

Downloading and installing the InfiniBand softwareHP supports Mellanox OFED 1.5.3 for use with X9300/X9320 systems. To download the software,go to:htt

/lib/modules/2.6.18-194.el5/updates/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko /lib/modules/2.6.18-194.el5/updates/kernel/fs/exportfs/exportfs.ko 3. Re

InfiniBand tests for end to end:• On listener host, run ib_read_bw.• On sender, run ib_read_bw <ip address>. You might need to specify a port nu

[root@ib~]# tar -xf ufm-client-utils-2.0.0-28.tgz[root@ib ~]# cd ufm-client-utilst[root@ib ufm-client-utils]# ./install.shCheck dependencies ... OK C

12 Support and other resourcesContacting HPFor worldwide technical support information, see the HP support website:http://www.hp.com/supportBefore con

13 Documentation feedbackHP is committed to providing documentation that meets your needs. To help us improve thedocumentation, send any errors, sugge

4. The Verify Configuration dialog box shows the configuration for the server. Select Commit tocontinue.5. On the Form a Cluster — Step 2 dialog box,

GlossaryACE access control entry.ACL access control list.ADS Active Directory Service.ALB Advanced load balancing.BMC Baseboard Management Configurati

SELinux Security-Enhanced Linux.SFU Microsoft Services for UNIX.SID Secondary controller identifier number.SNMP Simple Network Management Protocol.TCP

7. The Configuration Summary dialog box lists the configuration you specified. Select Committo apply the configuration.8. The wizard registers a passi

Installing additional servers using the templateComplete the following steps:1. Using a console connection, log into the server you are installing. Th

4. The Verify Configuration dialog box shows the configuration for the server.If the configuration is correct, select Accept and go to step 4.NOTE: To

5. The wizard registers a passive Fusion Manager on the server, and then configures and startsit.The installation is complete.Completing the installat

© Copyright 2009, 2012 Hewlett-Packard Development Company, L.P.Confidential computer software. Valid license from HP required for possession, use or

On the Edit Bonded Interface dialog box, enter the IP address and netmask and specify anybond options. The slaves are selected by the system based on

On the Select Interface Type dialog box, select Ok to create a bonded interface.On the Add Bonded Interface dialog box, enter bond1 as the name for th

When you select Ok, the Configure Network dialog box reappears. Select bond1, and thenselect Configure. The Edit Bonded Interface dialog box is displa

A configuration script now performs some tuning and imports the LUNs into the X9000 software.7. If the bond0/cluster network is not routed and the bon

3. The installation wizard scans the network for existing clusters and lists the clusters on the JoinCluster dialog box. Select the appropriate cluste

5. The Verify Configuration dialog box shows the configuration for the server.Because you need to change the configuration, select Reject, and the fol

7. The Server Networking Configuration dialog box defines the server on bond0. Note thefollowing:• The hostname can include alphanumeric characters an

9. On the Join a Cluster – Step 2 dialog box, enter the requested information.NOTE: Register IP is the Fusion Manager (management console) IP, not the

On the Edit Bonded Interface dialog box, enter the IP address and netmask, specify any bondoptions, and change the slave devices as necessary for your

On the Select Interface Type dialog box, select Ok to create a bonded interface.On the Add Bonded Interface dialog box, enter bond1 as the name for th

Contents1 Installing X9300 and X9320 systems...6Network information...

When you select Ok, the Configure Network dialog box reappears. Select bond1, and thenselect Configure. The Edit Bonded Interface dialog box is displa

2 Configuring the cluster with the Getting Started Wizard(X9300/X9320 systems)The Getting Started Wizard configures the cluster in a few steps. Be sur

To update your license keys, click Update. Typically, you will need a license key for each server.Download your licenses from the HP website and place

The wizard attempts to access the addresses that you specify. If it cannot reach an address, amessage such as Primary DNS Server Unreachable will be d

To configure a server, select the server on the File Servers page and click Configure. Enter the hostname and IP address of the server. If the wizard

f you create a CIFS share, you will need to configure the file serving nodes for CIFS and configureauthentication. You might also want to set certain

The wizard saves an installation log at /usr/local/ibrix/log/installtime.log on theserver where you ran the wizard. Click View Log to display the log.

Troubleshooting steps:1. Relaunch the wizard, go to the Cluster Settings page, and click Next to retry the operation.If the operation fails again, run

nameserver 202.52.1.11If the operation still fails, there may be network inconsistencies or an outage. Typically, a networkoutage lasts only a few min

displayed. This situation could be caused by network inconsistencies or an outage. Usually anetwork outage lasts only a few minutes. Try relaunching t

Configuring automated failover...81Example configuration.

network details such as the IP address and hostname, relaunch the wizard, and try to set theHA pair again.If the operation still fails, use the follow

ibrix_powersrc -a -t ilo -h HOSTNAME -I IPADDR [-u USERNAME -pPASSWORD] [-s]• If the network is experiencing inconsistencies or an outage, the wizard

Use ethtool <eth port> to detect the speed information. The port value for X9300/X9320systems is detected as described in the previous step. For

QR the preformatted systems.An NFS/CIFS share cannot be createdProbable cause:• The server on which the file system is mounted is not available for sh

3 Installing X9730 systemsThe system is configured at the factory as follows:• X9000 File Serving Software 6.1 is installed on the servers.• LUNs are

IMPORTANT: In previous releases, the X9720 system shipped with access to the management,user and cluster networks through a single FSN bond. The field

Installation checklistMore informationTaskStep“Configuring OA1 IP addresses for OnboardAdministrator” (page 46)Configure active and standby IP address

3. On the Network Settings: OA1 Active screen, select Network Properties and press OK.4. On the Change OA Network Properties screen, set Enclosure IP

7. On the Change: OA1 IP Address screen, set the IP address, subnet mask, and gateway(optional) and Accept the changes.8. On the Network Settings: OA1

cat /proc/partitionsmajor minor #blocks name8 128 15633408 sdi4. Execute the following dd command to make USB the QR installer:dd if=<IS

Troubleshooting the InfiniBand network...145Enabling client access...

IMPORTANT: HP recommends that you update the firmware before continuing with theinstallation. X9730 systems have been tested with specific firmware re

5. The Server Networking Configuration dialog box defines the server on bond0. Note thefollowing:• The hostname can include alphanumeric characters an

The wizard now sets up the blade based on the information you entered.7. The setup wizard next configures the chassis on the X9730 system. See the HP

8. The wizard now validates the information you have entered. It performs the following tests:• Pings the active OA.• Verifies the OA password.• Verif

To configure the iLO IP addresses manually, enter each iLO IP address on the Enter iLO IPAddresses dialog box.11. The wizard lists the IP addresses yo

To configure the Interconnect (IC) IP addresses in sequence, enter the first Interconnect (IC) IPaddress on the Set Interconnect IP Addresses dialog b

14. Enter the DNS and NTP server information used by the Onboard Administrator.15. The wizard now configures the OA. This process takes up to 45 minut

The wizard makes the following checks:• Pings the VC management IP address.• Verifies the hpspAdmin account created earlier.If a check fails, take the

22. The wizard powers off blades 2–16, applies the SAS configuration, and then reboots blade1. Log into blade 1 when the Linux login prompt appears.23

25. The wizard is ready to create the cluster. Note the situations listed on the Proceed to ClusterCreation dialog box, and select Exit if they apply

1 Installing X9300 and X9320 systemsThe system is configured at the factory as follows:• X9000 File Serving Software 6.1 is installed on the servers b

2. The Network Configuration dialog box lists the interfaces you configured earlier.• If you are using the unified network layout, bond0 is already se

NOTE: Ensure that the Management IP is on the same subnet as the cluster network(bond0 for the unified network layout; bond1 for all other layouts).3.

In the hostname templates, the parameters enclosed in braces ({...}) expand in the followingmanner:• number num: The number of file serving nodes in t

Installing additional X9730 bladesUse this procedure to install blades 2–16 on an X9730 system. Complete the following procedureon each blade:1. Log i

4. The wizard scans the network for existing clusters. On the Join Cluster dialog box, select themanagement console (Fusion Manager) for your cluster.

1. The blade you are installing is assigned the appropriate name from the template, plus the lastoctet IP for a hostname. If necessary, you can change

3. The installer now obtains OA/VC information from the chassis. If the installer cannot obtainthe information programmatically, the following screen

6. The Network Configuration dialog box lists the interfaces configured on bond0. Theconfiguration is complete. Select Continue.7. The Configuration S

NOTE: Ensure that the Management IP is on the same subnet as the cluster network (bond0).8. The wizard registers and starts a passive management conso

2. On the Server Networking Configuration dialog box, configure this server for bond0, thecluster network. Note the following:• The hostname can inclu

More informationTaskStep“Starting the installation and configuration”(page 8)Perform the installation5.“Configuring virtual interfaces for client acce

5. The wizard now takes the following actions:• Checks the OA and VC firmware and notifies you if an update is needed• Verifies the VC configuration•

• If you are using the unified network layout, bond0 is already set up. Select Continue andgo to step 8.• If you are using a different network layout,

NOTE: Ensure that the Management IP is on the same subnet as the cluster network (bond0)for the unified network layout; bond1 for all other layouts).9

If the firmware check determines that firmware should be downgraded, you will see a dialog boxsuch as the following. You cannot downgrade the firmware

TroubleshootingInstall software cannot ping the OAThis condition can occur if OA2 becomes the Active OA. Configure the OA as follows to resolvethis co

4. On the Change OA Network Properties screen, set Enclosure IP to Enable and press OK toAccept.5. On the Network Settings: OA1 Active screen, select

3. Unassign the blade's profile.4. Reassign the blade's profile.5. Reboot the blade, and continue the installation.Credential Manager initia

4 Post-installation tasksUpdating license keysTypically you need a license key for each server. If you did not update your license keys duringthe inst

X9000 software manpagesX9000 software provides manpages for most X9000 software commands. To view the manpages,set the MANPATH variable on the managem

Configuring CIFS shares (optional)NOTE: Before attempting to configure CIFS, ensure that the DNS entries for the user network IPaddresses have PTR (re

4491+0 records out4709154816 bytes (4.7 GB) copied, 957.784 seconds, 4.9 MB/s5. Insert the USB key into the server to be installed.6. Restart the serv

5 Configuring virtual interfaces for client accessX9000 Software uses a cluster network interface to carry Fusion Manager traffic and traffic betweenf

1. Add the VIF:# ibrix_nic –a -n bond0:2 –h node1,node2,node3,node42. Set up a standby server for each VIF:# ibrix_nic –b –H node1/bond0:1,node2/bond0

Specifying VIFs in the client configurationWhen you configure your clients, you may need to specify the VIF that should be used for clientaccess.NFS/C

6 Adding Linux and Windows X9000 clientsLinux and Windows X9000 clients run applications that use the file system. The clients can read,write, and del

3. Verify that the X9000 client is operational. The following command reports whether X9000services are running:/etc/init.d/ibrix_client statusRegiste

To prefer a network interface for a hostgroup, use the following command:<installdirectory>/bin/ibrix_hostgroup -n -g HOSTGROUP -A DESTHOST/IFNA

Windows X9000 client setupWhen setting up the Windows X9000 client, you will need to perform specific tasks on the ActiveDirectory server, the managem

After configuring automatic user mapping, register the Windows client, and start the service. See“Registering Windows X9000 clients and starting servi

If you create other OUs in Active Directory and users in those units will access the file system,delegate control for these OUs to the proxy user also

1. Launch the Windows X9000 client GUI and navigate to the Registration tab.2. Select the client’s IP address from the list.3. Enter the management co

• The default gateway provides a route between networks. If your default gateway is on adifferent subnet than bond0, skip this field.Later in this pro

Starting the X9000 client service automaticallyThe X9000 client service, FusionClient, starts manually by default. When the client is functioningto yo

• Tune Host. Tunable parameters include the NIC to prefer (the client uses the cluster interfaceby default unless a different network interface is pre

ACEs can be explicit or inherited. An explicit ACE is assigned directly to the object by the owneror an administrator, while an inherited ACE is inher

read-write-execute permissions, the corresponding permission in the file mode mask for others isset to read-only. The write-execute permissions of the

The Permissions Entry window has three permissions that are important to X9000 software: ReadData, Write Data, and Execute File. These map directly to

Uninstalling Windows X9000 clientsNOTE: It is not necessary to unmount the file system before uninstalling the Windows X9000client software.To uninsta

7 Completing the X9730 Performance Module installationThis chapter describes how to complete the installation of an X9730 Performance Module afterinst

Installing the first expansion bladeThe examples in this procedure show the installation of the first performance module, adding newblades to an exist

IMPORTANT: HP recommends that you update the firmware before continuing with theinstallation. X9730 systems have been tested with specific firmware re

5. The Verify Hostname dialog box displays a hostname generated by the management console.If the hostname is incorrect, enter the correct hostname..6.