Sun Microsystems, Inc.www.sun.comSubmit comments about this document at: http://www.sun.com/hwdocs/feedbackSun™ Dual Port 4x IB Host ChannelAdapter PC
x Sun Dual Port 4x IB Host Channel Adapter PCI-X Installation and User’s Guide • September 2005
xiRegulatory Compliance StatementsYour Sun product is marked to indicate its compliance class:• Federal Communications Commission (FCC) — USA• Industr
xii Sun Dual Port 4x IB Host Channel Adapter PCI-X Installation and User’s Guide • September 2005ICES-003 Class B Notice - Avis NMB-003, Classe BThis
Regulatory Compliance Statements xiiiCCC Class A NoticeThe following statement is applicable to products shipped to China and marked with “Class A” on
xiv Sun Dual Port 4x IB Host Channel Adapter PCI-X Installation and User’s Guide • September 2005
xvDeclaration of ConformityEMCUSA—FCC Class AThis equipment complies with Part 15 of the FCC Rules. Operation is subject to the following two conditio
xvi Sun Dual Port 4x IB Host Channel Adapter PCI-X Installation and User’s Guide • September 2005
xviiPrefaceThe Sun™ Dual Port 4x IB Host Channel Adapter PCI-X Installation and User’sGuide provides installation instructions for the Sun Dual Port 4
xviii Sun Dual Port 4x IB Host Channel Adapter PCI-X Installation and User’s Guide • September 2005Using UNIX CommandsThis document might not contain
Preface xixTypographic ConventionsRelated DocumentationThe following documents provide additional information regarding the IB-HCA andrelated products
Copyright 2005 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, California 95054, U.S.A. All rights reserved.Sun Microsystems, Inc. has intel
xx Sun Dual Port 4x IB Host Channel Adapter PCI-X Installation and User’s Guide • September 2005Documentation, Support, and TrainingThird-Party Web Si
Preface xxiSun Welcomes Your CommentsSun is interested in improving its documentation and welcomes your comments andsuggestions. You can submit your c
xxii Sun Dual Port 4x IB Host Channel Adapter PCI-X Installation and User’s Guide • September 2005
1CHAPTER1Product OverviewThis chapter provides an overview of the Sun Dual Port 4x IB Host Channel AdapterPCI-X card and includes the following sectio
2 Sun Dual Port 4x IB Host Channel Adapter PCI-X Installation and User’s Guide • September 2005The board characteristics are: Power: approx. 12 watts
Chapter 1 Product Overview 3I/O InterfacesThe IB-HCA includes the following interfaces: Two 4x InfiniBand copper connectors PCI-X 64-bit 133 MHz edg
4 Sun Dual Port 4x IB Host Channel Adapter PCI-X Installation and User’s Guide • September 2005FIGURE 1-2 LED LayoutLogical link(Amber LED)Physical li
Chapter 1 Product Overview 5Hardware, Software, and CableRequirementsThe hardware, software, and cable requirements for the Sun Dual Port 4x IB HostCh
6 Sun Dual Port 4x IB Host Channel Adapter PCI-X Installation and User’s Guide • September 2005
7CHAPTER2Adapter InstallationThis chapter describes how to install the adapter in your system and verify that ithas been installed correctly.IB-HCA Bu
iiiContentsRegulatory Compliance Statements xiDeclaration of Conformity xvPreface xviiHow This Book Is Organized xviiUsing UNIX Commands xviiiShell Pr
8 Sun Dual Port 4x IB Host Channel Adapter PCI-X Installation and User’s Guide • September 20052. Remove the cover from the unit to access the card sl
Chapter 2 Adapter Installation 9This completes the hardware installation. Proceed to the verification instructions in“Verifying the Installation” on p
10 Sun Dual Port 4x IB Host Channel Adapter PCI-X Installation and User’s Guide • September 20052. Check that the amber LED is illuminated for each po
11CHAPTER3Configuring IP Over InfiniBandThis chapter contains the following sections: “IPoIB Configuration” on page 11 “Managing IB Devices for IPoI
12 Sun Dual Port 4x IB Host Channel Adapter PCI-X Installation and User’s Guide • September 2005For example:Refer to dmesg(1M) for more information.2.
Chapter 3 Configuring IP Over InfiniBand 135. Verify that the devices are plumbed.To do this, type the command:The output includes information on the
14 Sun Dual Port 4x IB Host Channel Adapter PCI-X Installation and User’s Guide • September 2005
15CHAPTER4InfiniBand Software OverviewThis chapter includes the following topics: “InfiniBand Software” on page 15 “Related Software Documentation”
16 Sun Dual Port 4x IB Host Channel Adapter PCI-X Installation and User’s Guide • September 2005FIGURE 4-1 InfiniBand Software StackUser Direct Access
Chapter 4 InfiniBand Software Overview 17InfiniBand Transport FrameworkIBTF is the Solaris implementation of the InfiniBand Transport Layer (IBTL). IB
iv Sun Dual Port 4x IB Host Channel Adapter PCI-X Installation and User’s Guide • September 2005LED Displays 3Hardware, Software, and Cable Requiremen
18 Sun Dual Port 4x IB Host Channel Adapter PCI-X Installation and User’s Guide • September 2005Related Software DocumentationManuals System Administ
19APPENDIXAInfiniBand Cable Pin AssignmentsFIGURE A-1 shows the InfiniBand cable connectors and pin assignments.
20 Sun Dual Port 4x IB Host Channel Adapter PCI-X Installation and User’s Guide • September 2005FIGURE A-1 Sun 4x-to-12x InfiniBand Cable Pin Assignm
23APPENDIXBDiagnostic Software andTroubleshootingThis appendix provides an overview of the SunVTS™ diagnostic application andtroubleshooting tips for
24 Sun Dual Port 4x IB Host Channel Adapter PCI-X Installation and User’s Guide • September 2005Using the SunVTS ibhcatestThe ibhcatest diagnostic te
Appendix B Diagnostic Software and Troubleshooting 25▼ Using the ibhcatest1. Ensure that the SunVTS software and the Tavor driver are installed on you
26 Sun Dual Port 4x IB Host Channel Adapter PCI-X Installation and User’s Guide • September 2005If an InfiniBand software package is not installed, c
Appendix B Diagnostic Software and Troubleshooting 27snoopThe snoop program captures and inspects network packets. See the snoop(1M)man page for detai
28 Sun Dual Port 4x IB Host Channel Adapter PCI-X Installation and User’s Guide • September 2005
29IndexAadapterdescription, 1features, 1installation, 7layout, 2Ccable requirements, 5cablesconnectors, 19part numbers, 5pin assignments, 19Ddiagnosti
Contents vOther Useful Utilities 26cfgadm 26snoop 27netstat 27kstat 27Index 29
30 Sun Dual Port 4x IB Host Channel Adapter PCI-X Installation and User’s Guide • September 2005versions, 5TTavor driver, 17troubleshootingIB-HCA, 25t
vi Sun Dual Port 4x IB Host Channel Adapter PCI-X Installation and User’s Guide • September 2005
viiFiguresFIGURE 1-1 Sun Dual Port 4x IB Host Channel Adapter PCI-X Card 2FIGURE 1-2 LED Layout 4FIGURE 2-1 Typical Adapter-to-Switch Configuration 9F
viii Sun Dual Port 4x IB Host Channel Adapter PCI-X Installation and User’s Guide • September 2005
ixTablesTABLE 1-1 IB-HCA LEDs 3TABLE 1-2 Hardware, Software, and Cable Requirements 5TABLE B-1 SunVTS Documentation 24
Comentarios a estos manuales