background image

ActiveScale

X100 Rackless Instalation Guide

6-68841-0

3

, Rev. A

with ActiveScale OS 

6.0.2

 software

Summary of Contents for ActiveScale X100

Page 1: ...ActiveScale X100 Rackless Instalation Guide 6 68841 03 Rev A with ActiveScale OS 6 0 2 software...

Page 2: ...rks of Quantum Corporation and its affiliates in the United States and or other countries All other trademarks are the property of their respective owners Quantum specifications are subject to change...

Page 3: ...torage Enclosure Basic 37 3 2 1 Unpacking a Storage Enclosure Basic 38 3 3 Installing the rail kit 39 3 4 Installing the chassis 44 3 5 Installing the sleds 49 3 6 Installing the rear fans 54 3 7 Adju...

Page 4: ...s 112 10 2 1 Summary of workflow 112 10 2 2 Run the pre login configuration wizard single site version 112 10 2 3 Connect the system to your networks 118 10 2 4 Run the post login configuration wizard...

Page 5: ...1 3 Rack requirements 196 14 1 4 PDU requirements 196 14 1 4 1 PDU requirements for Racked systems 196 14 2 Unpacking System Expansion Node kits 196 14 3 Installing System Expansion Node kits 197 14 3...

Page 6: ...the cord retention bale 235 18 Host connectivity for the Storage Enclosure Basic 239 19 About ActiveScale X100 racks 241 19 1 Rack requirements 242 19 2 Airflow considerations 242 20 PDU specificatio...

Page 7: ...cale OS X100 Rackless Installation Guide Contents 7 20 5 4 Single phase 220V 24A NA 256 20 5 5 1 phase 230V 32A Europe global 258 21 How to read cable labels 261 21 1 Cable mapping 261 Contacting Quan...

Page 8: ...nstallation overview 164 Table 12 8 Installing sled columns for scale up overview 168 Table 13 9 Parts needed for per system per site 184 Table 14 1 Kit contents 196 Table 14 2 System Interconnect con...

Page 9: ...nput connector and wiring 250 Table 20 36 Output voltage 250 Table 20 37 Branch circuit characteristics 250 Table 20 38 Output connector ratings 250 Table 20 39 Dimensions and weights 250 Table 20 40...

Page 10: ...weights 256 Table 20 61 Input power configuration 258 Table 20 62 Input current power 258 Table 20 63 Input connector and wiring 258 Table 20 64 Output voltage 258 Table 20 65 Branch circuit character...

Page 11: ...18 Open latch handle 63 Figure 3 19 Power supply A 64 Figure 3 20 Power supply B 65 Figure 3 21 MiniSAS cable top cable A CSN1 S1 DA1 SA 65 Figure 3 22 MiniSAS cable bottom cable B CSN1 S2 DA1 SB 66...

Page 12: ...igure 10 14 Cable routing brush strip 119 Figure 10 15 Network connectivity for a single site ActiveScale X100 120 Figure 10 16 Post Login EULA 121 Figure 10 17 Post Login Configuration 122 Figure 10...

Page 13: ...ActiveScale X100 159 Figure 11 54 Removing the rear fans 164 Figure 11 55 Rack seal plate cage nuts 165 Figure 11 56 Installing the rack seal plate 165 Figure 11 57 Rack seal plate installed 165 Figu...

Page 14: ...xpand the outer Rail 199 Figure 14 3 Rail attaching to rear vertical rail 199 Figure 14 4 Rail attaching to front vertical rail 200 Figure 14 5 Locking the inner rail to the node 200 Figure 14 6 Insta...

Page 15: ...wever for customers who purchase the ActiveScale X100 and who prefer or need to use their own racks the components of the system are disassembled re boxed and shipped as the rackless ActiveScale X100...

Page 16: ...lbs 114 kg Each Storage Enclosure Basic box Rail kit Chassis Sleds I O Module Power cables SAS cables Screws and fasteners 2 Pallet weight 250kg 550lbs Pallet Dimensions 965 x 1220 x 635mm 38 x 48 x...

Page 17: ...Rail kits Screws and fasteners Storage Node Power cables 3 x System Nodes Box weight 65 lbs 30 kg Each System Node box Rail kits Screws and fasteners Storage Node Power cables 1 x System Interconnects...

Page 18: ...se 3 configuration typical max 4 45 5 34 kW Base 4 configuration typical max 5 1 6 02 kW Base 5 configuration typical max 5 75 6 7 kW Full Base 6 configuration typical max 6 4 7 4 kW System Expansion...

Page 19: ...six column of populated sleds 19 59 22 91 KBTU h Full configuration base 6 seven columns of populated sleds 21 83 25 25 KBTU h System Expansion Node kit 1 0 665 to 0 785 KBTU hour Weight Minimum syste...

Page 20: ...mary of installation phases Table 1 2 Installation phases Chapter Steps Phase 1 Preparing the rack Verifying rack dimensions Verifying front and rear working space Verifying interior rack space in fro...

Page 21: ...Phase 2 Installing Storage Enclosure Basics 6 Storage Enclosure Basics Unpacking boxes Installing rails Installing chassis Installing sleds Installing I O module with SAS cables and power cables Tabl...

Page 22: ...allation Guide 22 Phase 3 Installing the Storage Nodes 6 Storage Nodes Installing rails leaving 1U gap above last Storage Enclosure Basic Installing servers Connecting SAS cables Table 1 2 Installatio...

Page 23: ...ActiveScale OS X100 Rackless Installation Guide 23 Phase 4 Installing the System Nodes 3 System Nodes Installing rails Installing servers Table 1 2 Installation phases continued Chapter Steps...

Page 24: ...ackless Installation Guide 24 Phase 5 Installing the System Interconnects 2 System Interconnects Installing rails Installing System Interconnects Connecting DAC cables Table 1 2 Installation phases co...

Page 25: ...allation Guide 25 Phase 6 Installing the Management Interconnect 1 Management Interconnect Installing rails Installing the Management Interconnect Connecting Cat6 Ethernet cables Table 1 2 Installatio...

Page 26: ...ing power cables and powering on the ActiveScale X100 Installing PDUs Connecting System Interconnects to power Connecting Management Interconnect to power Connecting Storage Enclosure Basics to power...

Page 27: ...blanking panels not shown Note There is no requirement to leave space between System Interconnects in a racked ActiveScale X100 3 System Nodes 4 Storage Nodes 5 Storage Enclosure Basics N A PDUs On a...

Page 28: ...ActiveScale OS X100 Rackless Installation Guide 28...

Page 29: ...meet specifications Quantum Corporation recommends removing the front and rear doors to the rack before assembling If possible Quantum Corporation also recommends removing the side panels of the rack...

Page 30: ...n be found in Rack requirements on page 242 However Quantum Corporation has found that choosing a rack based solely on the measurements provided can sometimes lead to unexpected and unsatisfactory res...

Page 31: ...is if each Storage Enclosure Basic contains only one or two fully populated sleds each and the system will never be scaled up then the weight the rack will need to support will be less Note Before in...

Page 32: ...y Caution Quantum Corporation strongly recommends that you assemble the ActiveScale X100 with the PDUs disconnected from the power drops and that Length Cabinet length minimum length 47 25 1200 mm if...

Page 33: ...ng the ActiveScale X100 on page 105 2 4 System serial number Each ActiveScale X100 system has a serial number and each component of the ActiveScale X100 that is installed in the rack is labeled with t...

Page 34: ...ActiveScale OS X100 Rackless Installation Guide 34...

Page 35: ...ication of assembled Storage Enclosure Basic on page 37 About assembling the Storage Enclosure Basic on page 37 Installing the rail kit on page 39 Installing the chassis on page 44 Installing the sled...

Page 36: ...ActiveScale OS X100 Rackless Installation Guide 36 Assemble the remaining Storage Enclosure Basics on page 66...

Page 37: ...on rack and then you can unpack the box and assemble the Storage Enclosure Basic in the rack Another installation scenario is that you will need to unpack the Storage Enclosure Basic box outside the d...

Page 38: ...boxes in sequential order 2 Open the box 3 Verify the serial number on the chassis matches the rack serial number and verify that the chassis number is correct 4 As you remove parts from the box inspe...

Page 39: ...assembling the rail kits for the Storage Enclosure Basic insert screws loosely Until directed to tighten the screws all the screws on the rail kit should be left loose have approximately of thread sho...

Page 40: ...ons where the rack frame may create difficult access to the cable channel you may choose to pre thread the power cables and the SAS cables through the rails before mounting them 3 Extend the rail to i...

Page 41: ...back until it is flush behind the front vertical rail and insert screws with washers in the top and bottom holes of the rail Note The chamfered side of the washer goes toward the rack Tip If you drop...

Page 42: ...procedure to install the other rack mount rail and rear rail 8 Verify that the bottom of each rail kit is in the same starting U position That is before proceeding verify that the rail kits are at ev...

Page 43: ...ActiveScale OS X100 Rackless Installation Guide 43 10 Thread the SAS cables and the power cable between the front vertical rail and the front of the cabinet...

Page 44: ...ready to install the Storage Enclosure Basic chassis 3 4 Installing the chassis For the installation of the chassis the following hardware is required For the installation of the chassis the followin...

Page 45: ...1 If you have not already done so remove the chassis from the box 2 Attach the first rack ear to the front outside of the of the chassis with 5 M4 X 8 Torx screws Important Leave the screws loose just...

Page 46: ...de contains 5 M4 X 8 Torx screws Caution Due to the size and weight of the chassis Quantum Corporation recommends using two people to lift and install the chassis 4 Lift the chassis and place it on th...

Page 47: ...Installation Guide 47 6 From the inside of the chassis secure the sides of the chassis to the rails using 3 M4 X 8 screws Note Each side should contain 3 screws in the sidewall of the chassis Figure...

Page 48: ...ghten all 6 screws completely 9 On the left side of the chassis fully tighten the 5 rack ear screws 10 On the right side of the chassis fully tighten the 5 rack ear screws 11 From the front of the rac...

Page 49: ...ecommended torque of machined fasteners on page 233 15 On the right side of the rack push the edge of the chassis to the right until it is flush with or just slightly to the right of the front face of...

Page 50: ...lumns do not need to use identical drives For example column A could use all 10 TB drives and column B could use all 12 TB drives Populated sleds must be inserted contiguously on the left side of the...

Page 51: ...losure Basic number on the sled label matches the chassis number and rack position 4 Remove the red protective cap and inspect both ends of the sled for any visible connector damage 5 Line up the sled...

Page 52: ...X100 Rackless Installation Guide 52 6 Slide the sled into the chassis until it is securely seated against the rear of the chassis Note The sled can be inserted with the latch open or closed Figure 3...

Page 53: ...s 1 through 5 for all the remaining sleds Ensure that all populated sleds are aligned contiguously on the left side of the chassis Note The final sled or sled blank will fit snugly Be careful not to d...

Page 54: ...ear fans Figure 3 10 Front and rear view of rear fan Note Each fan is stamped with a letter Insert fans behind the exhaust ports on the back of the chassis according to the corresponding letter printe...

Page 55: ...rs on the chassis 2 Tilt the top of the fan until the fan pins line up with the connectors on the chassis Warning To prevent damage to the rear fan components press the at the top of the fan Do not pu...

Page 56: ...p of the fan and carefully pull the fan away from the chassis 3 7 Adjusting the cord retention bale The cord retention bale is adjustable to the size of different approved power cords The retention ba...

Page 57: ...ear view of I O module Warning To prevent damage to the I O module connector card on the module board avoid contact with anything other than the sled connectors Important Place the I O module on a cle...

Page 58: ...cing up position your hands so that your thumbs are on the outside and your fingers cradle the bottom and rear of either side of the I O module Warning The I O module is very top heavy Ensure that you...

Page 59: ...ActiveScale OS X100 Rackless Installation Guide 59 Figure 3 14 Installing the I O module...

Page 60: ...tallation Guide 60 6 Using the open lever slide the I O module towards the sleds until it stops Note Do not push on the top of the I O module Maneuver and push it into postion using the open lever Fig...

Page 61: ...Rackless Installation Guide 61 7 Verify that it is firmly in place 8 Using both of the palms of your hands press the latch handle up and into the I O module until locked into the rack ears Figure 3 1...

Page 62: ...hin the chassis Figure 3 17 Seated I O module 3 9 Connecting power cables For the installation of power cables the following hardware is required There are no tools required for the installation of th...

Page 63: ...of the rack leave the power cords and SAS cables loose until Phase 4 and Phase 8 3 Run the power cable through the left side of the I O module lift the retention bale and insert the overmold of the p...

Page 64: ...of the overmold in the removal latch slot The figure is provided for orientation purposes only do not insert the power cable into the removal latch slot while the latch is open Note Orient the neutra...

Page 65: ...o in front of the power cable Figure 3 20 Power supply B 5 Close the I O module latch handle 6 Fully seat the power cables and attach the cord bales on the both the left and right side of the I O modu...

Page 66: ...ans Verify that the fans can be serviced with the PDUs and power cables in place If detached re attach the back door of the rack cabinet Verify that the door will close with the Storage Enclosure Basi...

Page 67: ...ation Guide 67 Note As you assemble the ActiveScale X100 there will be a number of power cables hanging out of the back of the rack This is normal for the assembly process Be sure to rack the Storage...

Page 68: ...ActiveScale OS X100 Rackless Installation Guide 68...

Page 69: ...3 of the install process consists of installing six Storage Nodes and connecting SAS cables between the Storage Nodes and Storage Enclosure Basics Topics Installing the Storage Nodes on page 70 Conne...

Page 70: ...er 2 Open the box 3 Verify the serial number on the node matches the rack serial numbers and verify that the node number is correct 4 As you remove parts from the box inspect the node for any signs of...

Page 71: ...Storage Nodes for serviceability 1 Attach the outer rail to the rack a Extend the outer rail enough that it extends between the two vertical rails of the rack Figure 4 23 Expand the outer rail b Posi...

Page 72: ...ion Guide 72 c Extend the outer rail forward and insert the pegs into the front vertical rail The illustration below shows how the latch and the rail pegs attach to the rear vertical rail Figure 4 25...

Page 73: ...uter rails extending out of the rack Consider pushing the outer rails back into the rack until step 3 below e Repeat steps a d with the other rail 2 Attach the inner rails to the Storage Node a Attach...

Page 74: ...mportant The server weight is 12 2 kg 27 lbs Take precautions when handling the Storage Node 4 With the Storage Node inserted fully into the rack screw the thumb screws on the front of the system into...

Page 75: ...27 SAS cable labeling 4 3 Connecting power cables to the Storage Nodes Connect two power cables to each Storage Node that has been installed in the rack Note Do not connect the power cables to the PD...

Page 76: ...ActiveScale OS X100 Rackless Installation Guide 76...

Page 77: ...100 Rackless Installation Guide 77 5 Installing System Nodes Phase 4 consists of installing the three System Nodes Topics Installing the System Nodes on page 78 Connecting power cables to the System N...

Page 78: ...r 2 Open the box 3 Verify the serial number on the node matches the rack serial number and verify that the node number is correct 4 As you remove parts from the box inspect the node for any signs of d...

Page 79: ...re 5 28 Expand the outer rail b Position the hook of the rear outer rail around the rear vertical rail and then slide the rear outer rail pegs into the desired slots Figure 5 29 Rail attaching to rear...

Page 80: ...ActiveScale OS X100 Rackless Installation Guide 80 Figure 5 30 Rail attaching to front vertical rail...

Page 81: ...outer rails extending out of the rack Consider pushing the outer rails back into the rack until step 3 below e Repeat steps a d with the other rail 2 Attach the inner rails to the System Node a Attac...

Page 82: ...in Important The server weight is 12 2 kg 27 lbs Take precautions when handling the System Node 4 With the System Node inserted fully into the rack screw the thumb screws on the front of the system i...

Page 83: ...s of installing the System Interconnects and connecting the Storage Nodes and System Nodes to the System Interconnects with DAC cables Topics Installing the System Interconnects on page 84 Cabling the...

Page 84: ...nterconnect matches the other rack serial numbers and verify that the System Interconnect number is correct 4 As you remove parts from the box inspect the System Interconnects for any signs of damage...

Page 85: ...ack attach the left external rail by extending the adjustable rear end to its full length and inserting the pegs into the back vertical rail 3 Push the front of the external rail so that the front lin...

Page 86: ...System Interconnect 1 8 Install System Interconnect 1 into the 3U mounting bracket a From the front of the rack orient the System Interconnect so that the 48 network ports are facing toward the back o...

Page 87: ...tiveScale OS X100 Rackless Installation Guide 87 Interconnects e Slide the System Interconnect the rest of the way into the 3U rail kit until it stops Figure 6 32 Align and install System Interconnect...

Page 88: ...nt of the rack secure the System Interconnect bracket to the rack with the screws included in the mounting kit 9 Leaving a 1U gap install System Interconnect 2 on the top row of the 3U mounting bracke...

Page 89: ...tion on the Storage Node or System Node and destination i e the destination location in the System Interconnect Note Quantum Corporation recommends that you familiarize yourself with the cable labelin...

Page 90: ...ActiveScale OS X100 Rackless Installation Guide 90 Figure 6 34 Cabling Storage Node 2 Figure 6 35 Cabling Storage Node 3...

Page 91: ...ActiveScale OS X100 Rackless Installation Guide 91 Figure 6 36 Cabling Storage Node 4...

Page 92: ...ActiveScale OS X100 Rackless Installation Guide 92 Figure 6 37 Cabling Storage Node 5...

Page 93: ...38 Cabling Storage Node 6 6 2 2 Cabling the System Nodes Begin cabling with System Node 1 and proceed through System Node 3 as shown in the figures below You can also consult ActiveScale X100 cable wi...

Page 94: ...ActiveScale OS X100 Rackless Installation Guide 94 Figure 6 39 Cabling System Node 1...

Page 95: ...ActiveScale OS X100 Rackless Installation Guide 95 Figure 6 40 Cabling System Node 2...

Page 96: ...to the customer network Cables that connect the ActiveScale X100 to the customer network do not connect into the System Interconnects Rather they connect into N1 and N3 ports of the System Nodes Howe...

Page 97: ...nect the system to the customer network Follow these steps to install them 1 Locate the SFP ports on the back of each System Node Figure 6 42 Rear ports on System Node 2 Install one SFP transceiver in...

Page 98: ...ActiveScale OS X100 Rackless Installation Guide 98...

Page 99: ...alling the Management Interconnect and connecting the Storage Nodes and System Nodes to the management interconnect with CAT6 Ethernet cables Topics Installing the Management Interconnect on page 100...

Page 100: ...previous installation phase Before installing the Management Interconnect verify that the rack serial number is correct on the Management Interconnect To install the Management Interconnect do the fol...

Page 101: ...he system serial number 3 From the Management Interconnect box locate the adapters for mounting the Management Interconnect in the rack 4 Screw the adapters to either side of the Management Interconne...

Page 102: ...g positions on the right side of the rack 7 From the back of the rack position the adapters of the Management Interconnect over the cage nuts and screw the adapters into place with the 4 screws provid...

Page 103: ...ation it is represented below the System Interconnects to simplify the diagram Figure 7 43 Cabling diagram for the Management Interconnect Note The rackless version of ActiveScale X100 does not suppor...

Page 104: ...nnect Connect a power cable to the Management Interconnect that has been installed in the rack The power connector is on the back of the Management Interconnect facing the front of the rack and the ca...

Page 105: ...the rack and connecting them to power Identifying appropriate receptacles in the PDU for the power cords of ActiveScale X100 components Plugging component power cables into the PDU For Storage Nodes...

Page 106: ...ensure that the power going to and coming out of the PDUs is balanced As some ActiveScale X100 components draw significantly more power than others it is important that components be plugged into PDU...

Page 107: ...the power cords of the last Storage Enclosure Basic have been plugged into the PDU wait 1 2 minutes before plugging in the Storage Nodes 5 Plug the power cords from the Storage Nodes into the PDU at t...

Page 108: ...ActiveScale OS X100 Rackless Installation Guide 108...

Page 109: ...the system has powered on successfully Organize the cables in the cabinet 9 1 Tidying up There are a number of straps included in the accessory box that can be used to organize and move the cables to...

Page 110: ...ActiveScale OS X100 Rackless Installation Guide 110...

Page 111: ...of an additional system at the site a scale out stop here For instructions on adding additional systems see the ActiveScale X100 Support Guide Figure 10 1 Initial bringup workflow Topics What to bring...

Page 112: ...he fiber optic cable type you choose Maximum 10GBASE SR cable lengths are 300m for OM3 MMF fiber optic cables 400m for OM4 MMF fiber optic cables connected through duplex LC connectors 10 2 Single sit...

Page 113: ...pre login configuration wizard are mandatory unless otherwise noted Warning Do not use your web browser s Back or Forward buttons to navigate through the wizard 1 Configure a connection to the default...

Page 114: ...address 169 254 140 2 Subnet mask 255 255 255 0 Gateway 169 254 140 1 c Ping 169 254 140 1 from your laptop to confirm that you can reach it If ping results do not confirm a connection review your la...

Page 115: ...ault values Figure 10 5 Pre Login Site Configuration 5 Edit the fields on the Site Configuration page according to your predetermined values as recorded in your ActiveScale X100 Site Survey Note All f...

Page 116: ...3ad Dynamic Link bond mode 6 ALB Active Load Balancing includes transmit load balancing balance tlb and receive load balancing rlb for IPv4 traffic Receive load balancing is achieved by ARP negotiatio...

Page 117: ...ublic network s Check each IP assignment to make sure it is correct Note Write down the public IP address and subnet information because you need this to log into the system for post login configurati...

Page 118: ...ost Login Configuration image is highlighted as shown in the image below The check mark indicates successful completion of the pre login configuration Figure 10 11 Pre login checkmark 11 Optional Disc...

Page 119: ...er in SFP Port 1 N1 Figure 10 12 System Node ports for Public Network 1 and 2 For racked ActiveScale X100 systems feed the data center s network cables through the cable routing brush strip on top of...

Page 120: ...ion Guide 120 Figure 10 15 Network connectivity for a single site ActiveScale X100 10 2 4 Run the post login configuration wizard single site version The post login configuration wizard guides you thr...

Page 121: ...m the System Node s eth2 port while waiting for the pre configuration phase to complete navigate to any of these URLs using a desktop web browser https SystemNode1_PublicNetwork1_IP 10443 https System...

Page 122: ...the EULA section a Review the EULA in its entirety b At the bottom of the EULA type the Name and Title of the system administrator c To download a copy of the EULA click Download d Click I Agree The C...

Page 123: ...w quantum com support user It is limited to 20 characters You can change it at any time to allow deny access to your system by Quantum Support f Paste in your SSL certificates for ActiveScale SM and t...

Page 124: ...cting an SMTP server that the system cannot connect to contact Quantum support Tip You can specify SMTP Server as an IP address or a fully qualified domain name FQDN Tip Sending a test e mail is optio...

Page 125: ...throughput Usable capacity will be 679 of raw when storing large objects Large files 13 4 Small files 6 4 with a threshold 0 to 8 388 608 bytes Default 524 288 bytes Average client large file size to...

Page 126: ...ble capacity of 75 of the raw disk capacity The system will self heal up to five simultaneously failed drives Large files 20 5 Small files 7 5 with a threshold of 0 to 8 388 608 bytes Default 524 288...

Page 127: ...ActiveScale OS X100 Rackless Installation Guide 127 Figure 10 19 Post Login Storage Policy...

Page 128: ...enable telemetry collection the system sends telemetry back to Quantum Support for analysis and support Figure 10 20 Post Login ActiveScale m Click Apply A popup appears prompting you to confirm your...

Page 129: ...rors appear on this page click Show details see Troubleshooting on page 160 and then click Retry Upon successful completion of the post login configuration wizard the Go Live button appears Figure 10...

Page 130: ...ified for admin Figure 10 23 ActiveScale SM login page Upon first login the ActiveScale SM Welcome screen appears Figure 10 24 ActiveScale SM welcome screen 10 3 Multi site deployments A configuration...

Page 131: ...not attempt to convert a single site system into a multi site system 10 3 2 Do additional setup for a multi site deployment This step involves connecting additional cabling for uplinks reconfiguring...

Page 132: ...needed per system per site Cables needed per system per site Type Part number Quanti ty ActiveScale X100 base system one column Mode 1 two individual 10G access ports 48 47 per System Interconnect SF...

Page 133: ...N_Column3_StorageNetwork1 SiteN_Column3_StorageNetwork2 Tip There are four networks required at each site for ActiveScale X100 Figure 10 25 A multi site ActiveScale X100 system 10 3 2 3 Check data pat...

Page 134: ...atency is consistent and as expected Warning Do not assume that if site A can reach site B that means site B can reach site A or that the bandwidth and latency values in both directions are the same S...

Page 135: ...System Interconnect Provide non conflicting VLAN IDs and configure your respective switch ports for LACP Connect transceivers to ports 48 47 and 46 on each System Interconnect on each system at each s...

Page 136: ...tem Node s SFP transceivers as follows Figure 10 27 System Node ports for Public Network 1 and Public Network 2 For racked ActiveScale X100 systems feed the data center s network cables through the ca...

Page 137: ...Scale X100 Site Survey Please have this document available for your reference Each site must use the same multi site ActiveScale X100 Site Survey After verifying network settings the configuration wiz...

Page 138: ...s Tip All fields in the pre login configuration wizard are mandatory unless otherwise noted Warning Do not use your web browser s Back or Forward buttons to navigate through the wizard 1 At each site...

Page 139: ...54 140 2 Subnet mask 255 255 255 0 Gateway 169 254 140 1 c Ping 169 254 140 1 from your laptop to confirm that you can reach it If ping results do not confirm a connection review your laptop s network...

Page 140: ...ndefinitely for a connection from the primary site so if you fail to designate one site as the primary site the wizards will eventually become stuck Tip The factory designated site number Site1 Site2...

Page 141: ...default values Figure 10 33 Pre Login Site Configuration 5 On each configuration wizard edit the fields on the Site Configuration page according to your predetermined values as recorded in your Activ...

Page 142: ...lic Network 1 or Public Network 2 a Click the PUBLIC tab The wizard displays the IP addresses for Public Network 1 and Public Network 2 Check each IP assignment to make sure it s correct b Click the M...

Page 143: ...on wizard click Next The Inter Site Connectivity page appears on each configuration wizard Each wizard waits indefinitely for connectivity with the other two sites When the wizard establishes connecti...

Page 144: ...4 Figure 10 37 Pre Login Inter Site Connectivity secondary sites 9 On each configuration wizard click Next The Global Review page appears It shows the combined network configuration of the three sites...

Page 145: ...firm to apply the settings or Edit to make changes 11 Optional On the configuration wizard at the primary site wait for confirmation from the secondary sites 12 Write down the public IP address for Sy...

Page 146: ...zard at the primary site click Apply to apply the settings Warning If you click Apply while a secondary site s settings are still being edited the changes at that secondary site will be lost Figure 10...

Page 147: ...y Progress page is displayed Figure 10 42 Pre Login Apply Configuration Important If the Configure networks task fails this means that the network stress test has failed by default this test creates a...

Page 148: ...lic Network 1 if you made a note of the new IP address of System Node 1 If you did not make note of this IP address do not disconnect wait to click Proceed to Login 10 3 5 Run the post login configura...

Page 149: ...re starting the post login configuration Tip All fields in the post login configuration wizard are mandatory unless otherwise noted 1 Start the post login configuration wizard a Using a desktop web br...

Page 150: ...the EULA section a Review the EULA in its entirety b At the bottom of the EULA type the Name and Title of the system administrator c To download a copy of the EULA click Download d Click I Agree The C...

Page 151: ...an option that may be unavailable in certain countries Best practice is to specify a Master Encryption Phrase whether or not you can enable encryption and to save a copy of this phrase offline e Type...

Page 152: ...or fully qualified domain name s FQDN of the NTP servers you want the system to connect to i Specify how the system will send notifications Tip You can specify an SMTP Server as an IP address or a fu...

Page 153: ...ptimized multi site This policy has the highest availability Usable capacity will be 56 of raw when storing large objects Large files 18 8 Small files 10 8 with a threshold 0 to 8 388 608 bytes Defaul...

Page 154: ...e files 18 8 Small files 10 8 with a threshold of 0 to 8 388 608 bytes Default 524 288 Average object size 634 888 KB depending on disk capacity Overhead Large files 1 8x Small files 5 5x Durability U...

Page 155: ...ActiveScale OS X100 Rackless Installation Guide 155 Figure 10 47 Post Login Durability Policy...

Page 156: ...de 156 m Enable or disable telemetry collection ActiveScale CM If you enable telemetry collection the system sends telemetry back to Quantum Support for analysis and support Figure 10 48 Post Login Ac...

Page 157: ...is page click Show details see Troubleshooting on page 160 and then click Retry Upon successful completion of the post login configuration wizard the Go Live button appears Figure 10 50 Post Login App...

Page 158: ...password you specified for admin Figure 10 51 ActiveScale SM login page Upon first login the ActiveScale SM Welcome screen appears Figure 10 52 ActiveScale SM welcome screen 10 4 Verify system status...

Page 159: ...ActiveScale OS X100 Rackless Installation Guide 159 Figure 10 53 The dashboard for a single site ActiveScale X100 This confirms the successful bringup of the system...

Page 160: ...Troubleshoot Cable Check Failures The Apply Progress page indicates that a step failed To see details about the error click Show details The format of the details varies by step Copy the text to a cli...

Page 161: ...ration wizard fails at the Apply Configuration page on the Updating system with new network configuration step Quantum Support must refer to internal documentation to Recover from ElasticSearch Errors...

Page 162: ...ActiveScale OS X100 Rackless Installation Guide 162...

Page 163: ...that allows for the rack to be properly sealed in the event that third party liquid cooled doors are installed The rack seal plate can be easily installed into the bottom of the rack to seal off the...

Page 164: ...bottom Storage Enclosure Basic a From the rear of the chassis remove the rear fans by pressing the release button on the top right of the fan b Tilt the top of the fan out until clear of the rubber b...

Page 165: ...e is located directly across from the hole on the right side in the same position Figure 11 55 Rack seal plate cage nuts 5 From the rear of the rack install the rack seal plate a Place the end of the...

Page 166: ...Storage Enclosure Basic a From the rear of the chassis place the bottom of the fan on the rubber bumpers on the chassis Warning Do not place fingers anywhere near the fan blades while powered on b Ti...

Page 167: ...populated sled or a sled blank Each Storage Enclosure Basic in the system must have the same configuration of populated sleds and sled blanks All the drives in a sled must be the same type and capacit...

Page 168: ...talling sled columns for scale up overview Note Follow this procedure in its entirety on a single Storage Node Storage Enclosure Basic pair starting with the lowest pair Then wait for ActiveScale Caut...

Page 169: ...hat Storage Node select Shutdown The Machine Shutdown dialog appears e Type the password for admin f Click Shut Down 2 In your data center identify the Storage Enclosure Basic that is paired with the...

Page 170: ...I O module away from the chassis Figure 12 60 Removing the I O module 4 On the front of the leftmost sled blank press the latch mechanism button and pull it until it is at a 45 degree angle Figure 12...

Page 171: ...ulated sled up next to the last populated slot 7 Slide the sled into the enclosure until fully seated Figure 12 64 Installing the sled 8 Install the I O module into the Storage Enclosure Basic a Set t...

Page 172: ...ts status is ONLINE The correct number and position of installed sled s is shown Disks in the newly installed sled s have the status NOTMANAGED 11 Repeat this procedure starting from step 1 for each u...

Page 173: ...e up or scale out job is already in progress wait until the current job is complete to start the multi site scale up job Warning Do not start a log collection job while a scale up job is running 1 Ver...

Page 174: ...ActiveScale OS X100 Rackless Installation Guide 174 3 Enter the password for admin Figure 12 68 Scale up Password verification 4 Click Start Provisioning Figure 12 69 Scale up Start provisioning...

Page 175: ...completed all steps in the checklist displayed click Back to Let s Get Started and complete them first Figure 12 70 Scale Up Ready to provision 6 Navigate to the Jobs page and wait until the scale up...

Page 176: ...Confirmation on dashboard 8 Check the Resources page to confirm that the newly provisioned sled is present Figure 12 73 Scale up Confirmation on Resources page 12 3 Provisioning the newly added sleds...

Page 177: ...particularly important if you purchased multiple columns for an initial install Systems that have been running for some time may have a data safety issue as reported in ActiveScale SM You must resolv...

Page 178: ...tart the multi site scale up job Warning Do not start a log collection job while a scale up job is running 1 Verify the health of the system a Make sure all nodes are online b Click Configuration Syst...

Page 179: ...ActiveScale OS X100 Rackless Installation Guide 179 3 Enter the password for admin Figure 12 75 Scale up Password verification 4 Click Start Provisioning Figure 12 76 Scale up Start provisioning...

Page 180: ...completed all steps in the checklist displayed click Back to Let s Get Started and complete them first Figure 12 77 Scale Up Ready to provision 6 Navigate to the Jobs page and wait until the scale up...

Page 181: ...ct the problem Follow the suggestions 7 Check the dashboard to confirm that the added capacity is reflected in the Capacity tile Figure 12 79 Scale up Confirmation on dashboard 8 Check the Resources p...

Page 182: ...System Interconnects of the secondary system and run a wizard from the primary ActiveScale SM This section walks you through the procedure Topics Hardware steps on page 183 Parts Required for Scale O...

Page 183: ...If you are performing a multi site scale out additional parts are required Part Description Single rack scale out connectivity kit Part number 1EX0259 Contains four 40Gb male transceivers that plug i...

Page 184: ...eivers needed per system per site Cables needed per system per site Type Part number Quanti ty ActiveScale X100 base system one column Mode 1 two individual 10G access ports 48 47 per System Interconn...

Page 185: ...o ports 49 M1 and 51 M3 of System Interconnects 1 and 2 on both systems for a total of eight transceivers plugged in 2 Connect your OM3 OM4 cables to the transceivers you plugged in as follows Connect...

Page 186: ...nnect 2 port 49 to System 1 System Interconnect 2 port 51 13 5 Opening Interconnect Ports If the defaults were changed reconfigure the ports on your systems for the links to come up 1 Reconfigure the...

Page 187: ...ername admin no password lab mw System IP telnet IP of System Interconnect 2 Trying 172 16 210 200 Connected to 172 16 210 200 Escape character is User admin Password 4 Run the following commands Site...

Page 188: ...o ifconfig eth1 0 169 254 210 240 up f Connect to System Interconnect 2 username admin no password lab mw von telnet 169 254 210 200 Trying 169 254 210 200 Connected to 169 254 210 200 Escape characte...

Page 189: ...VLAN IDs and configure your respective switch ports for LACP Connect transceivers to ports 48 47 and 46 on each System Interconnect on each system at each site For uplink mode 5 two 40G trunks ports 5...

Page 190: ...is procedure does not upgrade or downgrade any firmware Warning Do not start a log collection job while a scale out job is running 1 Start the scale out wizard Important On multi site deployments star...

Page 191: ...the wizard indicates that there is a version mismatch click Close Update the ActiveScale OS on the existing system s and start the wizard again For upgrade help contact Quantum Support If the wizard f...

Page 192: ...tings in each tab Site 2 s network settings in each tab and Site 3 s network settings in each tab 4 When you reach the last tab click Proceed Figure 13 87 Scale out Click Proceed to apply network sett...

Page 193: ...different hgstsupport password than the existing system s Therefore best practice is to set a common hgstsupport password for the entire system 6 Click the link in the pop up to start the password wiz...

Page 194: ...e 13 90 Scale out Confirmation on Resources pane 9 Contact support to update the SSH keys on the new system At this point scaling out the system is done Tip If the existing system had encryption enabl...

Page 195: ...ades this includes Scale out deployments Scale up deployments Multi site deployments Important System Expansion Node kits do not provide failover or high availability capabilities to ActiveScale syste...

Page 196: ...ack space 27 lbs 12 2 kg of additional weight 0 665 at 785 KBTU hour of additional thermal output 230 W of additional power 14 1 4 PDU requirements Each System Expansion Node consumes approximately of...

Page 197: ...spect each item in the box for damage Repeat this process for each System Expansion Node kit 14 3 Installing System Expansion Node kits System Nodes and System Expansion Nodes use the same installatio...

Page 198: ...ActiveScale OS X100 Rackless Installation Guide 198 Figure 14 1 System Expansion Node rack locations 14 3 1 Installing the 1U rail kit To install the rails for the System Expansion Node...

Page 199: ...two vertical rails of the rack Figure 14 2 Expand the outer Rail b Position the hook on the rear outer rail around the rear vertical rail c Slide the rear outer rail pegs into the desired slots d Pos...

Page 200: ...cautious leaving the outer rails extending out of the rack Consider pushing the outer rails back until you are ready to install the node h Repeat the previous steps to attach the other rail to the ra...

Page 201: ...the rack 3 Push the node into the rack On the sides of the rail pull the blue tabs forward to allow the inner rail to slide all the way in 4 With the node inserted fully into the rack screw the thumb...

Page 202: ...Local port Peer port Peer device Cable SystemExpansion Node 3 N2 N42 SW2 10G SFP 1M DAC N4 N42 SW1 SystemExpansion Node 2 N2 N40 SW2 N4 N40 SW1 SystemExpansion Node 1 N2 N38 SW2 N4 N38 SW1 Local devi...

Page 203: ...plug is draped over the rack in a safe location and will not fall back through the hole Note The PDU cables may also go through the bottom of the rack if the power source is below the rack 2 Line up...

Page 204: ...Basic 5 23 10 C 13 1 06 System Interconnect 2 22 0 14 28 Total Branch YZ Plug Current A Component Port Time on s C 13 1 16 System Expansion Node 2 19 30 5 13 1 15 Storage Node 4 17 60 C 13 1 15 Stora...

Page 205: ...nsion Node 2 19 30 C 13 1 15 Storage Node 3 16 50 C 13 1 16 System Node 2 18 20 C 13 4 3 Storage Enclosure Basic 3 13 10 C 13 1 06 System Interconnect 1 12 0 9 69 Total Branch XY Plug Current A Compon...

Page 206: ...2 System Node 2 18 20 C 13 1 06 System Interconnect 1 12 0 10 55 Total Branch XY Plug Current A Component Port Time on s C 13 2 02 System Expansion Node 1 8 30 C 13 1 15 Storage Node 1 5 40 C 13 4 3 S...

Page 207: ...re configured to support VT100 ANSI The serial port also requires the following settings Branch ZX Plug Current A Component Port Time on s C 13 2 02 System Expansion Node 3 28 30 C 13 1 15 Storage Nod...

Page 208: ...the following default settings IP Address 192 168 1 254 Subnet Mask 255 255 255 0 Gateway 192 168 1 1 Configure a PC Ethernet port with a static IP address in the range 192 168 1 2 253 to enable commu...

Page 209: ...SED15 set outlet name AA16 CSN3 set outlet name AA17 UNUSED17 set outlet name AA18 SN2 set outlet name AA19 SEN2 set outlet name AA20 UNUSED20 set outlet name AA21 UNUSED21 set outlet name AA22 TORSW2...

Page 210: ...staticfallback disabled reboot ALL PDU 2 show system show units set unit name A PDU 2 set access prompt Switched CDU set outlet name AA1 UNUSED1 set outlet name AA2 MSW set outlet name AA3 SN1 set ou...

Page 211: ...3 0 set outlet extondelay AA14 0 set outlet extondelay AA15 40 set outlet extondelay AA16 0 set outlet extondelay AA17 60 set outlet extondelay AA18 20 set outlet extondelay AA19 30 set outlet extonde...

Page 212: ...outlet name AA27 UNUSED27 set outlet name AA28 SEN3 set outlet name AA29 UNUSED29 set outlet name AA30 UNUSED30 set outlet extondelay AA1 0 set outlet extondelay AA2 0 set outlet extondelay AA3 10 se...

Page 213: ...dhcp staticfallback disabled reboot ALL 14 7 Programming the System Interconnects After cabling the System Expansion Nodes log into the System Interconnect and open ports 38 for System Expansion Node...

Page 214: ...stem Interconnect command prompt appears 4 Log in using the default credentials User name admin no password 5 Type enable to enter the Privileged EXEC command mode 6 Type configure to enter the Privil...

Page 215: ...ps for adding a System Expansion Node kit Before following these steps complete the hardware steps in the ActiveScale X100 Installation Guide You can add one new System Expansion Node at a time to onl...

Page 216: ...Expansion Node job is running 1 Start the system expansion wizard Important On multi site deployments log into the GUI from the on each sites System Node to initiate the wizard g In the System Expans...

Page 217: ...tem Expansion Node wizard starts ActiveScale OS disables the DHCP server on the System Nodes and scans for the new System Expansion Node s link local IP addresses If the wizard indicates that no Syste...

Page 218: ...th octet of the new system s Public Network IP addresses System Network addresses are carried forward from the existing system s so you cannot change them 3 Click Next to review inputs Important On mu...

Page 219: ...t until the System Expansion job indicates success or failure The Jobs page displays the progress of the System Expansion job Figure 14 11 System Expansion Node Job progress If the System Expansion No...

Page 220: ...see the new system node and check the dashboard to confirm that the new system node is displayed in the Resources tile with the correct name For example for a multi site deployment System Expansion No...

Page 221: ...xpansion Node Confirmation on Resources pane 7 If you are using NFS client failover assign a virtual IP address to the new System Expansion Node For more information see the ActiveScale OS Administrat...

Page 222: ...e 223 Hard disk drive specifications on page 224 Management Interconnect specifications on page 226 PDU specifications on page 227 Rack specifications on page 228 Solid state drive specifications on p...

Page 223: ...ase 3 configuration typical max 4 45 5 34 kW Base 4 configuration typical max 5 1 6 02 kW Base 5 configuration typical max 5 75 6 7 kW Full Base 6 configuration typical max 6 4 7 4 kW System Expansion...

Page 224: ...lumn of populated sleds 19 59 22 91 KBTU h Full configuration base 6 seven columns of populated sleds 21 83 25 25 KBTU h System Expansion Node kit 1 0 665 to 0 785 KBTU hour Weight Minimum system weig...

Page 225: ...swappable No Operating relative humidity 5 to 95 non condensing Operating temperature 0 C to 70 C 32 F to 158 F internal Quantity 14 per sled 98 per Storage Enclosure Basic Replacement part number 1E...

Page 226: ...idual Management Interconnect Condition Specification Model Quantum Corporation Ultrastar HD HC500 Capacity 14 TB Dimensions Width 4 0 0098 in 101 6 0 25 mm Depth 5 78 147 mm Height 1 02 in 26 1 mm Ho...

Page 227: ...Yes Yes Yes Yes Quantity per system 2 2 2 2 Plug standard NEMA L15 30P NEMA L21 30P IEC 60309 16A 4P E IEC 60309 32A 4P E Outlet standard NEMA L15 30R NEMA L21 30R IEC 60309 16A 4P E IEC 60309 32A 4P...

Page 228: ...supply cord s must be plugged into socket outlet s that is are provided with a suitable earth ground The power supply cord s is are the main disconnect device to AC power The socket outlet s must be...

Page 229: ...d rear doors are shipped with the system Power cord route management The systems power cord can be routed through the top or the bottom The standard route for the system s power cord is through the to...

Page 230: ...80 GB Dimensions Width 2 75 in 69 85 mm Depth 3 94 in 100 2 mm Height 0 282 7 17 mm Hot swappable Yes1 1 Only hot swappable after decommissioning Operating relative humidity 5 to 95 non condensing Ope...

Page 231: ...um Temperature de rating 33 8 F per 984 2 ft above 9842 5 ft 1 C per 300 m above 3000 m Temperature gradient 68 F 20 C hour Weight per component 236 lbs 107 kg Weight total for all Storage Enclosure B...

Page 232: ...bs 9 kg Weight total for all System Interconnects 40 lbs 18 kg Condition Specification Dimensions Width 17 2 in 438 mm Depth 29 2 in 741 6 mm Height 1 73 in 44 mm Hot swappable No Operating relative h...

Page 233: ...fasteners The following list is the recommended torque of the machined fasteners being used during replacement or installation of ActiveScale X100 components Table 16 21 Recommended torque of machine...

Page 234: ...ActiveScale OS X100 Rackless Installation Guide 234...

Page 235: ...ot using the Quantum Corporation supplied cables 17 1 Adjusting the cord retention bale Note It is assumed that the PSU is not installed into the I O module during this adjustment Note Ensure that you...

Page 236: ...holes Position one located at the top and position five located at the bottom Figure 17 17 Adjustment holes for cord retention bale 4 Press both sides and insert the arms into the matching set of hole...

Page 237: ...l the PSU into the I O module plug in an approved power cord The molding on non approved power cords may not fully seat into the PSU 7 Verify that the approved power code fits with the new location of...

Page 238: ...ActiveScale OS X100 Rackless Installation Guide 238...

Page 239: ...osure Basic The following table displays the list of alternate SAS cables approved by Quantum Corporation for the Storage Enclosure Basic Table 18 22 Approved power cables Type Part number Dimension C...

Page 240: ...ActiveScale OS X100 Rackless Installation Guide 240...

Page 241: ...o the user s own rack mounting solution and does not come installed in an Quantum Corporation rack Therefore this section describes what is required of a rack mounting solution in order to accommodate...

Page 242: ...e system can be grounded safely and that the rack itself can also be grounded safely Use the following table to make determinations about your rack mounting solution 19 2 Airflow considerations Ensure...

Page 243: ...40 F to 150 8 F 10 C to 35 C 50 F to 95 F Temperature de rating 1 C per 300m above 3000 1 C per 300m above 950m Thermal output N A Partial configuration One column populated sleds 2 6 3 4 KVA 2 5 3 3...

Page 244: ...ActiveScale OS X100 Rackless Installation Guide 244...

Page 245: ...ous requirements on page 248 Example configurations on page 249 As a reference the following PDUs have been qualified for use with ActiveScale X100 Note Multiple PDUs are required based on the expecte...

Page 246: ...inal 50Hz or 60Hz Operating range 47 63Hz Table 20 29 Output connectors outlets Compliant to IEC 60320 Type C13 preferred or C19 All cables provided are C13 to C14 Quantity 18 may vary depending on co...

Page 247: ...ld be uniform in quality and free from defects that adversely affect life serviceability performance or appearance Short circuit protection line to ground The PDU should be able to withstand a line to...

Page 248: ...us spike in current is drawn that is sometimes several times its normal full load current This is called inrush current While inrush current might only last for microseconds it can still pose a risk t...

Page 249: ...Safety The PDU used shall comply with the safety standards of the country that rack is installed in 20 4 2 Electromagnetic compatibility The PDU used shall comply with the Electromagnetic Compatibili...

Page 250: ...able 20 35 Input connector and wiring Input wire connections 3P PE 3 poles plus protective Earth 4 wire Input plug compliant to NEMA L15 30P Input plug color code N A Input plug ground socket position...

Page 251: ...ActiveScale OS X100 Rackless Installation Guide 251 Height 70 5 in 1791 mm Depth 2 2 in 55 mm Weight 18 lbs 8 2 kg Table 20 39 Dimensions and weights continued...

Page 252: ...Earth 4 wire Input plug compliant to IEC 60309 1 IEC 60309 2 Input plug color code Blue rated operating voltage of 200 to 250 Input plug ground socket position 3 hour position mates with female in 9...

Page 253: ...ActiveScale OS X100 Rackless Installation Guide 253 Height 70 5 in 1791 mm Depth 2 2 in 55 mm Weight 18 lbs 8 2 kg Table 20 46 Dimensions and weights continued...

Page 254: ...Input wire connections 4P PE 4 poles plus protective Earth 5 wire Input plug compliant to IEC 60309 1 IEC 60309 2 Input plug color code Red rated operating voltage of 380V to 415V L L Input plug grou...

Page 255: ...ActiveScale OS X100 Rackless Installation Guide 255 Height 70 5 in 1791 mm Depth 2 2 in 55 mm Weight 18 lbs 8 2 kg Table 20 53 Dimensions and weights continued...

Page 256: ...20 56 Input connector and wiring Input wire connections 2P PE 2 poles plus protective Earth 3 wire Input plug compliant to NEMA L6 30P Input plug color code N A Input plug ground socket position N A I...

Page 257: ...ActiveScale OS X100 Rackless Installation Guide 257 Height 69 in 1753 mm Depth 2 25 in 57 mm Weight 18 lbs 8 2 kg Table 20 60 Dimensions and weights continued...

Page 258: ...put wire connections 2P PE 2 poles plus protective Earth 3 wire Input plug compliant To IEC 60309 1 IEC 60309 2 Input plug color code Blue rated operating voltage of 200V to 250V L N Input plug ground...

Page 259: ...ActiveScale OS X100 Rackless Installation Guide 259 Height 69 in 1753 mm Depth 2 25 in 57 mm Weight 18 lbs 8 2 kg Table 20 67 Dimensions and weights continued...

Page 260: ...ActiveScale OS X100 Rackless Installation Guide 260...

Page 261: ...second System Interconnect in the system and 12 refers to the port the cable is being connected to in System Interconnect 2 Figure 21 19 Cable label The cable labels contain a two letter identifier fo...

Page 262: ...ActiveScale OS X100 Rackless Installation Guide 262 Figure 21 20 Components and port identification...

Page 263: ...ActiveScale OS X100 Rackless Installation Guide 263 Figure 21 21 ActiveScale X100 cable wiring key...

Page 264: ...ActiveScale OS X100 Rackless Installation Guide 264...

Page 265: ...r further assistance contact the Quantum Contact Support Center Region Support Contact North America 1 800 284 5101 toll free 1 720 249 5700 EMEA 1 800 7826 8888 toll free 49 6131 324 185 Asia Pacific...

Reviews: