manualshive.com logo in svg

Qsan AegisSAN LX Series, Руководство пользователя

Продукция Qsan AegisSAN LX Series предлагает высококачественные хранилища данных с интуитивным интерфейсом. Для ознакомления с настройкой и использованием устройства доступны бесплатные инструкции по эксплуатации на manualshive.com. Скачайте свой руководство пользователя сейчас и начните использовать свой AegisSAN с уверенностью.

Поделиться
Скачать
background image

 

 
 

 

 

 

93

 

 

Copyright@2004~2014 Qsan Technology, Inc. All Rights Reserved.

 

 

Qsan Document – User Manual 

Active Sessions 

The

  Active  Session

  tab  is  used  to  display  all  currently  active  iSCSI  sessions  and  their  connection 

information. The various controllers support different number of sessions, list on the following: 

 

AegisSAN Q500: 

 

Q500-P10:

 Up to 256 sessions per controller. 

 

Q500-P20:

 Up to 256 sessions per controller. 

 

Q500-P21:

 Up to 256 sessions per controller. 

 

Q500-F20:

 Up to 64 sessions per controller. 

 

Q500-F21:

 Up to 64 sessions per controller. 

 

Q500-F30:

 Up to 64 sessions per controller. 

 

AegisSAN V100: 

 

V100-P10:

 Up to 256 sessions per controller. 

 

V100-P20:

 Up to 256 sessions per controller. 

 

V100-F30:

 Up to 64 sessions per controller. 

 

AegisSAN LX: 

 

P400Q:

 Up to 1024 sessions per controller. 

 

P600Q:

 Up to 1024 sessions per controller. 

 

F600Q:

 Up to 128 sessions per controller. 

 

F630Q:

 Up to 128 sessions per controller. 

 

 

 

This  table  shows  the  column  descriptions.  Most  of  the  options  are  standard  parameters  used  in 

the negotiation between the initiator and target when an iSCSI connection is created. 

 

Column Name 

Description 

TSIH 

TSIH (Target Session Identifying Handle) is used for this active session. 

Initiator Name 

It displays the host computer name. 

Target Name 

It displays the controller name. 

InitialR2T 

InitialR2T (Initial Ready to Transfer) is used to turn off either the use of a 
unidirectional  R2T  command  or  the  output  part  of  a  bidirectional 
command. The default value is Yes. 

Immed. data 

Immed.  data  (Immediate  Data)  sets  the  support  for  immediate  data 
between  the  initiator  and  the  target.  Both  must  be  set  to  the  same 
setting. The default value is Yes. 

MaxDataOutR2T 

MaxDataOutR2T  (Maximum  Data  Outstanding  Ready  to  Transfer) 

Содержание AegisSAN LX Series

Страница 1: ...Qsan Document User Manual AegisSAN Q500 Series AegisSAN V100 Series AegisSAN LX Series JBOD Series Version 8 52 October 2014 ...

Страница 2: ...irmware Versions AegisSAN Q500 P10 P20 P21 F20 F21 F30 Series FW 1 3 0 AegisSAN V100 P10 P20 F30 Series FW 1 1 1 AegisSAN LX P400Q P600Q F600Q F630Q Series FW 3 4 0 JBOD J100 J300Q Series FW 1 7 1 Storage Service Provider V2 0 6 TIP AegisSAN V100 series is not support QReplica fast rebuild SSD caching and performance monitor features Login Information Management IP Address 192 168 1 234 User Name ...

Страница 3: ...rage concepts and network technology It also assumes you have basic knowledge of Redundant Array of Independent Disks RAID Storage Area Network SAN Fibre Channel FC Internet SCSI iSCSI Serial attached SCSI SAS Serial ATA SATA technology CAUTION Do not attempt to service change disassemble or upgrade the equipment s components by yourself Doing so may violate your warranty and expose you to electri...

Страница 4: ... indicates that you can choose a b or nothing braces Indicates required or expected values Example a b indicates that you must choose either a or b vertical bar Indicates that you have a choice between two or more options or arguments Slash Indicates all options or arguments underline Indicates the default value Example a b FCC and CE statements FCC Statement This device has been shown to be in co...

Страница 5: ...t overloading of the circuits might have on overcurrent protection and supply wiring Appropriate consideration of equipment nameplate ratings should be used when addressing this concern 5 Reliable Earthing Reliable earthing of rack mounted equipment should be maintained Particular attention should be given to supply connections other than direct connections to the branch circuit e g use of power s...

Страница 6: ...REMPLACÉE PAR UNE BATTERIE DE TYPE INCORRECT METTRE AU REBUT LES BATTERIES USAGÉES CONFORMÉMENT AUX INSTRUCTIONS VORSICHT German Explosionsgefahr bei unsachgemaßem Austausch der Batterie Entsorgung gebrauchter Batterien nach Anleitung ADVERTENCIA Spanish Las baterí as pueden explotar si no se manipulan de forma apropiada No desmonte ni tire las baterí as al fuego Siga las normativas locales al des...

Страница 7: ...W 12 Model Comparison 13 Package Contents 15 HARDWARE 16 Front View 17 Disk Drive Assembly 22 3TB 6G MUX Board Limitation 26 Rear View 27 RAID CONCEPTS 39 RAID Levels 39 Volume Relationship 40 FIBRE CHANNEL CONCEPTS 40 ISCSI CONCEPTS 41 SAS CONCEPTS 42 Chapter 2 INSTALLATION 44 INSTALLATION OVERVIEW 44 Drive Slot Numbering 45 System Installation and Deployment 46 POWER ON OFF 60 Power on the Syste...

Страница 8: ...SYSTEM CONFIGURATION 79 System Settings 79 Network Settings 80 Login Settings 81 Email Notification Settings 82 Log and Alert Settings 83 HOST PORT ISCSI CONFIGURATION 85 Network Setup 85 Entity and iSCSI Settings 89 iSCSI Nodes 89 Active Sessions 93 CHAP Accounts 94 Fibre Channel 95 VOLUME CONFIGURATION 98 Physical Disks 98 RAID Groups 100 Virtual Disks 105 Snapshots 109 Logical Units 112 QReplic...

Страница 9: ...Fibre Channel 129 Chapter 5 ADVANCED OPERATIONS 130 VOLUME REBUILD 130 MIGRATE AND MOVE RAID GROUPS 131 EXTEND VIRTUAL DISKS 133 QTHIN 134 The Benefits of QThin 135 Features Highlight 136 QThin Options 138 Thin Provisioning Case 139 DISK ROAMING 140 JBOD EXPANSION 140 Connecting JBOD 140 Upgrade Firmware 142 MPIO AND MC S 142 MPIO 142 MC S 143 Difference 144 TRUNKING AND LACP 144 LACP 144 Trunking...

Страница 10: ...ar Clone 157 Clone Constraint 157 QREPLICAS 158 Create QReplica Task 159 Start and Stop QReplica Task 162 MPIO 162 MC S 163 Task Shaping 163 Schedule QReplica Task 164 QReplica Options 165 Delete QReplica Task 166 Clone Transfers to QReplica 166 FAST REBUILD 169 Solution 169 Configuration 170 Constraint 170 SSD CACHING 171 Solution 171 Methodology 171 Populating the Cache 172 Read Write Cache Case...

Страница 11: ...IFICATIONS 178 Chapter 7 SOFTWARE APPLICATION 188 MICROSOFT ISCSI INITIATOR 188 Connect to iSCSI Target 188 Setup MPIO 189 Setup MC S 190 Disconnect 192 MICROSOFT VSS 193 lntroduction 193 Software Contents 193 Install MPIO VSS Software 193 Using QVSSClient 196 GLOSSARY AND ACRONYM LIST 199 INDEX 201 ...

Страница 12: ...This user manual describes how to set up and use the Qsan storage systems There are several types of chassis available now AegisSAN Q500 Series AegisSAN Q500 2U12bays AegisSAN Q500 3U16bays AegisSAN Q500 4U24bays AegisSAN V100 Series and JBOD J100 Series AegisSAN V100 and J100 3U16bays AegisSAN V100 and J100 4U24bays ...

Страница 13: ...agement features Model Comparison Qsan storage system AegisSAN Q500 XXX Xxxx AegisSAN V100 XXX Xxxx and AegisSAN LX XXXXQ Xxxx stands for the following models AegisSAN Q500 XXX stands for front end interfaces Q500 P10 6 x GbE iSCSI ports per controller Q500 P20 2 x 10GbE iSCSI ports SFP 2 x GbE iSCSI ports per controller Q500 P21 2 x 10GbE iSCSI ports 10GBASE T 2 x GbE iSCSI ports per controller Q...

Страница 14: ...212 224 316 424 460 212 2U 12 bays with 3 5 HDD trays 224 2U 24 bays with 2 5 HDD trays 316 3U 16 bays with 3 5 HDD trays 424 4U 24 bays with 3 5 HDD trays 460 4U 60 bays with 3 5 HDD trays AegisSAN Q500 Series Host Interface 2U12 3U16 4U24 6 x GbE iSCSI Q500 P10 D212 Q500 P10 S212 Q500 P10 D316 Q500 P10 S316 Q500 P10 D424 Q500 P10 S424 2 x 10GbE iSCSI SFP 2 x GbE iSCSI Q500 P20 D212 Q500 P20 S212...

Страница 15: ...Q D316 F600Q S316 F600Q D424 F600Q S424 F600Q D460 F600Q S460 2 x 16Gb FC SFP 2 x GbE iSCSI F630Q D212 F630Q S212 F630Q D316 F630Q S316 F630Q D424 F630Q S424 N A JBOD Series Host Interface 2U12 2U24 3U16 4U24 4U60 6G SAS JBOD N A N A J100 C316 J100 C424 N A 6G SAS JBOD J300Q D212 J300Q C212 J300Q D224 J300Q C224 J300Q D316 J300Q C316 J300Q D424 J300Q C424 J300Q D460 J300Q C460 The dual controller ...

Страница 16: ...Rail kit x1 set Keys screws for drives and rail kit x1 packet Disk tool x1 4U60 Hardware This section provides basic information about the hardware components AegisSAN Q500 Series AegisSAN Q500 2U12bays AegisSAN Q500 3U16bays AegisSAN Q500 4U24bays AegisSAN V100 Series and JBOD J100 Series AegisSAN V100 and J100 3U16bays AegisSAN V100 and J100 4U24bays AegisSAN LX Series and JBOD J300Q Series Aegi...

Страница 17: ...t handle a LCM with the USB interface at the left front handle Number Description 1 USB port This is designed specifically for USB LCM usage It DOES NOT offer external USB storage function 2 Access LED This indicates the host interface frontend connectivity not the hard drive activity Please be aware Blink There is host interface activity data I O or management OFF There is no host interface activ...

Страница 18: ...8 1 234 User Name admin Password 1234 USB LCM comes as an optional device to Q500 series The standard SKU doesn t include USB LCM Both the USB port on the front left handle and the USB port on the controller itself support LCM function However the USB port doesn t support external USB storage function Number Description 1 LCD display 2 Up button 3 Down button 4 ENT Enter button 5 ESC Escape button...

Страница 19: ... default settings The default resets include Management IP Address 192 168 1 234 User Name admin Password 1234 4 Status LED Red System failure Off System OK 5 Access LED This indicates the host interface frontend connectivity not the hard drive activity Please be aware Blink There is host interface activity data I O or management OFF There is no host interface activity AegisSAN LX Series and JBOD ...

Страница 20: ...F 8 Status LED Red System failure Off System OK 9 Access LED Blue Host is accessing storage system Off No host access attempts AegisSAN LX Series and J300Q Series 4U60 CAUTION When powering off the subsystem press the Main Switch for 4 seconds and allow at least 3 minutes during which each disk slot starting from slot 1 until slot 60 will be powered down for the subsystem to shutdown properly Then...

Страница 21: ... Indicates the drive in this slot is faulty Blinking Red Indicates the drive in this slot is rebuilding Off Indicates there is no drive in this slot 3 Expander module Fault LED Red Indicates the Expander module is faulty Off Indicates the Expander module is normal There are four buttons to control LCM LCD Control Module including up down V Select and EXIT Escape This table shows the items located ...

Страница 22: ... and alarm will sound Off Temperature OK 11 Voltage Warning LED Red If the output DC voltage is above or below the allowed range an alarm will sound warning of a voltage abnormality and this LED will turn red Off Voltage OK 12 Activity LED Blinking blue When the disk array is busy or being accessed Off Idle Disk Drive Assembly AegisSAN Q500 Series AegisSAN LX Series and JBOD J300Q Series 2U12 3U16...

Страница 23: ...y 2 Access LED Blue blinking The drive is being accessed Off The drive is not being accessed or no drive in the tray 3 Tray removal handle 4 Latch to release the tray AegisSAN V100 Series and JBOD J100 Series 3U16 4U24 The front of each disk tray has four components This table provides details about the front components of a disk tray Number Description 1 Power LED Green Drive is inserted and good...

Страница 24: ...ff The drive is not being accessed or no drive in the tray 3 Tray removal handle 4 Latch to release the tray and tray lock AegisSAN LX Series and JBOD J300Q Series 4U60 1 Prepare the HDD side brackets Remove them from the dummy disk by pushing the upper sides of the dummy disk as shown below ...

Страница 25: ...d Qsan Document User Manual 2 Place the brackets on both sides of the disk drive and secure them with screws 3 Place the slotted flat head screw 4 Place the drive carefully in the disk slot 5 Fix the disk drive using the disk tool that is included in the package ...

Страница 26: ...All Rights Reserved Qsan Document User Manual 6 Repeat the same steps for the rest of the disks TIP You can use also the disk tool to remove the disk drive in the disk slot 3TB 6G MUX Board Limitation AegisSAN Q500 Series and AegisSAN LX Series ...

Страница 27: ... MUX Board SATA 3TB 2794 GB 2794 GB SATA 6Gb s SATA 6Gb s SATA 3Gb s SATA 3Gb s SATA 6Gb s SATA 3Gb s SATA 1 5Gb s SATA 6Gb s SATA 1 5Gb s Without MUX Board SAS 3TB 2794 GB SAS 6Gb s SAS 6Gb s SAS 3Gb s SAS 3Gb s Rear View There are several various chassis available The following examples show the AegisSAN Q500 P10 AegisSAN V100 P10 and AegisSAN LX P400Q series AegisSAN Q500 2U12 chassis This tabl...

Страница 28: ...logy Inc All Rights Reserved Qsan Document User Manual 6 Power Supply Unit PSU1 7 Power Supply Unit PSU2 8 Power Supply Unit PSU3 9 Fan Module FAN A 10 Fan Module FAN B 11 SAS JBOD expansion port AegisSAN Q500 3U16 chassis 4 3 5 7 1 6 2 ...

Страница 29: ...right 2004 2014 Qsan Technology Inc All Rights Reserved Qsan Document User Manual AegisSAN Q500 4U24 chassis AegisSAN V100 3U16 chassis AegisSAN V100 4U24 chassis 4 5 7 1 6 2 7 10 9 6 1 7 11 4 10 9 6 1 7 11 4 ...

Страница 30: ...Copyright 2004 2014 Qsan Technology Inc All Rights Reserved Qsan Document User Manual AegisSAN LX 2U12 chassis AegisSAN LX 3U16 chassis AegisSAN LX 4U24 chassis 4 5 7 1 3 6 2 2 6 7 5 1 4 3 4 5 8 1 3 7 6 2 ...

Страница 31: ...ch ON O OFF 4 Power Supply Unit PSU1 and Fan Module FAN1 5 Power Supply Unit PSU2 and Fan Module FAN2 6 Power Supply Unit PSU3 and Fan Module FAN3 7 Fan Module FAN4 FAN5 8 Fan Module FAN6 FAN7 9 Expander Module A1 single controller Expander Module B1 only for dual controller 10 Expander Module A2 single controller Expander Module B2 only for dual controller 11 Fan Module FAN8 12 Fan Module FAN9 13...

Страница 32: ...logy Inc All Rights Reserved Qsan Document User Manual There are many various controllers available With the exception of the host SAN ports the connections are the same on all modules 13 Fan10 14 Fan11 11 Fan8 12 Fan9 10 A2 B2 9 A1 B1 ...

Страница 33: ... x 16Gb Fibre Channel ports 6 x GbE iSCSI ports AegisSAN LX F600Q 4 x 8Gb Fibre Channel ports 2 x GbE iSCSI ports F630Q 2 x 16Gb Fibre Channel ports 2 x GbE iSCSI ports P400Q 6 x GbE iSCSI ports P600Q 2 x 10GbE iSCSI ports 2 x GbE iSCSI ports 2 LED from left to right for 4U24 3U16 chassis from right to left for 2U12 chassis Controller health LED Green Controller status normal Red System booting or...

Страница 34: ...eive activity Red Asserted when the link can t establish 8G FC Link LED AegisSAN Q500 F21 AegisSAN LX F600Q Blue Asserted when an 8G link is established and maintained Yellow Asserted when a 4G link is established and maintained Blinking yellow Asserted when a 2G link is established and maintained 8G FC Access fail LED AegisSAN Q500 F21 AegisSAN LX F600Q Green Asserted when the link is establish B...

Страница 35: ...nk is established and packets are being transmitted along with any receive activity CAUTION Be aware that when Controller Health LED is in RED please DO NOT unplug the controller from the system or turn off the power suddenly This may cause unrecoverable damage which will not be covered by warranty AegisSAN Q500 P20 2 x 10GbE iSCSI SFP 2 x GbE iSCSI controller AegisSAN Q500 P21 2 x 10GbE iSCSI 10G...

Страница 36: ... Manual AegisSAN Q500 F20 2 x 8G FC SFP 2 x GbE iSCSI controller AegisSAN Q500 F30 2 x 16G FC SFP 2 x GbE iSCSI controller AegisSAN Q500 F21 4 x 8G FC SFP 2 x GbE iSCSI controller AegisSAN V100 P10 6 x GbE iSCSI controller 4 1 6 5 7 2 5 6 7 4 3 1 9 5 6 7 4 2 3 1 9 5 6 7 8 4 2 3 1 9 ...

Страница 37: ...ll Rights Reserved Qsan Document User Manual AegisSAN V100 P20 2 x 10GbE iSCSI SFP 6 x GbE iSCSI controller AegisSAN V100 F30 2 x 16G FC SFP 6 x GbE iSCSI controller AegisSAN LX P400Q 6 x GbE iSCSI controller 5 6 7 8 4 2 3 1 9 4 1 6 5 7 4 1 6 5 7 ...

Страница 38: ...0Q 2 x 10GbE iSCSI SFP 2 x GbE iSCSI controller AegisSAN LX P600Q 2 x 10GbE iSCSI 10GBASE T 2 x GbE iSCSI controller AegisSAN LX F600Q 4 x 8Gb FC SFP 2 x GbE iSCSI controller AegisSAN LX F630Q 2 x 16Gb FC SFP 2 x GbE iSCSI controller 5 6 7 8 4 2 3 1 9 5 6 7 4 2 3 9 8 1 5 6 7 8 4 2 3 1 9 5 6 7 8 4 2 3 1 9 ...

Страница 39: ...pacity and reliability than a single drive The operating system detects the RAID drive as a single storage device RAID Levels There are various RAID levels with different degrees of data protection data availability and performance A description of supported RAID levels follow Type Description Min No of Drives RAID 0 Disk striping 1 RAID 1 Disk mirroring over two disks 2 N way mirror Extension to ...

Страница 40: ...s the volume structure which Qsan has designed It describes the relationship of RAID components One RG RAID group consists of a set of VDs Virtual Disk and owns one RAID level attribute Each RG can be divided into several VDs The VDs in one RG share the same RAID level but may have different volume capacity All VDs share the CV Cache Volume to execute the data transaction LUN Logical Unit Number i...

Страница 41: ...des high performance SANs over standard IP networks like LAN WAN or the Internet IP SANs are true SANs Storage Area Networks which allow several servers to attach to an infinite number of storage volumes by using iSCSI over TCP IP networks IP SANs can scale the storage capacity with any type and brand of storage system In addition it can be used by any type of network Ethernet Fast Ethernet Gigabi...

Страница 42: ...lf or an appliance which controls and serves volumes or virtual volumes The target is the device which performs SCSI command or bridge to an attached storage device SAS Concepts Serial attached SCSI offers advantages over older parallel technologies The cables are thinner and the connectors are less bulky Serial data transfer allows the use of longer cables than parallel data transfer The target i...

Страница 43: ...43 Copyright 2004 2014 Qsan Technology Inc All Rights Reserved Qsan Document User Manual SAS device 1 target Host initiator SAS HBA ...

Страница 44: ...es V100 P20 F30 Fibre Channel cables or AOCs Active Optic Cable AegisSAN LX P400Q CAT 5e or CAT 6 recommend network cables P600Q 10GBASE T CAT 6 network cables P600Q SFP F600Q F630Q Fibre Channel cables or AOCs Active Optic Cable JBOD J100 J300Q SAS cables Prepare a storage system configuration plan by the network administrator The plan should include network information for the management port an...

Страница 45: ...l F600Q F630Q Fibre Channel switches optional CHAP security information including CHAP username and secret optional For dual controller systems it is recommended that the host logon to the target twice both Controller 1 and Controller 2 and then the MPIO should setup automatically For an iSCSI dual controller system install an iSNS server on the same storage area network recommended Drive Slot Num...

Страница 46: ...0 56 52 48 45 42 38 34 30 26 22 18 15 12 8 4 TIP Install at least one drive in Slot 1 to 4 marked gray slots System event logs are saved in these drives Otherwise event logs no longer exist after a reboot System Installation and Deployment AegisSAN Q500 Series Using the following instructions to install and deploy the storage system Install BBM Battery Backup Module for AegisSAN Q500 series models...

Страница 47: ... it back to PSU and secure the bracket with screws Plug it in the chassis CAUTION Please do not touch the golden finger of the PSU when the BBM is connected AegisSAN Q500 3U16 and 4U24 chassis For 3U16 and 4U24 models BBM module is located between two controller cages BBM module is inserted into the system chassis and connected to the backplane Release the screws Plug in the BBM And then secure th...

Страница 48: ... memory slot Failing to do so will result in controller malfunction which will not be covered by warranty Install the Rail Kit onto the unit and insert it into the rack CAUTION The system is very heavy It s recommend that a mechanical lifter or at least two persons be used to raise and align the system to prevent injury during installation Use care when inserting or removing a system into or out o...

Страница 49: ...49 Copyright 2004 2014 Qsan Technology Inc All Rights Reserved Qsan Document User Manual AegisSAN Q500 P10 AegisSAN Q500 P20 ...

Страница 50: ...50 Copyright 2004 2014 Qsan Technology Inc All Rights Reserved Qsan Document User Manual AegisSAN Q500 P21 AegisSAN Q500 F20 F30 ...

Страница 51: ...ck CAUTION The system is very heavy It s recommend that a mechanical lifter or at least two persons be used to raise and align the system to prevent injury during installation Use care when inserting or removing a system into or out of a rack to prevent the accidental tipping or the rack causing damage or personal injury Install the Disk Drives Connect the management port cable and data port cable...

Страница 52: ...52 Copyright 2004 2014 Qsan Technology Inc All Rights Reserved Qsan Document User Manual AegisSAN V100 P10 AegisSAN V100 P20 ...

Страница 53: ...san Document User Manual AegisSAN V100 F30 AegisSAN LX Series Using the following instructions to install and deploy the storage system Install the BBM Battery Backup Module in their appropriate controllers if needed The following examples show the AegisSAN LX F600Q ...

Страница 54: ...controllers have the same DIMM on each corresponding memory slot Failing to do so will result in controller malfunction which will not be covered by warranty Install the Rail Kit onto the unit and insert it into the rack CAUTION The system is very heavy It s recommend that a mechanical lifter or at least two persons be used to raise and align the system to prevent injury during installation Use ca...

Страница 55: ...55 Copyright 2004 2014 Qsan Technology Inc All Rights Reserved Qsan Document User Manual AegisSAN LX P400Q AegisSAN LX P600Q ...

Страница 56: ...56 Copyright 2004 2014 Qsan Technology Inc All Rights Reserved Qsan Document User Manual AegisSAN LX F600Q AegisSAN LX F630Q ...

Страница 57: ...ack CAUTION The system is very heavy It s recommend that a mechanical lifter or at least two persons be used to raise and align the system to prevent injury during installation Use care when inserting or removing a system into or out of a rack to prevent the accidental tipping or the rack causing damage or personal injury Install the Disk Drives Connect SAS cable to the head unit the topology exam...

Страница 58: ...rved Qsan Document User Manual JBOD J300Q Dual controller topology For a better data service availability all the connections among hosts switches and the dual controllers are recommended as redundant as below The following example shows the AegisSAN LX P400Q ...

Страница 59: ...back color phone jack to DB9 female to connect from controller to management PC directly Using RS 232 cable for UPS gray color phone jack to DB9 male to connect from controller to APC Smart UPS serial cable DB9 female side and then connect the serial cable to APC Smart UPS CAUTION It may not work when connecting the RS 232 cable for UPS gray color phone jack to DB9 male to APC Smart UPS directly ...

Страница 60: ...s a few minutes AegisSAN Q500 AegisSAN V100 AegisSAN LX Series 2U12 3U16 4U24 The power switch is located at the rear of the panel To turn on the system you may press power switch to After you turn the power ON the system performs a booting process which takes a few minutes CAUTION Be aware that when Controller Health LED is in RED please DO NOT plug out the controller from the system or turn off ...

Страница 61: ...ll turn off 3 Shutdown using Power button The power button is located at the right front handle Forced shutdown press and hold for more than 4 seconds The power will be cut off immediately Graceful shutdown press one to initialize graceful shutdown Press 2nd time within 4 seconds to confirm and start graceful shutdown If there is no 2nd press within 4 seconds disable graceful shutdown and return t...

Страница 62: ... process completes the power LED will turn off AegisSAN LX Series 1 Shutdown using LCM At the LCM Power off the system using a normal shutdown Press ENT button Press down twice to show Reboot Shutdown and press ENT button Press down once to show Shutdown and press ENT button Press up once to highlight Yes and press ENT button System shutdown begins When the System Shutdown message is displayed tur...

Страница 63: ...o flow control Terminal Type vt100 The initial defaults for administrator login are Management IP Address 192 168 1 234 User Name admin Password 1234 Secure Shell Remote Access SSH secure shell software is required for remote login The SSH client software is available at the following web site SSH Tectia Client http www ssh com PuTTY http www chiark greenend org uk The default management IP addres...

Страница 64: ...r an error occurs Reset Shutdown Reset or shutdown the system Quick Install Provide quick steps to create a volume Volume Wizard Provide smart steps to create a volume View IP Setting Display current IP address subnet mask and gateway Change IP config Set IP address subnet mask and gateway There are 2 options DHCP Get IP address from DHCP server or static IP Enc Management Shows the enclosure data...

Страница 65: ... 3 RAID 5 RAID 6 RAID 0 1 New n disk nnn GB Adjust Volume Size Apply The Config Yes No View IP Setting IP Config Static IP DHCP BOOTP IP Address 192 168 001 234 IP Subnet Mask 255 255 255 0 IP Gateway xxx xxx xxx xxx Change IP Config DHCP Yes No BOOTP Yes No Static IP IP Address Adjust IP address IP Subnet Mask Adjust Submask IP IP Gateway Adjust Gateway IP Apply IP Setting Yes No Enc Management P...

Страница 66: ...system supports graphic user interface operation It supports most common web browsers Be sure to connect the LAN cable to the management port of the system The default management IP address is 192 168 1 234 255 255 255 0 please configure your computer IP address at the same subnet of the system e g 192 168 1 1 255 255 255 0 And then enter the IP address into your browser to display the authenticat...

Страница 67: ...he AegisSAN LX P400Q D212 Choose the functions from the Menu Bar on the left side of the window to make any configuration changes TIP The Host Port Configuration menu bar option is only visible when the controller has multiple interfaces The iSCSI Configuration menu bar option is only visible when the controller has iSCSI ports Menu Bar Options Indicators and Icons Operation Area ...

Страница 68: ... has failed Fan indicator Green Fan is working well Red Fan failed Power indicator Green Power supplies are connected and working well Red A power supply has failed or is no longer connected Dual controller indicator Green Dual controllers are active and working well Orange One of the dual controllers has failed Return to home page Logout of the management web UI Mute alarm beeper TIP If the statu...

Страница 69: ...k Installation Tool This tool guides you through the process of setting up basic array information configuring network settings and the creation of a volume on the storage system Please make sure that it has some free hard drives installed in the system SAS drivers are recommended 1 Click Quick Installation from the menu bar 2 Enter a System Name and set up the Date and Time Click Next button to p...

Страница 70: ...nology Inc All Rights Reserved Qsan Document User Manual 3 Confirm or change the management port IP address and DNS server If the default HTTP HTTPS and SSH port numbers are not allowed on your network they can be changed here as well ...

Страница 71: ...71 Copyright 2004 2014 Qsan Technology Inc All Rights Reserved Qsan Document User Manual 4 For iSCSI Configurations use this step to set up the data port iSCSI IP address and then click Next button ...

Страница 72: ...Manual 5 Choose a RAID Level The number in the brackets is the maximum capacity at the RAID level This step utilizes all drives in the storage system as well as any JBOD expansion arrays present This option allows the selection of the RAID type and the number of drives in each array ...

Страница 73: ...73 Copyright 2004 2014 Qsan Technology Inc All Rights Reserved Qsan Document User Manual 6 Verify all items and then click Finish button to complete the quick installation ...

Страница 74: ...nt RAID levels that can be created using the existing free drives It provides Largest capacity for each RAID level from which to choose The fewest number of drives for each RAID level volume size This way after choosing RAID level you may find that some drives are still available free status This phenomenon is the result of using smart design Take an example user chooses the RAID 5 level and the s...

Страница 75: ...capacity the volume size is larger and less drives 1 Click Volume Creation Wizard from the menu bar 2 Choose a RAID Level The number in the brackets is the maximum capacity at the RAID level 3 Select the default option Maximize the size of the RAID group or manual option Select the number of disks to use From the drop down list select either the RAID Group capacity combination desired Click Next b...

Страница 76: ...cument User Manual 4 Enter the Volume Size GB desired that is less than or equal to the default available size shown Then click Next button 5 Use LBA 64 support It depends on the operation system 6 Finally verify the selections and click Finish button if they are correct ...

Страница 77: ...77 Copyright 2004 2014 Qsan Technology Inc All Rights Reserved Qsan Document User Manual The volume is created and named by the system automatically It is available to use now ...

Страница 78: ...ange Portal Rename Alias Users Active Sessions Show information for Controller 1 Controller 2 Connection Details Disconnect CHAP Accounts Create User Options Modify User Information Delete User Fibre Channel This option is only visible when the controller has FC ports Show information for Controller 1 Controller 2 Clear All Counters Options Change Link speed Change Connection Mode Node Configurati...

Страница 79: ...wnload Mute Buzzer Clear Upgrade Controller Module Firmware Update JBOD Firmware Update Controller Mode SSD Caching License Firmware Synchronization This option is only visible when dual controllers are inserted Apply Reset to Factory Default Reset Configuration Backup Import or Export Import File Volume Restoration Options Restore Reboot and Shutdown Reboot Shutdown Reboot options Both Controller...

Страница 80: ...settings check Change Date and Time The changes can be done manually or synchronized from an NTP Network Time Protocol server System Identification Flash the status light on the front display for locating this system in the racks click OK button To Stop flashing the status light on the front display click OK button again When it is done click Apply button Network Settings The Network Settings tab ...

Страница 81: ...ion usage There are three options DHCP BOOTP and Specify a Static IP Address DNS Server Address If necessary the IP address of DNS server can be entered or changed here Service Ports If the default port numbers of HTTP HTTPS and SSH are not allowed on the network they can be changed here When it is done click Apply button Login Settings The Login Settings tab is used to control access to the stora...

Страница 82: ...tor password The maximum length of password is 12 alphanumeric characters Change User Password Check it to change user password The maximum length of password is 12 alphanumeric characters When it is done click Apply button Email Notification Settings The Email Notification Settings tab is used to enter up to three email addresses for receiving the event notifications Fill in the necessary fields ...

Страница 83: ... default setting only includes Warning and Error event logs When it is done click Apply button Log and Alert Settings The Log and Alert Settings tab is used to setup SNMP traps for alerting via SNMP pop up messages via Windows messenger not MSN or Skype alerts via the syslog protocol the pop up alerts and alerts on the front display The device buzzer is also managed here ...

Страница 84: ...are many SNMP tools available on the internet SNMPc http www snmpc com Net SNMP http net snmp sourceforge net Windows Messenger You must enable the Messenger service in Windows Start Control Panel Administrative Tools Services Messenger It allows up to three host addresses The same you can check the alert levels which you would like to receive System Server Settings Fill in the host address and th...

Страница 85: ... CHAP Account and Fibre Channel This option is only visible when the controller has Fibre Channel ports option tabs Network Setup The Network Setup tab is used to change IP addresses of iSCSI data ports The various controllers have different iSCSI ports list on the following AegisSAN Q500 Q500 P10 6 x GbE iSCSI ports per controller Q500 P20 2 x 10GbE iSCSI ports 2 x GbE iSCSI ports per controller ...

Страница 86: ...tic IP address For the other controllers that can be set up the same way The options are available on this tab iSCSI Bonding Settings The default mode of each iSCSI data port is individually connected without any bonding Trunking and LACP Link Aggregation Control Protocol settings can be setup here At least two iSCSI data ports must be checked for iSCSI bonding Trunking Configures multiple iSCSI p...

Страница 87: ...atches that of switch port If your network environment supports VLAN you can use this function to change the configurations Fill in VLAN ID and Priority settings to enable VLAN VLAN ID VLAN ID is a 12 bit number Its range is from 2 to 4094 while 0 1 and 4095 are reserved for special purposes Priority The PCP Priority Code Point is a 3 bit number and reserved for QoS The definition complies with IE...

Страница 88: ... maximum jumbo frame size is 3900 bytes To disable jumbo frames click Disable Jumbo Frames CAUTION VLAN ID jumbo frames for both the switching hub and HBA on host must be enabled Otherwise the LAN connection cannot work properly Ping host It can verify the port connection from a target to the corresponding host data port Input the host s IP address and click Start button The system will display th...

Страница 89: ...utton iSCSI Nodes The iSCSI Nodes tab is used to view the target name for iSCSI initiator The various controllers support different number of multiple nodes list on the following AegisSAN Q500 Q500 P10 Up to 64 multiple nodes per controller Q500 P20 Up to 64 multiple nodes per controller Q500 P21 Up to 64 multiple nodes per controller Q500 F20 Up to 32 multiple nodes per controller Q500 F21 Up to ...

Страница 90: ...t s a type of authentication in which the authentication server sends the client a key to be used for encrypting the username and password CHAP enables the username and password to transmit in an encrypted form for protection TIP A CHAP account must be added before you can use this authentication method Please refer to CHAP Accounts session to create an account if none exists To use CHAP authentic...

Страница 91: ...ck OK button To disable CHAP authentication please follow the procedures Select the node which wants to disable CHAP Chick Authentication Method Change it to None from the drop down list Click OK button Change Portal Use this iSCSI node option to change the network ports available Select one of nodes from one controller Chick Change Portal Select the network ports that you would like to be availab...

Страница 92: ... iSCSI alias Select one of nodes from one controller Chick Rename Alias Enter the Alias Name Leave it empty to remove the alias Click OK button After creating an alias it is displayed at the end of the portal information TIP After setting CHAP the host initiator should be set with the same CHAP account Otherwise the host cannot connect to the volume ...

Страница 93: ...ssions per controller P600Q Up to 1024 sessions per controller F600Q Up to 128 sessions per controller F630Q Up to 128 sessions per controller This table shows the column descriptions Most of the options are standard parameters used in the negotiation between the initiator and target when an iSCSI connection is created Column Name Description TSIH TSIH Target Session Identifying Handle is used for...

Страница 94: ...Data Units are transferred in continuously non decreasing sequence offsets The default value is Yes DataPDU InOrder DataPDU InOrder Data PDU in Order determines if the data PDUs within sequences are to be in order and overlays forbidden The default value is Yes The options are available on this tab Connection Details It can list all connection s of the selected session Disconnect Disconnect the se...

Страница 95: ...AP user information Delete User Delete the selected CHAP user Fibre Channel The Fibre Channel tab is used view the fibre channel information and change the link speed of FC It displays the Port ID Connection Mode Data Rate WWNN World Wide Node Name WWPN World Wide Port Name error count and the link status The options are available on this tab Clear All Counters Clear all counters of all fibre chan...

Страница 96: ... in a loop or ring similar to token ring networking Adding or removing a device from the loop causes all activity on the loop to be interrupted The failure of one device causes a break in the ring Fibre Channel hubs exist to connect multiple devices together and may bypass failed ports A loop may also be made by cabling each port to the next in a ring Fabric Switched Fabric FC SW All devices or lo...

Страница 97: ...t guaranteed Access to medium Dedicated Arbitrated Dedicated Reference from http en wikipedia org wiki Fibre_Channel Node Configuration Set the selected fibre channel for multi nodes configuration Check the nodes which can be accessed by the host Clear Counters Clear the counters of the selected fibre channel CAUTION The connection mode Point to Point does not support multi node ...

Страница 98: ...city of hard drive The unit can be displayed in GB or MB RAID Group RAID group name RAID Set The number of RAID Set N A The RAID group is traditional provisioning Number The RAID group is the number of RAID set of thin provisioning Virtual Disk Virtual disk name for SSD caching Status The status of the hard drive Online The hard drive is online Rebuilding The hard drive is being rebuilt Transition...

Страница 99: ...s and handle one by one The default value is Enabled The options are available on this tab Disk Health Check Check the health of the selected disks It cannot check the disks which are in used Disk Check Report Download the disk check report It s available after executing Disk Health Check Set Free Disk Make the selected hard drive be free for use Set Global Spare Set the selected hard drive to glo...

Страница 100: ... to create modify delete or view the status of the RAID groups Use the drop down list at the top to change the drive size units MB or GB Select the traditional RAID group it displays on the following This table shows the column descriptions Column Name Description Name RAID group name Total GB or MB Total capacity of the RAID group The unit can be displayed in GB or MB Free Capacity GB or MB Free ...

Страница 101: ...1 Preferred Controller This option is only visible when dual controllers are installed The preferred controller of the RAID group The default is controller 1 The options are available on this tab Create Create a RAID group The options are available after creating a RAID group Migrate RAID Level Change the RAID level of a RAID group Please refer to next chapter for details Move RAID Level Move the ...

Страница 102: ...abled The system will discern what data will be needed next based on what was just retrieved from disk and then preload this data into the disks buffer This feature will improve performance when the data being retrieved is sequential Default Disabled Disable disk read ahead Command Queuing Enabled Sends multiple commands at once to a disk to improve performance Default Disabled Disable disk comman...

Страница 103: ... is not healthy and not completed The reason could be lack of disk s or have failed disk The options are available on this tab Remove Remove the selected RAID set Move RAID Level Move the member disks of RAID set to other physical disks List Disks List the member of physical disks This table shows the column descriptions of RAID Group Policy Column Name Description No The number of the RAID group ...

Страница 104: ...g feature is enabled The default value is Disabled Write Cache It s to enable or disable the write cache option of hard drives The default value is Disabled Standby It s to enable or disable the auto spin down function of hard drives when this option is enabled and hard drives have no I O access after certain period of time they will spin down automatically The default value is Disabled Read Ahead...

Страница 105: ...rtual disk WT Write Through WB Write Back RO Read Only Priority The priority of virtual disk HI High priority MD Middle priority LO Low priority Bg Rate Background task priority 4 3 2 1 0 Default value is 4 The higher number the background priority of a VD is the more background I O will be scheduled to execute Type The type of the virtual disk RAID the virtual disk is normal BACKUP the virtual di...

Страница 106: ...Extend Extend the virtual disk capacity Set SSD Caching Set SSD caching for the virtual disk Detail is described in chapter 5 Verify Parity Execute parity check for the virtual disk It supports RAID 3 5 6 30 50 60 The options are Verify and repair data inconsistencies Only verify for data inconsistencies Stop verifying when 1 10 20 30 40 50 60 70 80 90 100 inconsistencies have been found Delete De...

Страница 107: ... The virtual disk is used for clone or QReplica usage Space Reclamation Reclaim space for the virtual disk Attach LUN Attach a logical unit number to the virtual disk Detach LUNs Detach a logical unit number from the virtual disk List LUNs List all of the attached logical unit numbers Set Clone Set the target virtual disk for clone Clear Clone Clear the clone Start Clone Start the clone Stop Clone...

Страница 108: ...ium and Low Priority The default value is High priority Bg Rate Background task priority The higher number the background priority of a virtual disk has the more background I O will be scheduled to execute The options are 0 to 4 The default value is 4 Read Ahead The system will discern what data will be needed next based on what was just retrieved form disk and then preload this data into the disk...

Страница 109: ...r controller is 64 The maximum virtual disk number in a system is 2048 The max virtual disk number for snapshot is 32 In AegisSAN V100 the maximum number of virtual disks in a RAID group is 96 The maximum host number per virtual disk is 16 The maximum host number per controller is 64 The maximum virtual disk number in a system is 2048 The max virtual disk number for snapshot is 16 In AegisSAN LX t...

Страница 110: ...t is attached Time Created The created time of the snapshot The options are available on this tab Set Snapshot Space Set snapshot space for preparing to take snapshots Schedule Snapshots Set the snapshots by schedule Take a Snapshot Take a snapshot on the virtual disk Cleanup Snapshots Clean all snapshots of the virtual disk and release the snapshot space The options are available after taking a s...

Страница 111: ...Click Take a Snapshot button 6 Use the drop down list to select a Virtual Disk 7 Enter a Snapshot Name 8 Click OK button The snapshot is taken 9 Set quota to expose the snapshot Click Set Quota option 10 Enter a size which is reserved for the snapshot If the size is zero the exposed snapshot will be read only Otherwise the exposed snapshot can be read written and the size will be the maximum capac...

Страница 112: ...h virtual disk The following example shows the P400Q series This table shows the column descriptions Column Name Description Allowed Hosts The FC node name iSCSI node name for access control or a wildcard for access by all hosts Target The number of the target LUN The number of the LUN assigned Permission The permission level Read write Read only Virtual Disk The name of the virtual disk assigned ...

Страница 113: ...rop down list 4 Enter the Allowed Hosts with semicolons or click Add Host button to add one by one Fill in wildcard for access by all hosts 5 Select a Target number from the drop down list 6 Select a LUN from the drop down list 7 Check the Permission level 8 Click OK button The matching rules of access control are followed from created time of the LUNs The earlier created LUN is prior to the match...

Страница 114: ...Disk The source name of the virtual disk Status The status of the task Online The task is normal and idle Initiating The source virtual disk is initiating Offline The source virtual disk is offline Queued The task is queued When multiple tasks are replicating one task is running the others are queued Replicating The task is running Missing The target virtual disk does not exist N A It s unavailabl...

Страница 115: ...ng The replication task pair is reconnecting when it s disconnected The options are available on this tab Create Create a replication task Rebuild Rebuild the replication task which is changed from a cloning job QReplica Options Set replication options Shaping Setting Configuration Set task shaping configurations The options are available after creating a replication task in the Task table Start S...

Страница 116: ...erent hardware characteristics among these sensors they have different polling intervals Below are the details of the polling time intervals Temperature sensors 1 minute Voltage sensors 1 minute Hard disk sensors 10 minutes Fan sensors 10 seconds When there are 3 errors consecutively system sends ERROR event log Power sensors 10 seconds when there are 3 errors consecutively system sends ERROR even...

Страница 117: ...gle short period of high temperature that could trigger an automatic shutdown the system uses to gauge if a shutdown is needed This is done using several sensors placed on key systems that the system checks every 30 seconds for present temperatures The core processor temperature limit is 80 The interface temperature limit is 65 The SAS Controller and SAS Expandor temperature limits are 65 When one...

Страница 118: ... the serial cable that comes with the UPS Then set up the shutdown values for when the power goes out This table shows the available options and their descriptions Options Description UPS Type Select UPS Type None No UPS or other vendors Smart UPS Serial port APC Smart UPS with serial port Smart UPS SNMP APC Smart UPS with network function Megatec UPS Megatec UPS Shutdown Battery Level When the ba...

Страница 119: ...e network UPS Status The status of UPS Detecting Running Unable to detect UPS Communication lost UPS reboot in progress UPS shutdown in progress Batteries failed Please change them NOW Battery level Current power percentage of battery level The system will shutdown either Shutdown Battery level or Shutdown Delay Seconds reaches the condition User should set these values carefully SES The SES SCSI ...

Страница 120: ...ing a failed hard drive This tool displays S M A R T information of hard drives The number is the current value the number in parenthesis is the threshold value The threshold values from different hard drive vendors are different please refer to hard drive vendors specification for details S M A R T only supports SATA drives SAS drives do not have this function and will show N A in the web page Sy...

Страница 121: ...down QReplica QThin and SSD Caching status This table shows the Status descriptions Status Description Normal Dual controllers and JBODs are in normal stage Degraded One controller or JBOD fails or has been plugged out Lockdown The firmware of two controllers is different or the size of memory of two controllers is different Single Single controller mode The options are available on this tab Downl...

Страница 122: ...t log The Event Log tab provides a log or event messages Choose the buttons of INFO WARNING or ERROR levels to display those particular events The options are available on this tab Download Save the event log as a file It will pop up a filter dialog as the following The default it Download all event logs Mute Buzzer Stop alarm if the system alerts Clear Clear all event logs TIP Please plug in any ...

Страница 123: ...he first four hard drives each hard drive has one copy of event log For one system there are four copies of event logs to make sure users can check event log any time when there are failed disks Upgrade The Upgrade tab is used to upgrade controller firmware JBOD firmware change operation mode and active SSD caching license Before upgrade it recommends to use Configuration Backup tab to export all ...

Страница 124: ...steps are the same as controller firmware update Controller Mode This option can be modified to dual or single here If the system installed only one controller switch this mode to Single and then click Apply button SSD Caching License This option can activate SSD caching function Select the license file and then click Apply button Each license key is unique and dedicated to a specific system To ob...

Страница 125: ...y the following message Click Apply button to synchronize TIP This tab is only visible when the dual controllers are installed A single controller system does not have this option Reset to Factory Defaults The Reset to factory defaults tab allows users to reset the system configurations back to the factory default settings The default values are Management IP Address 192 168 1 234 User Name admin ...

Страница 126: ...ions excluding volume configuration and the current system configurations will be replaced Volume Restoration The Volume Restoration can restore the volume configuration from the volume creation history It is used for RAID group corrupt and tries to recreate the volume When trying to do data recovery the same volume configurations as original must be set and all member disks must be installed by t...

Страница 127: ... When trying to do data recovery the same volume configurations as original must be set and all member disks must be installed by the same sequence as original Otherwise data recovery will fail CAUTION The data recovery does not guarantee that the lost data can be restored 100 It depends on the real operation and the degree of physical damages on disks Users will take their own risk to do these pr...

Страница 128: ...he Disk iSCSI and Fibre Channel This option is only visible when it is fibre channel model option tabs Disk The Disk provides to display the throughput and latency of the physical disk Check the slots which you want to monitor iSCSI The iSCSI provides to display TX Transmission and RX Reception of the iSCSI ports Check the interfaces which you want to monitor ...

Страница 129: ...14 Qsan Technology Inc All Rights Reserved Qsan Document User Manual Fibre Channel The Fibre Channel provides to display TX Transmission and RX Reception of the fibre channels Check the interfaces which you want to monitor ...

Страница 130: ...re disk The following examples are scenarios for a RAID 6 1 When there is no global spare disk or dedicated spare disk in the system The RAID group will be in degraded mode and wait until there is one disk assigned as spare disk or the failed disk is removed and replaced with new clean disk and then the Auto Rebuild starts 2 When there are spare disks for the degraded array system starts Auto Rebu...

Страница 131: ... 10 Striping over the member of RAID 1 volumes RAID 10 allows two hard drive failure or unplugging but in different arrays RAID 30 Striping over the member of RAID 3 volumes RAID 30 allows two hard drive failure or unplugging but in different arrays RAID 50 Striping over the member of RAID 5 volumes RAID 50 allows two hard drive failures or unplugging but in different arrays RAID 60 Striping over ...

Страница 132: ...pshot 10 Delete a snapshot 11 Expose a snapshot 12 Rollback to a snapshot TIP Migrate function will migrate the member disks of RAID group to the same physical disks but it should increase the number of disks or it should be different RAID level Move function will move the member disks of RAID group to totally different physical disks CAUTION RAID group migration or moving cannot be executed durin...

Страница 133: ...button to execute migration 6 Migration starts The status of Physical Disks RAID Groups and Virtual Disks are changing The complete percentage of migration is displayed in R Move RAID Level usage is the same as Migrate RAID Level except it cannot change the RAID level Extend Virtual Disks Extend function extend the size of the virtual disk if there is enough free space Take an example of extending...

Страница 134: ...ing which is the traditional way IT administrators allocate storage space to each logical volume that is used by an application or a group of users When it comes to the point to decide how much space a logical volume requires for three years or for the lifetime of an application it s really hard to make the prediction correctly and precisely To avoid the complexity of adding more space to the volu...

Страница 135: ...pace will be drawn dynamically from this storage pool to meet the needs Thin Provisioning The Benefits of QThin The benefits of QThin are described on the following Less disk purchase is needed initially when setting up a new storage system You don t need to buy more capacity to meet your future data growth at present time Usually hard drive price declines as time progresses You can buy the same h...

Страница 136: ...al user data happens to have all zero in a basic allocation unit granularity the storage system will treat it as free space and recycle it Until the next time there is data update to this reclaimed all zero basic unit the storage system can swiftly return a basic unit from the free storage pool because it s already filled with zero An eco friendly green feature that helps to reduce energy consumpt...

Страница 137: ...time Extra RAID set can be added to the thin RAID group to increase the size of free storage pool A thin RAID group can have up to 32 RAID sets with each RAID set containing up to 64 physical hard drives The maximum size of each RAID set is 64TB Figure 4 shows that Thin RG consists of two RAID sets Figure 4 Scalable RAID group size Allocation unit granularity is 1GB This is a number that demands c...

Страница 138: ...ones Virtual disk clone function can be performed on both directions fat to thin and thin to fat depending on your application needs Figure 5 shows cloning a fat virtual disk to a thin one Figure 5 Clone between thin virtual disk and fat one QThin Options The following describes the thin provisioning options Threshold settings and capacity policies These are designed to simplify the management and...

Страница 139: ...reclamation will be enabled automatically at the background with the lowest priority or when the I O is low The resource impact is reduced to minimum Figure 7 Space reclamation Thin Provisioning Case We suggest that you apply QThin to non critical production applications first Thin provisioning works well when the data written is thin friendly which means that the data written is not completely sp...

Страница 140: ...e constraints as described in the followings 1 Check the firmware version of two systems first It is better that either systems have the same firmware version or the firmware version of the system 2 is newer 2 All physical disks of the RAID group should be moved from system 1 to system 2 together The configuration of both RAID group and virtual disk will be kept but LUN configuration will be clear...

Страница 141: ... the redundant JBOD model the 6G MUX board is required The 3G MUX board does not apply to this model 5 The following table is the maximum JBOD numbers and maximum HDD numbers with different chassis can be cascaded AegisSAN Q500 Q500 P10 Q500 P20 Q500 F20 Q500 F21 Q500 F30 series RAID Storage System D212 D316 D424 J300Q D212 no 20 20 19 Max HDD no 252 256 252 J300Q D316 no 15 15 14 Max HDD no 252 2...

Страница 142: ...upgrading the JBOD firmware 3 After finished upgrading the JBOD system must reboot manually to make the new firmware took effect MPIO and MC S These features come from iSCSi initiator They can be setup from iSCSI initiator to establish redundant paths for sending I O from the initiator to the target MPIO In Microsoft Windows server base system Microsoft MPIO driver allows initiators to login multi...

Страница 143: ...er Session is a feature of iSCSI protocol which allows combining several connections inside a single session for performance and failover purposes In this way I O can be sent on any TCP IP connection to the target If one connection fails another connection can continue processing I O without interruption to the application ...

Страница 144: ...Windows Vista or Windows 7 MC S is the only option since Microsoft MPIO is supported Windows Server editions only 4 MC S can provide higher throughput than MPIO in Windows system but it consumes more CPU resources than MPIO Trunking and LACP Link aggregation is the technique of taking several distinct Ethernet links to let them appear as a single link It has a larger bandwidth and provides the fau...

Страница 145: ...s in parallel to increase the link speed beyond the limits of any single port The usage occasion of Trunking This is a simple SAN environment There is only one switch to connect the server and storage And there is no extra server to be added in the future There is no idea of using LACP or Trunking uses Trunking first There is a request of monitoring the traffic on a trunk in switch ...

Страница 146: ...ontroller mode please make sure both controllers have the same DIMM on each corresponding memory slot Failing to do so will result in controller malfunction which will not be covered by warranty Be aware that when the LED of the Controller Health is in RED please DO NOT unplug the controller from the system or turn off the power suddenly This may cause unrecoverable damage which will not be covere...

Страница 147: ... this stage I O will force to write through for protecting data and the ownership of RAID group will switch to good one For example if controller 1 which owns the RAID group 1 fails accidently the ownership of RAID group 1 will be switched to controller 2 automatically And the system and data can keep working well After controller 1 is fixed or replaced The current owner of all RAID groups will be...

Страница 148: ...ut With iSNS server this case would not happen TIP iSNS server is recommended for dual controller system of iSCSI interfaces Snapshots Snapshot on the box captures the instant state of data in the target volume in a logical sense The underlying logic is Copy on Write moving out the data which would be written to certain location where a write action occurs since the time of data capture The certai...

Страница 149: ...r in Snapshots tab click Set Snapshot Space button 2 Enter a Size which is reserved for the snapshot space and then click OK button The minimum size is suggested to be 20 of the virtual disk size Now there are two numbers in Snapshot Space GB column in Virtual Disks tab They mean used snapshot space and total snapshot space 3 There are two methods to take snapshot In Virtual Disks tab selects a vi...

Страница 150: ...ot can be read written and the size will be the maximum capacity for writing 8 Attach LUN to the snapshot 9 Done The Snapshot can be used Cleanup Snapshots To cleanup all the snapshots please follow the procedures 1 There are two methods to cleanup snapshots In Virtual Disks tab selects a virtual disk And then click Cleanup Snapshots or in Snapshots tab click Cleanup Snapshots button 2 Click OK to...

Страница 151: ...tton 2 Check the schedules which you want They can be set by monthly weekly daily or hourly Check Auto Mapping to attach LUN automatically when the snapshot is taken And the LUN is allowed to access by Allowed Hosts 3 Click OK to apply TIP Daily snapshot will be taken at every 00 00 Weekly snapshot will be taken every Sunday 00 00 Monthly snapshot will be taken every first day of month 00 00 Rollb...

Страница 152: ...ata consistent snapshot Before using snapshot user has to know why sometimes the data corrupts after rollback of snapshot Please refer to the following diagram When user modifies the data from host the data will pass through file system and memory of the host write caching Then the host will flush the data from memory to physical disks no matter the disk is local disk IDE or SATA DAS SCSI or SAS o...

Страница 153: ...ldest snapshots to release more space for the latest snapshot until enough space is released 2 If there is only one snapshot existed the snapshot will fail Because the snapshot space is run out For example there are two or more snapshots existed on a virtual disk and the latest snapshot keeps growing When it comes to the moment that the snapshot space is run out the system will try to remove the o...

Страница 154: ...e fully aware that the incremental copy needs to use snapshot to compare the data difference Therefore the enough snapshot space for the virtual disk is very important Of course clone job can also be set as schedule Setup Clone Take an example of clone the virtual disk 1 Before cloning it must prepare backup target virtual disk In Virtual Disks tab click Create button And then select Disk Type to ...

Страница 155: ...the source virtual disk and then click Start Clone 2 Click OK button The source virtual disk will take a snapshot and then start cloning To stop clone please follow the procedures 1 Select the source virtual disk and then click Stop Clone 2 Click OK button to stop cloning Schedule Clone The clone job can be set by schedule such as hourly or daily Please follow the procedures 1 Select the source vi...

Страница 156: ...napshot space If the ratio sets to 2 it means when the clone process is starting the system will book the free RAID group space to set as the snapshot space which capacity is double the source virtual disk automatically The options are 0 5 3 Threshold The setting will be effective after enabling schedule clone The threshold will monitor the usage amount of the snapshot space When the used snapshot...

Страница 157: ...default snapshot space allocated by the system is two times the size of source virtual disk That is the best value of our suggestion If user sets snapshot space by manually and lower than the default value user should take the risk if the snapshot space is not enough and the clone job will fail Clear Clone To clear the clone job please follow the procedures 1 Select the source virtual disk and the...

Страница 158: ...so be set as schedule The following table is the comparison with QReplica 1 0 and 2 0 QReplica 2 0 starts from AegisSAN LX FW 3 2 0 and AegisSAN Q500 FW 1 1 0 V2 0 V1 0 Replication port Any iSCSI data port Specified iSCSI port only Tasks per controller AegisSAN LX 32 tasks AegisSAN Q500 16 tasks 8 tasks MPIO 2 paths per task 2 paths per task MC S 4 connections per session N A Traffic shaping 8 tra...

Страница 159: ...sk Type to Backup Target Figure 1 Source Side Figure 2 Target Side 2 After creating the target virtual disk please also setup snapshot space The snapshot of the source virtual disk can replicate to the target virtual disk In Virtual Disks tab selects the backup virtual disk And then click Set Snapshot Space 3 Enter a Size which is reserved for the snapshot space and then click OK button 4 Attach L...

Страница 160: ...y Inc All Rights Reserved Qsan Document User Manual 7 Select the Source Port and input the Target IP and then click Next button 8 Select Authentication Method and input the CHAP user if needed Select a Target Node and then click Next button ...

Страница 161: ...r Manual 9 Select a Target LUN When a replication job completes it will take a snapshot on its target virtual disk Please make sure the snapshot space of the backup virtual disk on the target side is properly configured Finally click Finish button 10 The replication task is created ...

Страница 162: ...art replication Figure 5 Source side Figure 6 Target side To stop replication task please follow the procedures 1 In QReplicas tab of the source side select the task and then click Stop 2 Click OK button to stop replication MPIO To setup MPIO Multi Path Input Ouput of the replication task please follow the procedures 1 In QReplicas tab of the source side select the task and then click Add Path 2 N...

Страница 163: ...f the replication task path please follow the procedures 1 In QReplicas tab of the source side select the task path and then click Delete Connection 2 Select the connection s which want to be deleted and then click OK button 3 The multi connection s are deleted Task Shaping If the replication traffic affects the normal usage we provide a method to limit it There are eight shaping groups which can ...

Страница 164: ...K button 6 In QReplicas tab select the task and then click Set Task Shaping 7 Select a Shaping Group from the drop down list And then click OK button 8 The shaping group is applied to the replication task Schedule QReplica Task The replication task can be set by schedule such as hourly or daily Please follow the procedures 1 In QReplicas tab select the task and then click Schedule 2 Check the sche...

Страница 165: ...ribed on the following Snapshot Space This setting is the ratio of the source virtual disk and snapshot space If the ratio sets to 2 it means when the replication process is starting the system will book the free RAID group space to set as the snapshot space which capacity is double the source virtual disk automatically The options are 0 5 3 Threshold The setting will be effective after enabling s...

Страница 166: ...t a full copy CAUTION The default snapshot space allocated by the system is two times the size of source virtual disk That is the best value of our suggestion If user sets snapshot space by manually and lower than the default value user should take the risk if the snapshot space is not enough and the replication task will fail Delete QReplica Task To delele the replication task please follow the p...

Страница 167: ...h differential copy afterward To do that virtual disk clone transfers to QReplica please follow the procedures 1 Create a clone job on an existing virtual disk with data stored already 2 It is better that there is no host connected to the source virtual disk Then run Set Clone Start Clone to synchronize the data between source and target virtual disks 3 After the data is synchronized change the cl...

Страница 168: ...activate the RAID group in the target system Remember to set snapshot space for the target virtual disk And then attach the target virtual disk to a LUN ID 6 In QReplicas tab of the source side click Rebuild button to rebuild the replication task which is changed from a cloning job formerly 7 Rebuild the clone relationship select a source virtual disk 8 Next steps are the same as the procedure of ...

Страница 169: ... degraded mode to healthy At the same time it frees up CPU resources more quickly to be available for other I O and demands Solution Without Fast Rebuild feature rebuild will start from the beginning partition to the end It may spend lots of time to complete the task When enabling Fast Rebuild feature it will rebuild the partition with the changed only TIP With less changed partition the Fast Rebu...

Страница 170: ... in a fast rebuild virtual disk clean partitions are not rebuilt since there are no data saved there Though clean partitions are never rebuilt their health status is good If all partitions of the fast rebuild virtual disk are clean then no rebuild would happen and no event would be sent The RAID stacks could not use optimize algorithm to compute parities of a partition which is not rebuilt Thus th...

Страница 171: ...e enables the system to use SSDs as extended cache thus increasing the performance of random I O applications such as databases file servers and web servers etc Generally the SSD caching is useful for the following features 1 Due to the HDD IOPS read performance cause the bottleneck 2 In working space read I O is much more than write 3 The best performance is in the case the working data size is r...

Страница 172: ...s performed for read cache 2 Populate on write threshold It s the same action as read According to these values each cache block has associated to its read and write counts When a host requests the read data located on the cache block its read count is increment If a cache hit does not occur and the read count is greater than or equal to the populate on read threshold then a cache populate operati...

Страница 173: ...rom the HDD 3 Return requested data to the host 4 Populate the cache to SSD Read Data with Cache Hit The following figure shows the steps of the controller which handles a host read request when the data is in the SSD cache HDD SSD Memory Cache Data 2 Read from HDD 4 Populate Cache 1 Request Read 3 Return Data SSD HDD Memory Cache Data 4 Read from HDD SSD Failure Case 2 Read from SSD 1 Read 3 Retu...

Страница 174: ...the status to the host 4 Populate the cache to SSD I O Type The type of I O access is a user selectable SSD cache configuration The user selectable I O type controls the SSD cache internal settings for cache block size sub block size populate on read threshold and populate on write threshold Three pre defined I O types are supported they are database file system and web service The user can select...

Страница 175: ...cated far from other data that is frequently reread the lowest cache use is obtained In this case the lowest cache block size of I O type allows the most user data to be cached The sub block size affects the cache warm up time too A larger sub block size causes cache to fill more quickly than a smaller one but it can also affect the response time of host I O Also occupy the system resource such as...

Страница 176: ... Configuration Activate the license key User needs to obtain a license key and download it to the system to activate the SSD caching function in System Maintenance Upgrade SSD Caching License Each license key is unique and dedicated to a specific system To obtain the license key please contact sales for assistance Take an example of enabling SSD caching 1 After creating a virtual disk click Set SS...

Страница 177: ...aint Here are some constraints about SSD caching Only SSD could be used SSD caching space of a virtual disk A SSD could be assigned to one and only one virtual disk as its caching space Up to 8 SSDs could be used as SSD cache of a virtual disk Support up to 2 4TB of SSD caching space in one system ...

Страница 178: ... slot is inserted into system WARNING PD removed Disk slot is removed from system ERROR HDD read error Disk slot read block error ERROR HDD write error Disk slot write block error ERROR HDD error Disk slot is disabled ERROR HDD IO timeout Disk slot gets no response INFO PD upgrade started PD string starts upgrading firmware process INFO PD upgrade finished PD string finished upgrading firmware pro...

Страница 179: ...d reply terminated abnormally INFO Port linkup The Port number link status is changed to Up INFO Port linkdown The Port number link status is changed to Down EMS Events Level Type Description INFO Power install Power string is installed ERROR Power absent Power string is absent INFO Power restore Power string is restored to work ERROR Power fail Power string is not functioning WARNING Power detect...

Страница 180: ...event logs are cleared WARNING Send mail fail Failed to send event to email LVM Events Level Type Description INFO RG create OK RG name has been created INFO RG create fail Failed to create RG name INFO RG delete RG name has been deleted INFO RG rename RG name has been renamed as name INFO VD create OK VD name has been created INFO VD create fail Failed to create VD name INFO VD delete VD name has...

Страница 181: ... Rewrite at LBA address of VD name starts DEBUG VD rewrite finished Rewrite at LBA address of VD name completes DEBUG VD rewrite failed Rewrite at LBA address of VD name failed WARNING RG degraded RG name is in degraded mode WARNING VD degraded VD name is in degraded mode ERROR RG failed RG name is failed ERROR VD failed VD name is failed ERROR VD IO fault I O failure for stripe number address in ...

Страница 182: ... name finished erasing process WARNING VD erase failed The erasing process of VD name failed INFO VD erase started VD name starts erasing process WARNING RG disk missing RG name can not be activated because of missing disks ERROR PD VD read write fault Read error at LBA address address of PD slot and rewrite failed at LBA address address of VD name ERROR PD IO retry fault Over I O retry limit in l...

Страница 183: ...tring starts upgrading firmware process INFO PD upgrade finished JBOD name PD string finished upgrading firmware process WARNING PD upgrade failed JBOD name PD string upgrade firmware failed INFO PD freed JBOD name PD slot has been freed from RG name INFO PD inserted JBOD name disk slot is inserted into system Warning PD removed JBOD name disk slot is removed from system ERROR HDD read error JBOD ...

Страница 184: ...e of item read as string in JBOD name is CRIT UNDER INFO Volt recovery Voltage of string in JBOD string is NORMAL WARNING Therm warn OT Temperature of string read as string in JBOD name is OT WARNING WARNING Therm warn UT Temperature of string read as string in JBOD name is UT WARNING WARNING Therm fail OT Temperature of string read as string in JBOD name is OT FAILURE WARNING Therm fail UT Temper...

Страница 185: ...NFO System button shutdown System shutdown via power button INFO System LCM shutdown System shutdown via LCM INFO System console reboot System reboot from string via Console UI INFO System web reboot System reboot from string via Web UI INFO System LCM reboot System reboot via LCM INFO FW upgrade start System firmware upgrade starts INFO FW upgrade success System firmware upgrade succeeds WARNING ...

Страница 186: ... longer designated WARNING Auto clone error Auto clone task string WARNING Auto clone no snap Auto clone task Snapshot name is not found for VD name QReplica Events Level Type Description INFO Qrep portal enabled Replication portal is enabled INFO Qrep portal disabled Replication portal is disabled INFO VD replicate started VD name starts replication process INFO VD replicate finished VD name fini...

Страница 187: ... WARNING RG threshold hit The used capacity of RG name exceeds number percent INFO RAID set created RAID set number has been added into RG name INFO RAID set deleted RAID set number was deleted from RG name INFO VD reclaim started VD name starts space reclamation process INFO VD reclaim completed VD name finished space reclamation process WARNING VD reclaim aborted The space reclamation in VD name...

Страница 188: ...step by step to setup Microsoft iSCSI Initiator Please visit Microsoft website for latest iSCSI initiator This example is based on Microsoft Windows Server 2008 R2 Connect to iSCSI Target 1 Run Microsoft iSCSI Initiator 2 Input IP address or DNS name of the target And then click Quick Connect button 3 Select the target name and then click Done button ...

Страница 189: ...ights Reserved Qsan Document User Manual 4 It can connect to an iSCSI disk now Setup MPIO 1 If running MPIO please continue 2 Click Discovery tab to connect the second path 3 Click Discover Portal button Enter the IP address or DNS name of the target ...

Страница 190: ...k Targets tab select the second path and then click Connect button 6 Enable Enable multi path checkbox Then click OK button 7 Done it can connect to an iSCSI disk with MPIO Setup MC S 1 If running MC S please continue 2 Select one target name click Properties button 3 Click MCS button to add additional connections ...

Страница 191: ...014 Qsan Technology Inc All Rights Reserved Qsan Document User Manual 4 Click Add button 5 Click Advanced button 6 Select Initiator IP and Target portal IP and then click OK button 7 Click Connect button 8 Click OK button ...

Страница 192: ...2004 2014 Qsan Technology Inc All Rights Reserved Qsan Document User Manual 9 Done Disconnect 1 Select the target name click Disconnect button and then click Yes button 2 Done the iSCSI device disconnect successfully ...

Страница 193: ...wing items 1 Multipath I O Driver MPIO 2 Volume Shadow Copy Service VSS optional 3 QVolume Shadow Copy Application optional this is an application for demo VSS function The software has two versions One is for 32 bits OS x86 the other is for 64 bit OS x64 It can be installed in Microsoft Windows Server 2003 2003 R2 2008 2008 R2 only Install MPIO VSS Software 1 Depend on your 32 bits or 64 bits ope...

Страница 194: ...t 2004 2014 Qsan Technology Inc All Rights Reserved Qsan Document User Manual 4 Click Browse button to change the installation directory Default is C Program Files Qsan Then click Next button 5 Click Install button ...

Страница 195: ...Document User Manual 6 Click Finish button the installation completes 7 Please reboot the system to ensure the DSM driver take effect 8 After reboot use Windows CLI command vssadmin list providers to check whether the Qsan VSS hardware provider is installed successfully ...

Страница 196: ...the disk and assign a drive letter S This volume is a Virtual disk which comes from Qsan storage system Click Start All Programs QSAN QVSSClient to run the application 2 Click Create button It will take a snapshot via VSS 3 During Qsan VSS Hardware Provider is in operation the volume icon will be displayed in yellow ...

Страница 197: ... 4 Observe the event log on the Qsan storage system there is an associated snapshot through VSS 5 Select the No 1 column and click Expose button then select a folder The snapshot will expose to a directory as a disk image format 6 Click Schedule button to enable taking snapshots by schedule ...

Страница 198: ...198 Copyright 2004 2014 Qsan Technology Inc All Rights Reserved Qsan Document User Manual 7 Click Delete button to delete the snapshot ...

Страница 199: ...ms another RAID 1 subgroup In the 4 cells the 4 subgroups are physical disk 0 1 physical disk 2 3 physical disk 4 5 and physical disk 6 7 WT Write Through cache write policy A caching technique in which the completion of a write request is not signaled until data is safely stored in non volatile media Each data is synchronized in both data cache and accessed physical disks WB Write Back cache writ...

Страница 200: ...ink Aggregation Control Protocol MPIO Multi Path Input Output MC S Multiple Connections per Session MTU Maximum Transmission Unit CHAP Challenge Handshake Authentication Protocol An optional security mechanism to control access to an iSCSI storage system over the iSCSI data ports iSNS Internet Storage Name Service SAS Serial Attached SCSI Dual Controller Terminology Item Description SBB Storage Br...

Страница 201: ...lers 146 E Email Notification Settings 82 Send Test Email 82 Enclosure Management 116 Entity and iSNS Settings 89 Event Log 122 178 Clear 122 Download 122 Mute Buzzer 122 F Fast Rebuild 169 Configuration 170 Constraint 170 Solution 169 FC Fibre Channel 40 95 Arbitrated Loop FC AL 96 Change Connection Mode 96 Change Link Speed 95 Clear All Counters 95 Clear Counters 97 Node Configuration 97 Point t...

Страница 202: ...Point 87 Performance Monitor 128 Physical Disks 98 Disk Check Report 99 Disk Health Check 99 Disk Scrub 99 More Information 99 Read Error Cleared 99 Set Dedicated Spare 99 Set Free Disk 99 Set Global Spare 99 Set Local Spare 99 Turn off the Indication LED 99 Turn on the Indication LED 99 Upgrade 99 Q QReplica Options Restart the task an hour later if it failed 166 Snapshot Space 165 Threshold 165 ...

Страница 203: ...ystem Name 80 T Technical Support 3 Thin Provisioning 134 Trunking 86 145 U UL Statement 5 Upgrade 123 Controller Mode 124 147 Controller Module Firmware Update 124 JBOD Firmware Update 124 142 SSD Caching License 124 UPS Uninterruptible Power Supply 118 V Virtual Disks 105 Attach LUN 107 110 113 Change QReplica Options 107 Cleanup Snapshots 107 110 Clear Clone 107 Cloning Options 106 Create 106 D...

Отзывы:

Нет отзывов

Похожие инструкции для AegisSAN LX Series

StarTech.com IDECASE35SAT Instruction Manual preview
IDECASE35SAT
Бренд: StarTech.com Страницы: 8
Deuba 101848 Assembly Instruction Manual preview
101848
Бренд: Deuba Страницы: 7
American Megatrends StorTrends 1312-P Specifications preview
StorTrends 1312-P
Бренд: American Megatrends Страницы: 2
Qsan XCubeDAS XD5324D User Manual preview
XCubeDAS XD5324D
Бренд: Qsan Страницы: 49
Acard ARS-2018 User Manual preview
ARS-2018
Бренд: Acard Страницы: 54
Kingston Technology DTR30G2 Specifications preview
DTR30G2
Бренд: Kingston Technology Страницы: 2
SanDisk CruzerSync Getting Started Manual preview
CruzerSync
Бренд: SanDisk Страницы: 7
FOREDOM Work Bench System Mounting Instructions preview
Work Bench System
Бренд: FOREDOM Страницы: 2
HOLZMANN MASCHINEN WB 210C User Manual preview
WB 210C
Бренд: HOLZMANN MASCHINEN Страницы: 13
ZyXEL Communications NAS542 Manual preview
NAS542
Бренд: ZyXEL Communications Страницы: 6
Tramontina PRO 44954/045 Assembly Instructions preview
44954/045
Бренд: Tramontina PRO Страницы: 2
Maverick System NasDisk User Manual preview
NasDisk
Бренд: Maverick System Страницы: 58
Franklin X720 User Manual preview
X720
Бренд: Franklin Страницы: 15
LaCie rikiki 301949 Specifications preview
rikiki 301949
Бренд: LaCie Страницы: 2
SanDisk SD25B-100 Product Manual preview
SD25B-100
Бренд: SanDisk Страницы: 69
SanDisk SDP3B Product Manual preview
SDP3B
Бренд: SanDisk Страницы: 111
Thermaltake Muse R-Duo RAID User Manual preview
Muse R-Duo RAID
Бренд: Thermaltake Страницы: 47
Think Tank Photo ShapeShifter Instructions preview
ShapeShifter
Бренд: Think Tank Photo Страницы: 2

Бренды по названию

Популярные бренды

Загрузить еще бренды