G-Technology G-RACK 12 Скачать руководство пользователя страница 54 | Manualshive

Страница: 54 / 296

G-Technology G-RACK 12 Скачать руководство пользователя страница 54

Administrative Tool

p. 54

RAID

This menu is used to set RAID configuration and format the data drives.

The status is displayed in the Dashboard and can be one of the following:
•

Good - normal state. everything is ok

•

Unmounted - filesystem unmounted, not in use

•

Degraded - there is a drive missing. The filesystem is still operational. Replace the missing drive.

•

Replacing (%) - the user has added a replacement drive into the system and the system in the
process of bringing it into the RAID. Percentage will show how much is completed.

•

Balancing - when the filesystem is re-allocating/ distributing the information across all the drives

•

Delete missing - system is removing the drive that has failed( drive is gone), recovery operation

•

Replacing_stuck - mounting has been resumed after rebooting, but the physical disk is missing

«
...
52
53
54
55
56
...
»

Содержание G-RACK 12

Страница 1: ......

Страница 2: ...Copyrights...

Страница 3: ...ountries Microsoft Active Directory Internet Explorer Windows Windows Vista and Windows XP are trademarks or registered trademarks of Microsoft Corporation in the US and or other countries Linux is th...

Страница 4: ...Introduction...

Страница 5: ...igh speed networking with the G RACK 12 software to provide a solution that is both powerful and easy to maintain The G Technology NAS OS has been customized and optimized for speed reliability and ea...

Страница 6: ...pansion Module Seamless integration with your data network and non linear editing NLE suites and The latest Btrfs file system for better data protection and faster content recovery Key Features Enterp...

Страница 7: ...RACK 12 in any occasions Improper dissemblance of the product may expose you to electric shock or other risks For any inquiries please contact the distributor 10 Do NOT use the G RACK 12 near water fo...

Страница 8: ...net Explorer 11 or newer Windows only Microsoft Edge Apple Safari v9 newer Windows or Mac Mozilla Firefox v42 or newer Windows or Mac Google Chrome v46 or newer Hardware Local area network LAN or wire...

Страница 9: ...Getting Started...

Страница 10: ...wer outlet The G RACK 12 must be handled with care during unpacking and installation Drives may be damaged by rough handling shock or vibration Be aware of the following precautions when unpacking and...

Страница 11: ...x Contents The G RACK 12 server including 12 bays with internal hard drives 2 Power cords 2 Bezel locking Keys Front bezel Rack rail kit Rail kit adapter Hardware QSG Software QSG 5 Year limited warra...

Страница 12: ...Getting Started p 12 Front View Rear View...

Страница 13: ...s Rack Precautions Ensure that the leveling jacks on the bottom of the rack are fully extended to the floor with the full weight of the rack resting on them In single rack installation stabilizers sho...

Страница 14: ...possible overloading of circuits might have on overcurrent protection and power supply wiring Appropriate consideration of equipment nameplate ratings should be used when addressing this concern Relia...

Страница 15: ...ack itself Installing the Inner Rail Extension The G RACK 12 chassis includes a set of inner rails in two sections inner rails and inner rail extensions The inner rails are pre attached to the chassis...

Страница 16: ...unted equipment is not to be used as a shelf or a work space Stability hazard The rack stabilizing mechanism must be in place or the rack must be bolted to the floor before you slide the unit out for...

Страница 17: ...hes and 33 inches Installing the Outer Rails to the Rack 1 Secure the back end of the outer rail to the rack using the screws provided 2 Press the button where the two outer rails are joined to retrac...

Страница 18: ...s on the rack 3 Slide the inner rails into the outer rails keeping the pressure even on both sides When the chassis has been pushed completely into the rack it should click into the locked position 4...

Страница 19: ...Getting Started p 19 Physically Connecting G RACK 12 1 Plug in 2 power cords to back of the G RACK 12 2 Plug in the Ethernet cable 3 LEDs will flash green on ethernet port 4 Press power button...

Страница 20: ...DHCP assigned IP address by default it will have a self assigned IP address of 172 16 12 12 It is recommended to use IP Search Utility when accessing and configuring the G RACK 12 for the first time T...

Страница 21: ...s and with the G RACK 12 Administration Tool you can change the IP address to what works best for you Using static IP you will need to change your client computer s IP address to match the static For...

Страница 22: ...arted p 22 7 Save your settings For Windows 1 Open Network 2 Go to Sharing Change adapter settings and choose your connected network 3 View Properties 4 Click Internet Protocol Version 4 and 5 Click P...

Страница 23: ...55 255 0 8 Save your settings THE FURTHER PROCEDURES SHOULD BE COMPLETED ON ANOTHER NETWORKED CLIENT COMPUTER WITH A WEB BROWSER Access the G RACK 12 by using a supported web browser and use the IP ad...

Страница 24: ...rmance THE FURTHER PROCEDURES SHOULD BE COMPLETED ON ANOTHER NETWORKED CLIENT COMPUTER WITH A WEB BROWSER Access the G RACK 12 by using a supported web browser and use the IP address of the device Lis...

Страница 25: ...se confirm that you have read and agree with the Agreement STEP 3 Choose a theme for your environment Theme is a set of pre configured parameters that are most likely to suit to desired working enviro...

Страница 26: ...ACK 12 Admin password here Login user name will remain admin Please note that password is case sensitive Min length is 5 characters If you don t change the password at this step it will remain as defa...

Страница 27: ...ption SMTP server Specify the SMTP server of the G RACK 12 email account SMTP port Specify the SMTP port of the G RACK 12 email account Use SSL TLS secure connection Toggle to enable secure connection...

Страница 28: ...he minimal length of 5 characters Choose whether all users will share a single workspace or each user will be assigned a separate one STEP 7 Customize your G RACK 12 You will not see this dialog if yo...

Страница 29: ...the G RACK 12 Shares and Targets settings Enable network protocols to used for each Share workspace and Targets STEP 9 The G RACK 12 Build Summary This step is informational Review the configuration s...

Страница 30: ...Getting Started p 30 STEP 10 Welcome to the G RACK 12 Administrative tool Once you are done with primary settings you will see the Dashboard...

Страница 31: ...Getting Started p 31 All settings can be changed manually in the G RACK 12 Administrative Tool at any time...

Страница 32: ...Administrative Tool...

Страница 33: ...og in Dashboard You are here The G RACK 12 Dashboard provides a quick overview of performance metrics and health statuses in the form of widgets The title of a widget is a quick access link to the cor...

Страница 34: ...alancing Degraded Replacing_ stuck Click the widget title to see more information in the RAID section More details on OS filesystem is in OS RAID menu System Health The widget displays the status of C...

Страница 35: ...together with service disable sign means the service is running If you see a RED running man that means the service is stopped Click the widget title to see more information under Services section Wo...

Страница 36: ...ace there should be a RAID already created Click the Add button to create a new Workspace The following table describes the labels on the screen Name Input the name of the Workspace Device Select RAID...

Страница 37: ...s Permissions The file level access of the shared folder path Comment Add notes on the Workspace here Click the Permissions button to set users and groups access permission for the Workspace To change...

Страница 38: ...pes Replace Toggle on to replace all existing permissions Default On Recursive Toggle on to apply permissions to files and subfolders Default On To enable domain users go to the Active Directory menu...

Страница 39: ...d file system Read only Toggle to make the snapshot read only Quotas This option is used to limit the amount of disk storage space that is allowed for a workspace When the quota limits are approached...

Страница 40: ...set a quota limit and click the Edit Quota Limits button NOTE It is not possible to set the quota limit less than the already used space Mount Click the Mount button to mount a workspace Until you mou...

Страница 41: ...Administrative Tool p 41 Delete Workspace To delete a workspace highlight the workspace and click Delete button...

Страница 42: ...s of the G RACK 12 It shows the drive slot number system name of the drive vendor model serial number and disk capacity For best practice we recommend using all disks of the same capacity and the same...

Страница 43: ...tial write perfor mance boost at the cost of loosing data on power down Wipe physical drive This option erases all the data from a physical disk When you click the button a warning message will appear...

Страница 44: ...each drive individually The following table describes the labels on the screen Monitor Toggle on to enable monitoring Device System name of the physical disk Model Manufacturer s model of the physica...

Страница 45: ...s have S M A R T support Device information Select the device and click the information button to pull up the information dialog The following table describes the labels on the screen Device Device re...

Страница 46: ...ive at tribute This is a standard across all S M A R T enabled storage devices However it depends on the storage vendor which attributes it will allow S M A R T to diagnose Attribute name This refers...

Страница 47: ...ttained by the hard drive since S M A R T started its assessment of the physical drive Treshold This is the attribute s threshold value if the at tribute s current normalized value is less than or equ...

Страница 48: ...Administrative Tool p 48 Extended information from smartctl utility...

Страница 49: ...lar test from the list The test will run at a pre determined time and date Click the plus button to add a scheduled test The following table describes the labels on the screen Enable Enables the sched...

Страница 50: ...echanical Properties The exact sequence of the servos and the positioning mecha nism to be tested is also specific to each manufacturer Read Verify It will read a certain area of the disk and verify c...

Страница 51: ...ated will appear under the Scheduled tests tab To disable the test toggle off the enable button The test will not run but will remain in the list Execute scheduled test The Run button starts the test...

Страница 52: ...ative Tool p 52 The following table describes the labels on the screen Enable Toggle on to enable S M A R T monitoring for the physical disks Check interval Sets the interval between disk checks to N...

Страница 53: ...e last report Set to 0 to disable this report Informal Report if the temperature is greater or equal than N degrees Celsius Set to 0 to disable this report Critical Report if the temperature is greate...

Страница 54: ...m is still operational Replace the missing drive Replacing the user has added a replacement drive into the system and the system in the process of bringing it into the RAID Percentage will show how mu...

Страница 55: ...ID array NOTE The minimal number of drives for different RAID levels is RAID 5 minimum 2 physical disks RAID 6 minimum 3 physical disks For best practice we recommend using all disks of the same capac...

Страница 56: ...RAID array NOTE Remember to perform balance on any modification of RAID structure For best practice we recommend using all drives of the same capacity If your system happens to have drives of differe...

Страница 57: ...aded array state Click the Hot spare button to call the dialog to set a hot spare for a RAID Select devices to be added as a hot spare to the selected RAID device The following table describes the lab...

Страница 58: ...unt button to mount the RAID device A newly created RAID will be mounted automatically Unmount To unmount the selected RAID click the Unmount button To make this option active all volumes of the RAID...

Страница 59: ...enu buttons to the most used items The icons that are not displayed will remain hidden until you press the Advanced menu button Simple menu displays only Network Services NFS SMB CIFS AFP and iSCSI SC...

Страница 60: ...istrative Tool p 60 The following table describes the labels on the screen Hostname Label that identifies the system to the network Domain Name DNS domain where the G RACK 12 hostname should be regist...

Страница 61: ...Interfaces Add Edit Ethernet The menu is used to configure and add network interfaces Both ipv4 and ipv6 are configurable using this menu To configure a particular interface highlight that interface a...

Страница 62: ...upplied if you dynamic method has been cho sen Netmask Add Netmask Gateway Add Gateway IPv6 For IP version 6 protocol setup Method DHCP allow DHCP server to assign you an IP address Netmask and the ga...

Страница 63: ...Unit the size of the packet pay load for the this interface Wake on LAN Toggle to enable Wake on Lan if packets arrive at this interface Options Additional device settings e g autoneg off speed 100 d...

Страница 64: ...1 interface 4 After eth1 has been deleted eth0 should be only one remaining You will need this for now do not delete both or all eth ports or else you will not be able to login to the admin tool with...

Страница 65: ...Address Enter an IP address Netmask Enter the subnet mask of your network Gateway Enter the IP address of your gateway IPv6 For IP version 6 protocol setup Method DHCP allow DHCP server to assign you...

Страница 66: ...play in the list with a DHCP IP generated Log out of the admin tool after getting IP for bond0 interface then login to the admin tool with bond0 IP instead Navigate back to Connect Network Interfaces...

Страница 67: ...lows the tool that probes each TCP UDP port to see if there is a service listening Then the tool will know that the service is available to connect to the G RACK 12 If the advertising of service of ea...

Страница 68: ...ic ruled added by the administrator Add Edit By adding custom rules it is possible to allow or block access based on the service or application source or destination IP addresses time of the day its a...

Страница 69: ...or 1024 65535 Destination Destination address can be either a network IP address with mask an IP range or a plain IP ad dress A argument before the address specifi cation inverts the sense of the add...

Страница 70: ...ative Tool p 70 Services Overview The menu shows network services enabled and successfully running SSH The menu shows additional information on SSH status currently logged in users and established con...

Страница 71: ...B CIFS The menu shows additional information on SMB CIFS status currently logged in users and established connections FTP The menu shows additional information on its status currently logged in users...

Страница 72: ...Enable this multi platform file system here Otherwise disable the option to prevent unnecessary CPU overhead Shares Share is a way a user will connect to the G RACK 12 to transfer files We are sharin...

Страница 73: ...this is setting of 192 168 0 12 and by doing so you would limit the NFS share to exactly the one computer that had that IP address The next level of access is to provide access to all computers on a s...

Страница 74: ...nd 2 Read Write that gives you privileges to read edit copy and delete the files available on this NFS share Advanced options Advanced Options Additional information on these settings can be found onl...

Страница 75: ...ace is set to use NFS protocol NFS service doesn t run unless something is exported Mac Client Information On a Mac clients and mounting through NFS with the Connect to Server option the Mac client ad...

Страница 76: ...shares and logging in navigate to Connect NFS 3 Edit share and change client IP 4 In extra options change secure to insecure and save 5 Navigate to Access Control Workspaces and open up ACL options 6...

Страница 77: ...Administrative Tool p 77 SMB CIFS Workspaces Add a workspace that will connect via SMB CIFS service...

Страница 78: ...ter is set then users may not crea te or modify files in the share Browseable Set browseable This controls whether this share is seen in the list of available shares in a net view and in the browse li...

Страница 79: ...ttributes SYSTEM HIDDEN ARCHI VE or READ ONLY from a file system extended attribute before mapping DOS attributes to UNIX permission bits When set DOS attributes will be stored onto an extended attrib...

Страница 80: ...Administrative Tool p 80 Audit Audit file operations NOTE Connecting a shared workspace through SMB protocol the username is case sensitive...

Страница 81: ...ed by clients Description The NT description field Local Master Browser Allow this server to try and become a local mas ter browser Eae i use a computer it will show all available shares Time server A...

Страница 82: ...via AFPservice The following table describes the labels on the screen Shared workspace The location of the files to share Workspace The name of the share Read only Set read only If this option is set...

Страница 83: ...rces filename restrictions This forces filenames to be restricted to the character set used by Windows Case folding This option handles if the case of filenames should be changed Comment Add an option...

Страница 84: ...S connections Certificate The SSL certificate Required This option requires clients to use FTP over TLS when talking to this server No certificate request This option causes the server to not send a c...

Страница 85: ...n the screen Event This rule is triggered whenever the selected event directive occurs Occurrence This parameter says that if N occurrences of the event happen within the given time interval then a ba...

Страница 86: ...ive Tool p 86 Shares Add a workspace that will connect via FTP service The following table describes the labels on the screen Shared workspace The location of the files to share Comment Optional comme...

Страница 87: ...n Enable Toggle on to enable the service Port Specify the port to be used Max clients Set the maximum number of simultaneous clients that can connect to the FTP server Max connections per host Maximum...

Страница 88: ...ricts the range of ports from which the server will select when sent the PASV command from a client The server will randomly choose a number from within the specified range until an open port is found...

Страница 89: ...ding port on your router and forward that port from your router to the device Resume Allow clients to resume interrupted uploads and downloads Ident protocol Enable the ident protocol RFC1413 When a c...

Страница 90: ...rce to another the destination It is efficient because it only transfers files which are different between the source and destination directories Jobs To add a new rsync task press the Add button Thes...

Страница 91: ...rm a trial run with no changes made Recursive Recurse into directories Times Preserve modification times Compress Compress file data during the transfer Archive Enable archive mode Delete Delete files...

Страница 92: ...Administrative Tool p 92 Comment Optional comment text box...

Страница 93: ...following hack Create an iSCSI target original Rsync this iSCSI target to another G RACK 12 duplicate If at this point you try to discover the duplicate target from initiator the result will be it is...

Страница 94: ...istrative Tool p 94 Server Settings Use this menu to enable rsync utility and set the port The following table describes the labels on the screen Enable Toggle on to enable Port Choose the port Defaul...

Страница 95: ...ption specifies the group name that file transfers to and from that module should take place Use chroot Enable chroot If this option is set the daemon will chroot to the shared folder path before star...

Страница 96: ...is option is a comma space or tab delimited set of hosts which are permitted to access this module You can specify the hosts by name or IP number Leave this field empty to use default settings Hosts d...

Страница 97: ...IP networks which makes it possible to use the advantages of a SAN without creating a new network infrastructure and in addition you do not need to train your employees On the client side it requires...

Страница 98: ...ming user name goes to the iSCSI target and the LUN that is automatically created CHAP secret Password optional attribute containing user password for incoming user name Password must be at least 12 c...

Страница 99: ...ue FirstBurstLength for unsolicited data MaxBurstLenghth Maximum SCSI data payload in bytes for data in or for a solicited data out sequence The respon der s number is used The result function is Min...

Страница 100: ...represent a combination of recovery capabilities Each level includes all the capabilities of the lower recovery level The result function is Min OfMaker Turns on or off the initiator to target marker...

Страница 101: ...he initiator in NopInTime out seconds the corresponding connection will be closed Default is 30 seconds If it s set to 0 then NOP In requests are disabled NopInTimeout Defines the maximum time in seco...

Страница 102: ...spaces X Users Add Edit user Use this menu to create new users account and to assign them to groups To create new or to editing the existing one user account click the Add button then fill out the req...

Страница 103: ...separator e g john john smith grack12 PLM false A uid was not set and is not mandatory here because the G RACK 12 will set the next user id in the line for them NOTE It is not possible to set a group...

Страница 104: ...formation Group A user group is a collection of users with the same access right to the files or folders Assigning users to groups gives you powerful tools to manage large numbers of users and their p...

Страница 105: ...red group and press the Delete button Confirm in the dialogue window NOTE Deleting a group will not affect user data Refresh The Refresh button will reload the screen and display any new or updated in...

Страница 106: ...er accounts of the Active Directory server will be imported to the G RACK 12 automatically This will allow the administrator to configure the access rights read only read write or deny access to the n...

Страница 107: ...cts Users will merge as one and display as being part of both local and domain groups This may cause issues when mounting shared workspaces or setting permissions For best practice to avoid such confl...

Страница 108: ...Force SSl TLS Force secure connection only Note When you turn on Enable SSL TLS you will need to add https to the URL for the Admin Tool When you do this all browsers will report that you are using an...

Страница 109: ...Administrative Tool p 109 Example error message...

Страница 110: ...dministrator s password NOTE Make sure to remember the password If the admin password is lost contact G Technology support center for the assistance NOTE For security purposes the system will block th...

Страница 111: ...rowser to connect to the G RACK 12 or save a file the display time of the action will be incorrect The time of the event log displayed will be inconsistent with the actual time when an action occurs C...

Страница 112: ...if Use NTP server option is active The first time synchronization may take several minutes to complete NOTE In an Active Directory environment this functionality should not be used because the server...

Страница 113: ...Monitoring tab In this situation 1 Find out which disk has failed for this click Details button It will say device1 or device 2 ID1 on the left ID 2 on the right when you are facing the G RACK 12 Also...

Страница 114: ...f the G RACK 12 from multiple angles In the event of a performance exception you can find the cause by viewing the performance statistics It is adviced to always keep the real time performance monitor...

Страница 115: ...e sent when necessary Settings Use this dialog to set SMTP server which is used to send emails from the notification service Yu can use either external public SMTP like smtp gmail com or private SMTP...

Страница 116: ...spam make sure you allow this address to be received Authentification required If your SMTP server requires authentication toggle on to enable it Usename Enter the Username for the email server Passw...

Страница 117: ...secure encrypted data communications between two computers connecting over an insecure network in client server architectire SSH is widely used by network administrators for managing systems remotely...

Страница 118: ...ill need a certificate and a key These are available from web hosting services and many private privacy providers To create a new SSL certificate click Add button and choose Create in the drop down me...

Страница 119: ...e when the test will be performed Hour Set the time when the test will be performed Asterisk means every hour Day of month Set the day when the test will be performed Asterisk means every day Month Se...

Страница 120: ...Administrative Tool p 120 Comment Add an optional text here Execute cron job The Run button starts the job immediately Delete sheduled Job Click the Delete button to delete the test...

Страница 121: ...portant information about the G RACK 12 server Server name Version Time Hardware information Raid status CPU usage System memory Network info with current transfer rate Overview General information su...

Страница 122: ...all running processes sorted by CPU consumption This info may be helpful if you are trying to figure out why the performance is suboptimal or if the process for the corresponding service is actually r...

Страница 123: ...ed devices and storing performance log files If a problem occurs handle it by the following steps 1 View the real time performance and historical performance of the device 2 Download log files 3 Analy...

Страница 124: ...Administrative Tool p 124 Memory usage Network interfaces...

Страница 125: ...issues Please attach this information to any request to the G Technology support Logs Log files help troubleshooting in case of problems Especially when contacting technical support it is very import...

Страница 126: ...or further investigation or report it to the technical support engineers If a tough or critical problem persist in routine maintenance or troubleshooting contact G Technology for technical support Aft...

Страница 127: ...the installation of updates for the G RACK 12 existing software Once an update is available you will see a notice in the menu and plus button will be active To eliminate vulnerabilities within the G R...

Страница 128: ...snapshots will help you to roll the operating system back NOTE Snapshots of OS RAID are read only To take snapshot click the Take snapshot button The snapshots will be displayed in the list Reboot wi...

Страница 129: ...ed a fresh system to start a new project To be able to use the data with new settings backup the data to a different location perform Reset to Factory Settings and move the data back Also you can manu...

Страница 130: ...Hardware Description...

Страница 131: ...tion to the server board and chassis various hardware components have been included with the G RACK 12 as listed below Two passive CPU heat sinks Three 8 cm system fans One air shroud SATA Accessories...

Страница 132: ...escription p 132 Serverboard Features The G RACK 12 is built around a dual processor server board based on the Intel C612 chipset Below are the main features of the unit Intel C612 Chipset System Bloc...

Страница 133: ...the chipset to provide 10 SATA 3 0 6 Gbps ports I SATA0 5 supported by the Intel PCH and a vertical 4 port S SATA connection supported by the Intel SCU The SATA drives are hot swappable units PCI Exp...

Страница 134: ...mposed of two separate power modules This power redundancy feature allows you to replace a failed power supply without shutting down the system Hard Drive Subsystem The G RACK 12 chassis was designed...

Страница 135: ...sis includes three 8 cm hot plug system cooling fans located in the middle section of the chassis An air shroud channels the air flow from the system fans to efficiently cool the processor area of the...

Страница 136: ...cific components There are also two buttons on the chassis control panel Control Panel Buttons There are two buttons located on the front of the chassis a reset button and a power on off button Reset...

Страница 137: ...or details on replacing the power supply This LED should be off when the system is operating normally Information LED This LED will be blue when the UID function has been activated When this LED ashes...

Страница 138: ...e G RACK 12 this LED indicates hard drive activity for any drive in the system Each drive carrier also has an LED for individual activity Power Indicates power is being supplied to the system s power...

Страница 139: ...Blue Solid On SATA drive installed Blue Blinking I O activity Status LED Red Solid On Failed drive for SATA with RSTe support Red Blinking at 1 Hz Rebuild drive for SATA with RSTe support Red Blinkin...

Страница 140: ...or data storage applications The chassis design optimizes every aspect of interior space without compromising superior cooling and is equipped with a redundant power supply Features Drives The chassis...

Страница 141: ...hips memory modules or gold contacts When handling chips or modules avoid touching their pins Put the motherboard add on cards and peripherals back into their antistatic bags when not in use For groun...

Страница 142: ...periodically Do not operate the server without drives or drive carriers in the drive bays Use only recommended server parts Make sure no wires or foreign objects obstruct airflow through the chassis...

Страница 143: ...easing the Inner Rail Each inner rail has a locking latch This latch prevents the server from coming completely out of the rack when the chassis is pulled out for servicing To mount the rail onto the...

Страница 144: ...he rack must be bolted to the floor before you slide the unit out for servicing Failure to stabilize the rack can cause the rack to tip over NOTE Do not use a two post telco type racks as they will no...

Страница 145: ...pty carriers without hard drives installed must remain in the chassis Removing a Drive Carrier 1 Push the release button located beside the drive s LEDs 2 Swing the handle fully out and use it to pull...

Страница 146: ...Hardware Description p 146 Mounting a Drive in a Carrier Caution Regardless of how many hard drives are installed all drive carriers must remain in the drive bays to maintain proper airflow...

Страница 147: ...g chips or modules avoid touching their pins Put the card and peripherals back into their antistatic bags when not in use General Safety Guidelines Always disconnect power cables before installing or...

Страница 148: ...d in section 4 1 lay the chassis on a flat stable surface and remove the chassis cover 2 Remove the two screws from the sides of the chassis cover 3 Press the release tabs to remove the cover from the...

Страница 149: ...lock the cover 3 Slide the cover toward the rear of the chassis 4 Lift the cover off the chassis Removing the Chassis Cover Installing Hard Drives The G RACK 12 chassis supports twelve hot swappable 3...

Страница 150: ...ds up to two additional 2 5 hard drives Instructions on the following pages Removing a 3 5 Hard Drive Carrier Removing a Hard Drive Carrier Removing Hard Drive Carriers 1 Press the release button on t...

Страница 151: ...short periods of time swapping hard drives do not operate the server with the hard drive bays empty Note Your operating system must have RAID support to enable the hot swap capability of the drives D...

Страница 152: ...a desk table or work bench 4 Slide the hard drive into the carrier with the printed circuit board side facing down 5 Carefully align the mounting holes in the hard drive and the carrier Make sure the...

Страница 153: ...r provides hot swap capability with SAS SATA drive state indication The backplane is already pre configured so no jumper or switch configurations are required Caution Use care when working around the...

Страница 154: ...the server without the chassis cover in place The cover must be in place to allow proper air ow and prevent overheating Replacing System Fans Three heavy duty fans provide cooling for the chassis Rep...

Страница 155: ...full load and allow the system to continue operation without interruption The Power Fail LED on the front control panel will illuminate and remain on until the failed unit has been replaced The power...

Страница 156: ...e handle to pull it straight out with the rounded handle Installing a New Power Supply 1 Replace the failed hot swap unit with another identical power supply unit 2 Push the new power supply unit into...

Страница 157: ...m the motherboard backplane and other components 3 Remove both power supplies 4 Locate the power distributor between the power supply and the fan row 5 Remove the three screws securing the power suppl...

Страница 158: ...S SATA drives Each drive carrier displays two status LEDs on the front of the carrier Green When illuminated this LED indicates drive activity It blinks on and off when that particular drive is being...

Страница 159: ...Use Cases Tutorials...

Страница 160: ...chose the RAID level you desire Once you have done that you can check off the number of disks you want in the volume 4 Click Save 5 Confirm you want to create the RAID volume 6 Once the RAID volume i...

Страница 161: ...te the creation of the share How do I set up notifications 1 Prior to selecting which notifications you wish to receive you mush configure the email connection that will allow you to receive them This...

Страница 162: ...e g Bonjour or if there is no DHCP server available utilize the default IP address to connect and set a static IP address of 172 16 12 12 It is recommended to use an IP Search Utility when accessing...

Страница 163: ...stems Icon 2 Select the Systems Information function 3 Click on the Logs tab 4 You have the option of downloading the logs as a text file for viewing in an editor 5 To download all log files at once o...

Страница 164: ...physical drive is about to fail The simple method of seeing a physical drive issue is on the Dashboard The section marked Drive Health will give you the first indication of a drive issue Beyond that y...

Страница 165: ...Select a workspace which you want to take a snapshot of 3 From the Workspaces menu select the Make Snapshot option 4 You have the option to name the Snapshot s path and to allow the snapshot to be re...

Страница 166: ...data disks IMPORTANT This feature can as designed cause data loss Using it without understanding the implications can be catastrophic To wipe a physical disk 1 Navigate to Storage Physical disks 2 Se...

Страница 167: ...et up a network connection navigate to the Connect menu 2 Press the Network option 3 You will be presented with 4 tabs General Interfaces Service Discovery and Firewall 4 Select select the Interfaces...

Страница 168: ...Use Cases Tutorials p 168 7 Press save The values will change quickly on the system It make take a moment before equipment on your network notices the change...

Страница 169: ...s Service Discovery and Firewall 4 Select select the Interfaces tab 5 Click the listing for eth0 or the interface you wish to edit 6 Press the Edit button 7 The MTU value is at the bottom of the edit...

Страница 170: ...for a group that feature must be set identically on each member adapter In short Set all cards to the same Jumbo Frame setting Source https www attotech com software files manuals Manual_FFNICInstall...

Страница 171: ...searching for service providers according to certain criteria Therefore further service usage is a separate issue This option does not enable the service You have to do that in the Settings tab of eac...

Страница 172: ...the rules dialog 6 Select direction of the rule INPUT for inbound connections OUTPUT for outbound connections 7 Choose action for a packet which matches the rule ACCEPT allow the packet to pass over...

Страница 173: ...ave 6 If you need you can manually execute the job by pressing the Run button 7 You can edit or delete a command by using the Edit or Delete buttons How to allow access your G RACK 12 via SSH without...

Страница 174: ...Click Modules Tab 5 Click button 6 Choose the source workspace or create a new workspace 7 Choose settings you would like User authentication read write only Host allow deny 8 Click Save RSync module...

Страница 175: ...Enter password in the Password field 6 Choose the local destination select a workspace or create a new one 7 Choose settings you would like archive choose time date 8 Save job This Job will now execu...

Страница 176: ...et 6 User name and passwords are optional this is for authentication chap on systems that require it 7 Enter the field data that matches you network requirements In most cases the default values will...

Страница 177: ...who can access files folders on G RACK 12 If you are the administrator of G RACK 12 you can set access rights for users and groups Use Permissions menu to do this How to know the software version of...

Страница 178: ...old LUN The drive that I want to use as a hot spare says to have some information on it You can still use this physical disks as a hot spare To do this 1 Navigate Storage Physical Disks 2 Select the...

Страница 179: ...are unsure of the IP address see the section Finding the server IP address If this is your first time logging in you will use the default login Username admin Password gtech If you have logged in the...

Страница 180: ...Use Cases Tutorials p 180...

Страница 181: ...Use Cases Tutorials p 181 You will be presented with the option of selecting a theme There are three options you can take here 1 Media Entertainment Theme 2 General Theme 3 Skip Theme Selection...

Страница 182: ...New password for admin is required after your selection Follow these password word rules for setting a password Minimum number of characters is 5 A Z a z 0 9 The password will need to be confirmed an...

Страница 183: ...Use Cases Tutorials p 183 Once you have entered a new password you are presented with the option of allowing the G RACK 12 to email you when there are system events...

Страница 184: ...Use Cases Tutorials p 184 You need to click the enable slider to activate this option...

Страница 185: ...Use Cases Tutorials p 185 If you choose to activate email notifications then you must complete the email fields as seeing in this example...

Страница 186: ...iguration option is Creating User Accounts When you get to this screen use the plus symbol to add a new user to the server You have the option of giving each user their own Workspace storage area or a...

Страница 187: ...want a single Workspace If the server is established to create storage for each user to have their files on then you will want to select the Create Workspace for each user option As you create users...

Страница 188: ...l Cut Pro X Project Shares Only Your system should support file based Project Shares using SMB Samba CIFS NFS or AFP Example application Adobe Photoshop iSCSI Project Shares Your system should support...

Страница 189: ...Use Cases Tutorials p 189 For the purpose of this walk through we have selected both iSCSI and Project Shares You will need to select what percentage of storage to reserve for each storage type...

Страница 190: ...share Workspaces can be accessed using various protocols You can turn on and off each type on this next screen If you are unsure which to use then leave them all on until you can determine which are b...

Страница 191: ...Use Cases Tutorials p 191 Lastly a review is presented before the shares are created...

Страница 192: ...Use Cases Tutorials p 192 Once you confirm the process starts...

Страница 193: ...Use Cases Tutorials p 193 The next screen you see is the G RACK 12 Dashboard Follow the other use cases for more detail on the dashboard...

Страница 194: ...defaults settings will erase the data and settings for the server From the dashboard click the three line drop down on the upper right of the screen You will be asked to confirm and type in the word...

Страница 195: ...sport Control Protocol TCP and allows the SCSI command to be sent end to end over local area networks LANs wide area networks WANs or the Internet Unlike file sharing protocols it presents the option...

Страница 196: ...rives missing that are clearly in the server Troubles with the G RACK 12 software Failure to boot Unexpected data loss How do I know how full my server is with data The best way to see exactly how muc...

Страница 197: ...r client computer such that the client computer sees both the previous NAS device and the G RACK 12 Migrating the data can be done via line command file tools or click and drag on an operating system...

Страница 198: ...Use Cases Tutorials p 198 If you like you can import an SSL certificate generated outside the G RACK 12 or you use a generated certificate by filling in all the fields and pressing Save...

Страница 199: ...12 We recommend using HGST drives with your G RACK 12 HGST drives are properly tested and certified to be completely compatible with your server If you choose a different brand of drives we advise th...

Страница 200: ...TTPS is generally desired and used for encrypted and secure communication This option is available once you have created or imported a SSL certificate Steps on how to do this are included elsewhere in...

Страница 201: ...on the G RACK 12 If something seems high you can click each of them for more details Check the system status es of the G RACK 12 If the CPU or memory are very busy this is an indicator of why the sys...

Страница 202: ...of this LUN or create new ones How to change RAID level RAID levels are set at the time you set up your Workspaces In order to make a change to an existing RAID set do the following Backup the data on...

Страница 203: ...m You can allow guest access via anonymous FTP for this you need the user just needs to know the IP address of the G RACK 12 server NOTE you will not see these users in the Dashboard For more secure c...

Страница 204: ...Use Cases Tutorials p 204 How to access an AFP shared workspace On OSX all you need to do is open your finder and look for the Shared connections on the left hand side...

Страница 205: ...erver and click on it How to access an NFS shared workspace Mounting a NFS share on Windows can be seeing here https technet microsoft com en us library cc754350 aspx Mounting a NFS share on OSX can b...

Страница 206: ...necessary move the data and if necessary delete the old target so that the free space can be reallocated If you are fully at capacity the best option is to purchase a G RACK Expansion Chassis This uni...

Страница 207: ...on GRack Navigate to Connect Rsync Click Server Tab Toggle on the Enable switch Click Modules Tab Click button Choose the source workspace or create a new workspace Choose settings you would like Use...

Страница 208: ...remote G RACK 12 Navigate to Connect RSync Click icon to add a new job Choose job type as remote Choose mode as Pull Enter the Source server info Without user authentication Enter the destination IP f...

Страница 209: ...w user and password Click on General Tab Toggle on User authentication Click Save To now use this module it will require user authentication RSync can be used on a regular client computer but it will...

Страница 210: ...l disks into a logical drive and apply one the the existing RAID levels Depending on the RAID level selected performance redundancy storage capacity and reliability of the logical drive will differ Mo...

Страница 211: ...rformance with small random requests Performance driven single or multi threaded applica tions RAID 5 Disk striping with distributed parity High read perfor mance medium write performance with data pr...

Страница 212: ...in and follow these steps 1 Navigate to the Storage menu select the RAID 2 Click Add button to start the process of adding a physical disk to the selected RAID 3 Create a new RAID Name your RAID volum...

Страница 213: ...ounted automatically The selected RAID is highlighted the Mount button is inactive How to grow a RAID array There are times when you want the size of your RAID array to be larger Here are the steps to...

Страница 214: ...Select drives to be added to the RAID from the list of the available drives 4 Confirm your choice and press Save 5 Important Remember to balance the RAID array after growing Highlight the RAID array a...

Страница 215: ...Use Cases Tutorials p 215 6 The RAID is ready...

Страница 216: ...e times when you want to reduce the number of drives in a RAID array By following these steps you can shrink your RAID array 1 To shrink your data RAID array use the RAID menu and press the Shrink but...

Страница 217: ...r RAID array to be ready for a drive failure How to assign a new disk as a Hot Spare NOTE Hot spare icon is only active after selecting a RAID 1 Go to the Storage and select the RAID menu 2 Click Hot...

Страница 218: ...ve probably has existing data You can still use this physical disks as a hot spare To do this 1 Navigate Storage Physical Disks 2 Select the new hot spare disk 3 Click wipe and confirm 4 All data will...

Страница 219: ...r the Storage menu Find the name of the drive to know the number of the disk slot 2 Pull out the failed drive 3 Pull in a brand new one 4 Go to the G RACK 12 Administrative tool click on the Storage t...

Страница 220: ...nge to a State of good How to change a RAID array level At this time there is no method available for changing a RAID level If you must have a new RAID level then 1 Backup the data of the current RAID...

Страница 221: ...iSCSI Essentials...

Страница 222: ...otocol allowing organizations to consolidate storage into data center storage arrays while providing hosts such as database and web servers with the illusion of locally attached disks Unlike some SAN...

Страница 223: ...rought to the iSCSI Settings page where you must first enable the iSCSI service by switching the enable toggle to On green and pressing the Save button The iSCSI service might already be toggled On if...

Страница 224: ...multitude of performance and initiator parameters G RACK 12 s default advanced parameter configuration has already been maximized for performance but if your network or administrator choose to persona...

Страница 225: ...LUNs within a Target resulting in multiple Volumes much like a partition for a Directly Attached Storage device DAS However you should know that once a G RACK 12 iSCSI target has been initialized by...

Страница 226: ...y of the current LUNs For this instance we will discuss the Edit LUN function Highlight the auto generated LUN id 0 and press the Edit LUN button You will be presented with the G RACK 12 s Edit LUN pa...

Страница 227: ...a new LUN with id0 Add LUNs LUN s correspond to Volumes that are mounted on your desktop The G RACK 12 has made adding additional LUNs simple Navigate to the iSCSI SCST under the Connect menu and sele...

Страница 228: ...iSCSI Essentials p 228 Links and references https en wikipedia org wiki ISCSI...

Страница 229: ...cedure and reboot when prompted at the end of the process Once the application has been installed and the system restart has rebooted your workstation access System Preferences from the Mac pull down...

Страница 230: ...other workstation already has a particular iSCSI target mounted To download and install SANmp you will have to sign up for a dongle to be sent to you from SNS or a qualified reseller You can contact S...

Страница 231: ...your disk you can launch and login When prompted to enter a password use the default password adminpw111 which can be changed later on if you wish From the SANmp admin tool highlight your initialized...

Страница 232: ...e credentials that were created on the Admin workstation Now highlight the SANmp managed volume and press the Read Write button SANmp Client will reach out to the SANmp admin tool and other devices on...

Страница 233: ...al and when prompted type sudo purge iSCSI initiators are not compatible with one another So if you have a different brand installed on your system you will have to uninstall it before working with SN...

Страница 234: ...Troubleshooting...

Страница 235: ...disk drive When adding a new drive you will want to look for activity to see that synchronization has started 4 Network activity What does the network activity light mean When data is flowing on off...

Страница 236: ...Additionally the Ethernet ports on the unit will indicate if they have a good connection and if data is flowing User interface 1 If you are having issues with data access or speed please login to the...

Страница 237: ...Active Directory AD on the G RACK 12 you must furnish the admin credentials so the server can access the AD listing of users and groups from the Windows Server Once properly connected the G RACK 12 wi...

Страница 238: ...RACK12 has multiple Ethernet ports that can be configured in different ways If you would The Connections window is simply showing you that you have multiple paths IP to access your iSCSI target Best p...

Страница 239: ...op option and press connect 5 Once connected you will be prompted to format the target Format the target to your specific needs in Disk Utility Users could not see all mounted volumes in Finder OS X I...

Страница 240: ...iles The AFP time machine will show as an available Time Machine restore point Mac OSX El Capitan GlobalSAN iSCSI 5 3 0 518 The GlobalSAN iSCSI Initiator throws an easily avoidable error Header and Da...

Страница 241: ...a list of items you need to complete this task G RACK 12 with all the electronic components in place and properly working This process fails if you do not have the drives in the unit A G Technology pr...

Страница 242: ...message that you can t boot there is an excellent change the BIOS is not set to boot of the USB key If this is the case you will need to reboot and enter the BIOS screen Select USB boot as an option S...

Страница 243: ...Troubleshooting p 243 2 Using your keyboard scroll down to the second option Install RAID1 and press Enter 3 Immediately the install process starts...

Страница 244: ...244 4 As it progresses you will see the update bar change 5 If you see this screen you have successfully installed the software The server is ready to reboot Remove the USB key from the back of the un...

Страница 245: ...e to remove the USB keyboard and the monitor from the connectors 8 At this point you can use the Administration software using a web browser The screen above indicates the IP address you can enter in...

Страница 246: ...lient has to either Authenticate each transaction or Go into the client side permissions and amend the everyone W R option in order to use an application that requires constant transactions FCPX etc S...

Страница 247: ...F A Q...

Страница 248: ...24 GB of Load Reduced LRDIMM or 512 GB of Registered RDIMM ECC DDR4 2133 1866 1600 memory For best performance install pairs of memory modules of the same type and speed Please refer to our website fo...

Страница 249: ...rounded Grounding What is grounding In electrical engineering ground or earth is the reference point in an electrical circuit from which voltages are measured a common return path for electric current...

Страница 250: ...by the size of batteries in the UPS Properly configured and featured UPS units will send a signal to the server to shutdown properly when battery levels are low Additionally when power is restored an...

Страница 251: ...com apple finder AppleShowAllFiles YES Then relaunch Finder by holding option command and right click on Finder to relaunch Dot files will show after ACLS Permissions on the G RACK 12 When using ACLs...

Страница 252: ...ace and hit Apply with recursive toggled on Do it on top level workspace and permissions will apply throughout workspace all files added to workspace should have same permissions There is a known conf...

Страница 253: ...ace you can t find is not missing Immediately after wizard setup if you picked both NAS and iSCSI then the RAID volume for NAS shows as half the space being already used Where you will find the other...

Страница 254: ...evel The server comes pre configured with RAID level 5 How to I upgrade drives If you wish to replace all the drives the most simple method is to backup the data power down the unit remove all the cur...

Страница 255: ...to replace drives one at time if you wish to keep the RAID set intact When you remove a drive from a RAID set it take a period of time to re sync the RAID Replacing more than one drive at a time could...

Страница 256: ...body but specifically the enterprises The role file systems play in storage devices Each file system has a different take on how and where to put data on the disks Where files are stored and how they...

Страница 257: ...inode number BTRfs_ROOT_ITEM_KEY Transaction ID The updated btree blocks are all flushed to disk and then the super block is updated to point to the new root tree Once the super block has been proper...

Страница 258: ...r development it may or may not improve performance to match ext4 in the future BTRfs has shown high disk consumption on small files BTRfs advantages BTRfs will provide new features such as the copy o...

Страница 259: ...redundancy and this might be by choice since a patch to allow nearly arbitrary levels of redundancy in RAID was submitted years ago I keep hoping this is just attributed to growing pains and BTRfs RAI...

Страница 260: ...d striping is done directly by the filesystem so you can have different volumes that have inner redundancy BTRfs allocation tree For example Block group 2 is configured for RAID1 redundancy So a chunk...

Страница 261: ...ent based file storage 2 64 byte 16 EiB maximum file size practical limit is 8 EiB due to Linux VFS Space efficient packing of small files Space efficient indexed directories Dynamic inode allocation...

Страница 262: ...ed to domain and users imported navigate to Workspaces again 5 Open permissions view and set permissions on domain users groups 6 Go back to Active Directory and disable 7 Open up workspace permission...

Страница 263: ...be sent We are only able to produce this in our lab and have not heard any reports of data loss in the field but to be safe we opted to enable the policy We filed a bug report and have tested each sub...

Страница 264: ...server can be asked to do Because of this is recommended that you watch the CPU utilization on the dashboard of the Administration tool or by navigating to System System Information Performance stati...

Страница 265: ...loped a large and expanding user base mainly video hobbyists and independent filmmakers Does G RACK 12 support Final Cut Pro X G RACK 12 Absolutely supports Final Cut Pro X The performance and storage...

Страница 266: ...in Settings change the Number of Servers from 8 to 16 Alter the Advanced Options field no_subtree_check insecure async NOTE Change Add Workspace window the admin has to change privileges from Read onl...

Страница 267: ...12 and use FCP If you have selected iSCSI as your method of connecting Please review the G RACK 12 iSCSI Essentials to get the optimal speed for your connections Understand that OS X does not come wi...

Страница 268: ...as rebooted your workstation access System Preferences from the Mac pulldown menu Press the new GlobalSAN and Xtarget icon located at the bottom of System Preferences and follow SNS s instructions to...

Страница 269: ...col workflow Final Cut Pro X can once again enjoy the benefits of network connectivity and performance in a shared workflow The high level overview One ingest client transfers media to an SMB share On...

Страница 270: ...ommunication formats are installed onto G RACK 12 s structure and each serves a different function Protocols can be analogous to driving across country There are many different routes one could take E...

Страница 271: ...link on the fly newly added files on the SMB share to the Library and read the same files simultaneously from multiple clients on the network will lead to higher productivity Links and references http...

Страница 272: ...Technical Support Warranty...

Страница 273: ...support If you encounter any difficulties while installing or using your G RACK 12 please contact G Technology Technical Support at www g technology com contact contact_support Helpful information fo...

Страница 274: ...lteration to hardware or software tampering unsuitable physical or operating environment beyond product specifications improper maintenance or failure caused by a product for which HGST is not respons...

Страница 275: ...ty limited HGST AND ITS AFFILIATES SUPPLIERS DISTRIBUTORS AND RESELLERS ARE NOT LIABLE FOR ANY OF THE FOLLOWING 1 THIRD PARTY CLAIMS AGAINST YOU FOR DAMAGES OTHER THAN BODILY INJURY INCLUDING DEATH AN...

Страница 276: ...The Software is licensed to you and not sold Subject to the terms of this Agreement HGST hereby grants you a limited non exclusive non transferable non sublicensable and revocable license to use the S...

Страница 277: ...omated check for Updates if applicable you hereby agree and consent to automatically request and receive Updates from HGST and that the terms and conditions of this Agreement together with any additio...

Страница 278: ...ce Provider or Third Party Content owner You acknowledge that you may be required to enter into a separate agreement with a Service Provider or Third Party Content owner or comply with a Service Provi...

Страница 279: ...SERVICES OF THIRD PARTIES ACCESSED THROUGH the SOFTWARE TO THE EXTENT YOU CHOOSE TO USE OR ACCESS ANY THIRD PARTY CONTENT THROUGH the SOFTWARE YOU DO SO AT YOUR OWN INITIATIVE AND ARE RESPONSIBLE FOR...

Страница 280: ...trade embargo currently Iran Cuba Syria North Korea and Sudan or anyone on any of the U S government s Lists of Parties of Concern including the U S Treasury Department s list of Specially Designated...

Страница 281: ...c The restrictions of Section 1 2 13 and 14 of this Agreement only apply to any applicable Open Source software when and to the extent that they do not conflict with any terms of the Open Source softw...

Страница 282: ...om this Agreement If no such modification is possible the other provisions of this Agreement shall remain in full force and effect A waiver by either party of any term or condition of this Agreement o...

Страница 283: ...Glossary...

Страница 284: ...over the network DNS Domain Name Service A system that allows a network name server to translate text host names into numeric IP addresses used to uniquely identify any device connected to the Interne...

Страница 285: ...also Protocol iSCSI Internet Small Computer System Interface iSCSI is an IP based storage networking standard for linking data storage facilities LAN Local Area Network A system in which computer use...

Страница 286: ...is both striped and mirrored Mirroring provides data protection and striping improves performance See also mirror and stripe RAID 5 A level of RAID protection A volume with RAID 5 is built from a min...

Страница 287: ...ta being sent over a network or the Internet SSL uses a system of keys like secret passwords to send and receive files securely Streaming Media Media such as audio video and photos that are constantly...

Страница 288: ...ave access level permissions associated with them Volume Data storage space that can be made up of one or more disk drives or of only part of a single disk drive WAN Wide Area Network A computer netwo...

Страница 289: ...Appendices...

Страница 290: ...for Internal External Cascading Expander Combination for high performance high availability or high redundancy requirements 1x IPMI port for Remote System Power on off and system monitoring Support NT...

Страница 291: ...stem to continue to boot These error messages normally appear on the screen Fatal errors will not allow the system to continue with bootup If a fatal error occurs you should consult with your system m...

Страница 292: ...tacts When handling chips or modules avoid touching their pins Put the card and peripherals back into their antistatic bags when not in use General Safety Guidelines Always disconnect power cables bef...

Страница 293: ...ower source Circuit Breaker This product relies on the building s installation for short circuit over current protection Ensure that the protective device is rated not greater than 60VDC 20 A Power Di...

Страница 294: ...turning when you remove the fan assembly from the chassis Keep fingers screwdrivers and other objects away from the openings in the fan assembly s housing DC Power Supply When stranded wiring is requ...

Страница 295: ...t a bunch of disks Each drive can be ac cessed as an individ ual volume Usable storage capacity is 100 of total avail able storage No fault tolerance Audio applications RAID 0 Disk striping Offers the...

Страница 296: ...tal capacity of all drives in the array less the Content creation applications requir ing data protection performance RAID 6 Block level striping with double distributed parity Double parity provides...

Отзывы:

Нет отзывов