manualshive.com logo in svg

Qlogic iSR6200, Руководство пользователя программного обеспечения

Поделиться
Скачать
Qlogic iSR6200 Скачать руководство пользователя страница 8

viii

ISR654608-00  B

Data Migration Service for iSR6200

User’s Guide

Data Migration Jobs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

3-3

Job Attributes. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

3-3

Migration Types . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

3-4

Offline Data Migration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

3-4

Online Data Migration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

3-4

Job Scheduling  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

3-4

Immediate Schedule . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

3-4

Delayed Schedule  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

3-5

Serial Schedule  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

3-5

Configure Only  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

3-5

Job States . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

3-6

Protection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

3-7

Logs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

3-7

Users  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

3-8

4

Data Migration Licenses

Types of Data Migration Licenses  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

4-1

Capacity-based Licenses  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

4-1

Array-based Licenses . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

4-2

Installing a Data Migration License Key . . . . . . . . . . . . . . . . . . . . . . . . . . . .

4-2

Applying an Array-based License to a Specific Array. . . . . . . . . . . . . . . . . .

4-4

Viewing Data Migration License Usage . . . . . . . . . . . . . . . . . . . . . . . . . . . .

4-6

5

Performing Data Migration 

Typical Data Migration Process . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

5-2

Presenting LUNs to the iSR6200 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

5-3

LUN Presentation from Fibre Channel Arrays . . . . . . . . . . . . . . . . . . .

5-3

LUN Presentation from iSCSI Arrays  . . . . . . . . . . . . . . . . . . . . . . . . .

5-4

Presenting LUNs to the Server for Online Data Migration . . . . . . . . . . . . . .

5-5

Mapping Initiators to LUNs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

5-7

Setting Array Properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

5-8

Creating a Data Migration Job Group. . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

5-10

Using the Data Migration Wizard . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

5-10

Starting the Data Migration Wizard  . . . . . . . . . . . . . . . . . . . . . . . . . . .

5-11

Scheduling an Individual Data Migration Job  . . . . . . . . . . . . . . . . . . .

5-11

Scheduling Data Migration Jobs in Batch Mode . . . . . . . . . . . . . . . . .

5-14

Starting Serial Scheduled Jobs  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

5-16

Viewing the Status of Data Migration Jobs . . . . . . . . . . . . . . . . . . . . . . . . . .

5-17

Viewing Job Details and Controlling Job Actions . . . . . . . . . . . . . . . . . . . . .

5-17

Содержание iSR6200

Страница 1: ...ISR654608 00 B Data Migration Service for iSR6200 User s Guide...

Страница 2: ...age xv Removed obsolete reference to switching to DMS mode added reference to new SNMP appendix What s in This Guide on page xv Updated features descriptions and added online DMS Moved Feature Details...

Страница 3: ...on page 6 88 Updated the array rm command example array rm on page 6 6 Added example of migration acknowledge command for acknowledging an online data migra tion job migration acknowledge on page 6 2...

Страница 4: ...ample showing command output for an array that returns multiple WWULNs show migration_luninfo on page 6 74 Updated start_serial jobs command example start_serial_jobs on page 6 87 Updated the targetma...

Страница 5: ...or configur ing several types of host multipathing software Appendix A Configuring the Data Path Through iSR6200 for Online Data Migration Added new appendix of SNMP information for data migration eve...

Страница 6: ...vi ISR654608 00 B Data Migration Service for iSR6200 User s Guide...

Страница 7: ...Training xviii Contact Information xix Knowledge Database xix 1 Introduction 2 Getting Started Supported Configurations 2 1 Supported Topologies 2 1 Direct Attach Configuration 2 1 Fabric Configurati...

Страница 8: ...se to a Specific Array 4 4 Viewing Data Migration License Usage 4 6 5 Performing Data Migration Typical Data Migration Process 5 2 Presenting LUNs to the iSR6200 5 3 LUN Presentation from Fibre Channe...

Страница 9: ...Sessions 6 1 Admin Session 6 1 Miguser Session 6 2 Commands 6 2 array rm 6 6 array_licensed_port rm 6 7 compare_luns acknowledge 6 8 compare_luns add 6 9 compare_luns pause 6 12 compare_luns resume 6...

Страница 10: ...ators_lunmask 6 58 show iscsi 6 59 show logs 6 60 show luninfo 6 61 show luns 6 64 show memory 6 66 show mgmt 6 68 show migration 6 69 show migration_logs 6 71 show migration_luninfo 6 74 show migrati...

Страница 11: ...Completing Data Migration Jobs 8 1 A Configuring the Data Path Through iSR6200 for Online Data Migration Windows Multipath Configuration A 2 Linux Multipath Configuration A 4 HP UX Multipath Configur...

Страница 12: ...ine Fibre Channel and iSCSI Arrays 2 8 4 1 Features Page License Information 4 3 4 2 New License Key Dialog Box 4 3 4 3 Add License Dialog Box 4 4 4 4 License Array Dialog Box 4 5 4 5 Information Page...

Страница 13: ...figuring Microsoft MPIO on Windows 2008 A 2 A 2 Configuring Array Specific Multipathing on Windows A 3 A 3 Configuring Native Device Mapper Multipath on Linux A 4 A 4 Configuring EMC PowerPath on Linu...

Страница 14: ...xiv ISR654608 00 B Data Migration Service for iSR6200 User s Guide...

Страница 15: ...uter Manager utility and covers the intended audience related materials document conventions and contact information for technical support The remainder of this guide is organized into the following c...

Страница 16: ...on Windows Linux HP UX and Solaris operating systems Appendix B Simple Network Management Protocol provides reference material for the simple network management protocol SNMP which you can use to man...

Страница 17: ...1 lists the possible data migration job states For details see Starting Serial Scheduled Jobs on page 4 23 For more information visit www qlogic com Text in bold font indicates user interface element...

Страница 18: ...gic Technical Support others will be redirected to their authorized maintenance provider Visit the QLogic support Web site listed in Contact Information for the latest firmware and software updates Av...

Страница 19: ...hed by the following methods Knowledge Database The QLogic knowledge database is an extensive collection of QLogic product information that you can search for specific solutions We are constantly addi...

Страница 20: ...Preface Technical Support xx ISR654608 00 B...

Страница 21: ...6200 supports data migration across heterogeneous arrays arrays manufactured by different vendors For a list of the storage array types for which DMS currently provides support see Supported Storage A...

Страница 22: ...l being migrated to higher speed 4Gb and 8Gb Fibre Channel arrays using higher speed 4Gb and 8Gb Fibre Channel switches Data migration service logs DMS logs are maintained separately from the system l...

Страница 23: ...ons This section describes and illustrates the supported topologies direct attach fabric and multipath and lists the supported fabric and array types Supported Topologies Supported topologies include...

Страница 24: ...ts and one port from each iSR6200 blade connected to each fabric This configuration enables the iSR6200 to perform load balancing Figure 2 2 Single and Dual Blade High Availability Setup Table 2 2 sho...

Страница 25: ...the typical configurations used for offline and online data migration using iSR6200 models Chapter 5 Performing Data Migration and Appendix A Configuring the Data Path Through iSR6200 for Online Data...

Страница 26: ...rt number DA n Destination array controller A port number DB n Destination array controller B port number BL n FC n VPG n iSR6200 blade number Fibre Channel port number and virtual port group number P...

Страница 27: ...Started Supported Configurations ISR654608 00 B 2 5 Figure 2 5 illustrates both online and offline data migration between two Fibre Channel storage arrays Figure 2 5 Online and Offline Two Fibre Chann...

Страница 28: ...B Figure 2 6 illustrates both online and offline data migration between two Fibre Channel storage arrays using iSR6260 models with four Fibre Channel ports per blade eight total Fibre Channel ports Fi...

Страница 29: ...8 00 B 2 7 Figure 2 7 illustrates both online and offline data migration between two Fibre Channel arrays using iSR6260 models when the Fibre Channel fabric is also upgraded Figure 2 7 Online and Offl...

Страница 30: ...SI Arrays Supported Fibre Channel Fabrics DMS is currently supported with Brocade McDATA Cisco and QLogic 2Gb 4Gb and 8Gb Fibre Channel fabrics Supported Storage Arrays Table 2 3 lists the storage arr...

Страница 31: ...roup Modular Storage WMS family Universal Storage Platform USP family Hewlett Packard HP HP StorageWorks Modular Storage Array MSA family HP StorageWorks Enterprise Virtual Array EVA family HP Storage...

Страница 32: ...details on various topology configurations see Data Migration Configuration on page 2 3 Software Setup Software setup for DMS includes the following Zoning Perform zoning on the Fibre Channel switches...

Страница 33: ...fied name IQN targets using iSCSI login It forms an array when at least one data LUN is presented to the iSR6200 from that array If no data LUN is presented to the iSR6200 all array ports are shown in...

Страница 34: ...eously supports both iSCSI connectivity and data migration service Typically you would use the None attribute when the iSR6200 is used to provide only iSCSI connectivity for that storage array Array b...

Страница 35: ...uling on page 3 4 Job States on page 3 6 Job Attributes Data migration jobs include the following attributes Migration Type Data migration jobs can be either online or offline For details see Migratio...

Страница 36: ...on Online Data Migration DMS as an online service allows you to use the iSR6200 to migrate data while the application remains online and continues to access the data Currently online service supports...

Страница 37: ...serial schedule starts no more than four to eight jobs are running simultaneously and ensures optimum data migration performance In order to achieve this serial scheduling requires a job priority for...

Страница 38: ...d A running job has been paused by the user You can resume or stop a paused job A paused job that is resumed continues running from the point where it was paused Stopped A running scheduled failed or...

Страница 39: ...be configured for a different job until the current job is acknowledged or removed DMS detects the normal configuration of Windows OS partitions on the data LUN Before fully configuring a data migrati...

Страница 40: ...of users Administrative user admin For managing the iSR6200 you must be in an administrative session The default password for the administrator is config Data migration user miguser This user session...

Страница 41: ...based licenses Capacity based Licenses Capacity based licenses allow you to migrate data up to a specific limit designated by the applied license key This type of license is available in variants of 5...

Страница 42: ...iguring jobs for data migration Array based licenses allow you to migrate data in and out of the specified licensed array For example consolidating three or four source arrays onto a single destinatio...

Страница 43: ...3 Figure 4 1 Features Page License Information The New License Key dialog box opens as shown in Figure 4 2 Figure 4 2 New License Key Dialog Box 5 Type a valid DM license key and then click OK The Ad...

Страница 44: ...ager or the CLI If you have purchased array based licenses and installed the licenses in the iSR6200 follow these steps to license a specific array for data migration For every array that is licensed...

Страница 45: ...enses Applying an Array based License to a Specific Array ISR654608 00 B 4 5 Figure 4 4 License Array Dialog Box The Information page for the selected array now shows the Array License as Licensed as...

Страница 46: ...CSI FC Router Manager or the CLI Follow this procedure to view the usage of data migration licenses in the GUI to view the licenses in the CLI see show migration_usage on page 6 78 To view data migrat...

Страница 47: ...4 Data Migration Licenses Viewing Data Migration License Usage ISR654608 00 B 4 7 Figure 4 6 Data Migration Info...

Страница 48: ...4 Data Migration Licenses Viewing Data Migration License Usage 4 8 ISR654608 00 B...

Страница 49: ...tiators to LUNs on page 5 7 Setting Array Properties on page 5 8 Creating a Data Migration Job Group on page 5 10 Using the Data Migration Wizard on page 5 10 Starting Serial Scheduled Jobs on page 5...

Страница 50: ...he iSR6200 access to LUNs from source and destination arrays Presenting LUNs to the iSR6200 on page 5 3 5 Discover arrays and set array proper ties Setting Array Properties on page 5 8 6 Apply the arr...

Страница 51: ...data migration ensure that server has no longer access to source LUNs Deactivate zones 1 and 2 as described in Data Migration Configuration on page 2 3 11 For online data migration ensure that Pre Mig...

Страница 52: ...as the same LUN ID if possible as presented to the server If multiple servers are being migrated at the same time using the same iSR6200 and different LUNs are presented to the different server as the...

Страница 53: ...r successful iSCSI login the iSCSI target comes online 6 Optional To discover the newly presented LUNs and form the new arrays if required follow these steps a In the left pane of SANsurfer iSCSI FC R...

Страница 54: ...and to create a presented target on these portals See Mapping Initiators to LUNs on page 5 7 Because SANsurfer Router Manager performs an array based LUN presentation the LUN is presented to an initia...

Страница 55: ...rs to LUNs SANsurfer iSCSI FC Router Manager provides the Target Presentation LUN Mapping Wizard to map Fibre Channel initiators to LUNs for online data migration This mapping provides the access for...

Страница 56: ...password 5 Type the admin password and then click Next 6 On the LUN Masking Configuration Status window review the results of the target ports presented for the selected initiators and then click Fini...

Страница 57: ...ies 3 Optional In the Symbolic Name box type a user friendly array name 4 From the Target Type list select Source 5 From the Array Bandwidth list click one of the following values Slow 50MB s Medium 2...

Страница 58: ...up Follow these steps to create a data migration job group in SANsurfer iSCSI FC Router Manager To create a data migration job group 1 In the left pane click the Services tab to open the Services page...

Страница 59: ...gration Job dialog box click Options 5 In the Migration Schedule Options dialog box select either Schedule in batch mode or Schedule individual job 6 Click OK 7 Depending on your selection in the prec...

Страница 60: ...ata Migration Jobs Options dialog box opens Figure 5 3 shows an example NOTE SANsurfer iSCSI FC Router Manager does not allow you to drag a LUN from an array of Source type in the right pane and drop...

Страница 61: ...icates that the job is scheduled earlier than jobs configured with higher values For details on Serial Schedule Jobs see Starting Serial Scheduled Jobs on page 5 16 Click Configure Only to configure t...

Страница 62: ...bs need to be classified under a specific group for better management DMS allows a maximum of eight jobs to run simultaneously at any specific time per source array To optimize iSR6200 performance QLo...

Страница 63: ...b name is created by using the source and destination array names 4 Repeat the preceding steps to create migration jobs for all source LUNs to be migrated in a batch 5 To save your migration job and a...

Страница 64: ...tion job options click Apply Or to abandon changes to this data migration job click Cancel Starting Serial Scheduled Jobs If the individual or batch data migration job you created was configured as a...

Страница 65: ...arized view of all active jobs including the following columns of information 3 To see a summarized view of all completed jobs click the Completed Data Migration Jobs tab in the right pane 4 To view a...

Страница 66: ...In the left pane on the Services page under the Data Migration Jobs node click a migration group to view the status for all jobs belonging to that specific group 3 In the left pane select a migration...

Страница 67: ...and Controlling Job Actions ISR654608 00 B 5 19 Figure 5 5 Data Migration Job Information Page NOTE For online data migration jobs log details include the Number of DRL Dirty Region Log Blocks for off...

Страница 68: ...ing System and Data Migration Job Logs SANsurfer iSCSI FC Router Manager provides two types of logs system and data migration job This section describes how to open and view each log type System Log T...

Страница 69: ...te the contents of the log Click Export to download the logs in CSV file format that can be viewed in any spreadsheet application such as Microsoft Excel Click Print to send the contents of the log to...

Страница 70: ...following columns of information as shown in Figure 5 8 SeqID is the sequential ID of log entries Time Stamp is the log entry time based on router system time Group Name is the user defined job group...

Страница 71: ...verification jobs to compare data residing on two LUNs This ensures the data integrity of the migration process by performing a bit by bit comparison of the data on the source LUN with the correspondi...

Страница 72: ...pane open the Services page right click on either the Blade or Data Migration Jobs node and from the shortcut menu click Configure Verifying Job 3 In the Data Migration Security Check dialog box enter...

Страница 73: ...r iSCSI FC Router Manager keeps a track of all the data migration jobs until you either delete them from the system or acknowledge them after job completion You must acknowledge jobs to free up the de...

Страница 74: ...f you used an array based license for the data migration job and you plan to use this array again for migration you may keep the license when removing the array To remove an offline array 1 In the lef...

Страница 75: ...st account is the default user account used to log into the iSR6200 Telnet session The guest session has a view only type of access The default password for this account is password User Sessions User...

Страница 76: ...miguser stop iSR6200 1 Commands This section provides the DMS CLI commands arranged alphabetically by command name Table 6 1 lists by type the DMS commands used in the CLI and provides a cross referen...

Страница 77: ...6 19 show iscsi on page 6 59 LUN commands lunmask on page 6 20 show luninfo on page 6 61 show luns on page 6 64 Miscellaneous commands readjust_priority on page 6 40 reset on page 6 41 save capture on...

Страница 78: ...6 59i show logs on page 6 60 show luninfo on page 6 61 show luns on page 6 64 show memory on page 6 66 show mgmt on page 6 68 show migration on page 6 69 show migration_logs on page 6 71 show migrati...

Страница 79: ...6 Command Line Interface Commands ISR654608 00 B 6 5 VP Group commands set vpgroups on page 6 49 show vpgroups on page 6 86 Table 6 1 CLI Commands Continued Command Type Commands...

Страница 80: ...the list press q or Q and the ENTER key to do so Index WWPN PortId iScsiName Ip Add Symbolic Name Target Type 0 50 06 01 60 4b a0 35 f6 61 05 00 DGC RAID 0 Source Please select a Target Id to remove...

Страница 81: ...the array_licensed_port rm command iSR6200 1 miguser array_licensed_port rm 01 Symbolic name DGC RAID 1 No of ports registered 2 WWNN WWPN 50 06 01 60 cb a0 35 de 50 06 01 60 4b a0 35 de WWNN WWPN 50...

Страница 82: ...job is permanently deleted from the database Authority miguser Examples The following example shows the compare_luns acknowledge command iSR6200 1 miguser compare_luns acknowledge Job Type Status Job...

Страница 83: ...R6200 2 miguser compare_luns add A list of attributes with formatting and current values will follow Enter a new value or simply press the ENTER key to accept the current value If you wish to terminat...

Страница 84: ...oup Name 1 VPGROUP_1 2 VPGROUP_2 3 VPGROUP_3 4 VPGROUP_4 Please select a VPGroup for Destination Lun q to quit 1 LUN Vendor LUN Size GB Attributes 1 HP 10 00 SRC LUN 2 HP 10 00 3 HP 20 00 4 HP 20 00 5...

Страница 85: ...ine Interface compare_luns add ISR654608 00 B 6 11 Start Time 1 Now 2 Delayed 3 JobSerialScheduling 4 ConfigureOnly Now Successfully created Job All attribute values for that have been changed will no...

Страница 86: ...ob from the block where the compare was paused Authority miguser Examples The following example shows the compare_luns pause command iSR6200 1 miguser compare_luns pause Job Type Status Job Descriptio...

Страница 87: ...compare was paused Authority miguser Examples The following example shows the compare_luns resume command iSR6200 1 miguser compare_luns resume Job Type Status Job Description ID 0 Offline Verify Paus...

Страница 88: ...mple shows the compare_luns rm command iSR6200 1 miguser compare_luns rm Job Type Status Job Description ID 0 Offline Verify Running HP HSV200 0 0001 to DGC RAID 1 0000 Please select a Job Id from the...

Страница 89: ...command iSR6200 1 miguser compare_luns start Job Type Status Job Description ID 0 Offline Stopped HP HSV200 0 0001 to DGC RAID 1 0000 Please select a Job Id from the list above q to quit 0 Start Time...

Страница 90: ...command also on already configured scheduled jobs to change the scheduling time Authority miguser Examples The following example shows the compare_luns stop command iSR6200 1 miguser compare_luns sto...

Страница 91: ...8b a8 86 02 2 FC 20 00 00 e0 8b 88 86 02 21 00 00 e0 8b 88 86 02 Please select an Initiator from the list above q to quit 1 A list of attributes with formatting and current values will follow Enter a...

Страница 92: ...iSR6200 1 admin iscsi discover A list of attributes with formatting and current values will follow Enter a new value or simply press the ENTER key to accept the current value If you wish to terminate...

Страница 93: ...formatting and current values will follow Enter a new value or simply press the ENTER key to accept the current value If you wish to terminate this process before reaching the end of the list press q...

Страница 94: ...d iSR6200 1 admin lunmask add Index Type Mapped WWNN WWPN iSCSI Name 0 FC Yes 20 00 00 1b 32 0a 61 80 21 00 00 1b 32 0a 61 80 Please select an Initiator from the list above q to quit 0 Index WWNN WWPN...

Страница 95: ...200 1 admin lunmask rm Index WWNN WWPN iSCSI Name 0 50 0a 09 80 85 95 82 2c 50 0a 09 81 85 95 82 2c 1 20 00 00 14 c3 3d cf 88 21 00 00 14 c3 3d cf 88 2 20 00 00 14 c3 3d d3 25 21 00 00 14 c3 3d d3 25...

Страница 96: ...dge Job Type Status Job Description ID 0 Offline Completed 100 HP HSV200 0 LUN1 to DGC RAID 1 LUN0 Please select a Job Id from the list above q to quit 0 All attribute values for that have been change...

Страница 97: ...iguser migration add A list of attributes with formatting and current values will follow Enter a new value or simply press the ENTER key to accept the current value If you wish to terminate this proce...

Страница 98: ...50 06 01 61 4b a0 35 de 82 08 00 DGC RAID 3 Src Dest Please select a Destination Target from the list above q to quit 0 Index VpGroup Name 1 VPGROUP_1 2 VPGROUP_2 3 VPGROUP_3 4 VPGROUP_4 Please selec...

Страница 99: ...he ENTER key to accept the current value If you wish to terminate this process before reaching the end of the list press q or Q and the ENTER key to do so Migration Type 1 Online 2 Offline 1 Index WWP...

Страница 100: ...06 01 61 4b a0 35 de 82 08 00 DGC RAID 3 Src Dest Please select a Destination Target from the list above q to quit 1 Index VpGroup Name 1 VPGROUP_1 2 VPGROUP_2 3 VPGROUP_3 4 VPGROUP_4 Please select a...

Страница 101: ...The CLI lists the source arrays that you have previously defined and prompts you to select one 6 When prompted select a VP Group for the Source LUN 7 From the selected source array the CLI lists the L...

Страница 102: ...ity 2 The CLI informs you if the migration job is created successfully and saves any changes you have made The iSR6200 then schedules a migration job based on your inputs The following shows an exampl...

Страница 103: ...d5 9a 05 00 00 00 HP MSA2012fc 0 Src Dest 1 50 00 1f e1 50 0a e1 49 82 07 00 HP HSV200 1 Src Dest 2 50 06 01 60 4b a0 35 de 82 03 00 DGC RAID 2 Src Dest 3 50 00 1f e1 50 0a 37 18 00 00 00 HP HSV210 3...

Страница 104: ...Enter a Job Description Max 64 characters default name DGC RAID 2 VPG4 001 to HP HSV210 3 VPG1 001 Index Group Owner Group Name 0 1 Group 0 1 1 DM_Testing Please select a Group that this Job should be...

Страница 105: ...b from the block where the migration was paused Authority miguser Examples The following example shows the migration pause command iSR6200 1 miguser migration pause Job Type Status Job Description ID...

Страница 106: ...data migration was paused Authority miguser Examples The following example shows the migration resume command iSR6200 1 miguser migration resume Job Type Status Job Description ID 0 Offline Paused 80...

Страница 107: ...g example shows the migration rm command iSR6200 1 miguser migration rm Job Type Status Job Description ID 0 Offline Running 5 DGC RAID 2 VPG4 001 to HP HSV210 3 Please select a Job Id from the list a...

Страница 108: ...when the peer blade is down iSR6200 1 miguser migration rm_peer Job Type Status Job Description ID 0 Online Paused 13 MSA2012fc 0 VPG1 001 to MSA2012f Please select a Job Id from the list above q to...

Страница 109: ...mand iSR6200 1 miguser migration start Job Type Status Job Description ID 0 Offline Stopped HP HSV200 0 LUN1 to DGC RAID 1 LUN0 Please select a Job Id from the list above q to quit 0 Start Time for Jo...

Страница 110: ...it on already scheduled jobs to change the scheduling time Authority miguser Examples The following example shows the migration stop command iSR6200 1 miguser migration stop Job Id Type Status LUN ID...

Страница 111: ...in to the iSR6200 as guest and enter the password 2 Open a miguser session using the following command miguser start p migration The default password for miguser is migration 3 Create a migration gro...

Страница 112: ...e occurred when you typed the name while creating the data migration job group Authority miguser Examples The following example shows the migration_group edit command iSR6200 1 miguser migration_group...

Страница 113: ...jobs that need to be scheduled You may need to delete groups because there is limit of eight groups into which the iSR6200 can classify data migration jobs Authority miguser Examples The following exa...

Страница 114: ...fting the priority values on already configured jobs This readjustment reduces the priority value of the last job from 256 by the value of the priority of the currently running serial job and makes ro...

Страница 115: ...ormation for everything except the MGMT IP address Authority admin Syntax reset factory mappings Keywords factory Deletes router configuration and resets them to factory defaults mappings Deletes rout...

Страница 116: ...n the iSR6200 is exhibiting erroneous behavior This command generates a System_Capture tar gz file that provides a detailed analysis Authority admin Examples The following example shows the save captu...

Страница 117: ...50 00 1f e1 50 0a 37 18 00 00 00 HP HSV210 3 Src Dest Please select a Target Id from the list above q to quit 0 Symbolic Name Max 128 characters HP MSA2012fc 0 Target Type 1 SrcTarget 2 DstTarget 3 S...

Страница 118: ...20 78 00 c0 ff d5 9a 05 00 00 00 HP MSA2012fc 0 Src Dest 1 50 00 1f e1 50 0a e1 49 82 07 00 HP HSV200 1 Src Dest 2 50 06 01 60 4b a0 35 de 82 03 00 DGC RAID 2 Src Dest 3 50 00 1f e1 50 0a 37 18 00 00...

Страница 119: ...ey to accept the current value If you wish to terminate this process before reaching the end of the list press q or Q and the ENTER key to do so Index WWPN PortId Symbolic Name Target Type 0 50 00 1f...

Страница 120: ...q or Q and the ENTER key to do so WARNING The following command might cause a loss of connections to both ports Configuring FC Port 1 Port Status 0 Enable 1 Disable Enabled Link Rate 0 Auto 1 1Gb 2 2...

Страница 121: ...0 1 admin set features A list of attributes with formatting and current values will follow Enter a new value or simply press the ENTER key to accept the current value If you wish to terminate this pro...

Страница 122: ...of attributes with formatting and current values will follow Enter a new value or simply press the ENTER key to accept the current value If you wish to terminate this process before reaching the end o...

Страница 123: ...the ENTER key to do so Configuring VpGroup 1 Status 0 Enable 1 Disable Enabled VpGroup Name Max 64 characters VPGROUP_1 VPGroup 1 All attribute values for VpGroup 1 that have been changed will now be...

Страница 124: ...Type Src Dest WWPN 50 00 1f e1 50 0a e1 4c Port ID 01 2b 00 State Online WWPN 50 00 1f e1 50 0a e1 48 Port ID 01 29 00 State Online Array Bandwidth Available Bandwidth Load Balancing Enabled Array Lic...

Страница 125: ...18 Port ID 01 24 00 State Offline Array Bandwidth Available Bandwidth Load Balancing Enabled Array License Not Applied Symbolic Name HP MSA2012fc 3 State Online Vendor ID HP Product ID MSA2012fc Targ...

Страница 126: ...Scheduled CX 320 A VPG1 000 to MSA 2012 Please select a Compare Job Id from the list above q to quit 0 Compare Information Job Id 0 Job Owner b1 Job Description CX 320 A VPG1 000 to MSA 2012 VPG1 000...

Страница 127: ...P_1 WWPN 21 00 00 c0 dd 13 2c 60 VPGROUP_1 Port ID 8c 0a 00 VPGROUP_1 WWNN 20 01 00 c0 dd 13 2c 60 VPGROUP_2 WWPN 21 01 00 c0 dd 13 2c 60 VPGROUP_2 Port ID 8c 0a 01 VPGROUP_2 WWNN 20 02 00 c0 dd 13 2c...

Страница 128: ...UP_2 WWPN 21 01 00 c0 dd 13 2c 61 VPGROUP_2 Port ID 8c 0d 01 VPGROUP_2 WWNN 20 02 00 c0 dd 13 2c 61 VPGROUP_3 WWPN 21 02 00 c0 dd 13 2c 61 VPGROUP_3 Port ID 8c 0d 02 VPGROUP_3 WWNN 20 03 00 c0 dd 13 2...

Страница 129: ...w features Lists available features and shows the current license status of each Authority guest Examples The following example shows the show features command iSR6200 1 show features Feature Informat...

Страница 130: ...TION CAPACITY 10TB Chassis Licensed 0851E00034 Date Applied Wed Jan 14 01 14 21 2010 Key 4000000 LCJLNJPGOIQVC B53E7FA8 FCIP 1G FCIP 1Gig Chassis Licensed 0851E00034 Date Applied Wed Jan 14 01 16 23 2...

Страница 131: ...mmand iSR6200 2 show initiators Initiator Information WWNN 50 06 01 60 cb a0 35 de WWPN 50 06 01 69 4b a0 35 de Port ID 64 09 00 Status Logged In Type FC OS Type Windows WWNN 20 01 00 e0 8b a8 86 02 W...

Страница 132: ...sk Index Type WWNN WWPN iSCSI Name 0 FC 50 06 01 60 cb a0 35 de 50 06 01 69 4b a0 35 de 1 FC 20 01 00 e0 8b a8 86 02 21 01 00 e0 8b a8 86 02 2 FC 20 00 00 e0 8b 88 86 02 21 00 00 e0 8b 88 86 02 Please...

Страница 133: ...I Link Status Up iSCSI Name iqn 2004 08 com qlogic isr6200 0834e00029 b1 Firmware Revision 3 00 01 57 Current Port Speed Unknown Programmed Port Speed Auto MTU Size Normal Window Size 65536 MAC Addres...

Страница 134: ...0x2080000 VpIndex 0x1 10 09 2009 11 15 29 QLFC 3 0 QLIsrEventHandler RSCN update 8015 rscnInfo 0x2080000 VpIndex 0x2 10 09 2009 11 15 29 QLFC 3 0 QLIsrEventHandler RSCN update 8015 rscnInfo 0x2080000...

Страница 135: ...WWULNs are present iSR6200 1 show luninfo Index WWNN WWPN iSCSI Name 0 50 0a 09 80 85 95 82 2c 50 0a 09 81 85 95 82 2c 1 20 00 00 14 c3 3d cf 88 21 00 00 14 c3 3d cf 88 2 20 00 00 14 c3 3d d3 25 21 00...

Страница 136: ...WNN WWPN iSCSI Name 0 50 0a 09 80 85 95 82 2c 50 0a 09 81 85 95 82 2c 1 20 00 00 14 c3 3d cf 88 21 00 00 14 c3 3d cf 88 2 20 00 00 14 c3 3d d3 25 21 00 00 14 c3 3d d3 25 3 50 06 01 60 cb a0 35 f6 50 0...

Страница 137: ...fo ISR654608 00 B 6 63 LUN Number 5 VendorId DGC ProductId RAID 5 ProdRevLevel 0223 Portal 0 Lun Size 6144 MB Lun State Online LUN Path Information Controller Id WWPN PortId IQN IP Path Status 2 50 06...

Страница 138: ...Group LUN 20 78 00 c0 ff d5 9a 05 VPGROUP_1 0 VPGROUP_1 1 VPGROUP_1 2 VPGROUP_1 3 VPGROUP_1 4 VPGROUP_1 5 VPGROUP_1 6 VPGROUP_1 7 VPGROUP_1 8 VPGROUP_1 9 VPGROUP_1 10 VPGROUP_1 11 VPGROUP_1 12 VPGROUP...

Страница 139: ...0 VPGROUP_1 1 VPGROUP_1 2 VPGROUP_1 3 VPGROUP_1 4 VPGROUP_1 5 VPGROUP_1 6 VPGROUP_1 7 VPGROUP_1 8 VPGROUP_1 9 50 00 1f e1 50 0a 37 18 VPGROUP_1 0 VPGROUP_1 1 VPGROUP_1 2 VPGROUP_1 3 VPGROUP_1 4 VPGROU...

Страница 140: ...Memory Units Free Total Physical 198MB 1002MB Buffer Pool 11392 12416 Nic Buffer Pool 40960 40960 Process Blocks 8192 8192 Request Blocks 8192 8192 Event Blocks 4096 4096 Control Blocks 1024 1024 Cli...

Страница 141: ...7MB 1002MB Buffer Pool 7808 8832 Nic Buffer Pool 53344 65536 Process Blocks 8192 8192 Request Blocks 8192 8192 Event Blocks 4096 4096 Control Blocks 1024 1024 Client Req Blocks 8192 8192 FCIP Buffer P...

Страница 142: ...mask and gateway Authority guest Examples The following example shows the show mgmt command iSR6200 1 show mgmt Management Port Information IPv4 Interface Enabled IPv4 Mode Static IPv4 IP Address 172...

Страница 143: ...ID 7 VPG4 000 to HP HSV Please select a Migration Job Id from the list above q to quit 0 Migration Information Job Id 0 Job Owner b2 Job Description DGC RAID 7 VPG4 000 to HP HSV210 6 VPG1 004 Group N...

Страница 144: ...n DGC RAID 1 VPG1 008 to HP MSA2012fc 0 VPG1 003 Group Name Group 0 Migration Type Online Priority Not Applicable Migration Status Running I O Size 64 KB Migration State 0 Complete Migration Performan...

Страница 145: ...GED JobId 1 Offline of group Group 0 with priority 0 from Target HP HSV200 0 Lun 60 05 08 b4 00 07 59 a4 00 02 a0 00 03 ba 00 00 9 to Target HP HSV200 0 Lun 60 05 08 b4 00 07 59 a4 00 02 a0 00 00 83 0...

Страница 146: ...ion size 2 00 GB Mon Jan 12 06 42 44 2010 Seq id 3 Job Type Migration Online miguser STARTING MIGRATION MigrOwner 1 JobId 0 Online of group Group 0 with priority 0 from Target NETAPP LUN 0 Lun NETAPP...

Страница 147: ...roup Group 0 with priority 0 from Target HP HSV200 0 Lun 60 05 08 b4 00 07 59 a4 00 02 a0 00 00 7e 00 00 6 to Target HP HSV200 0 Lun 60 05 08 b4 00 07 59 a4 00 02 a0 00 00 83 00 00 7 with migration si...

Страница 148: ...and iSR6200 1 show migration_luninfo Index WWPN PortId iScsiName Ip Add Symbolic Name Target Type 0 50 0a 09 81 95 95 82 2c 00 00 00 NETAPP LUN 0 Src Dest 1 50 06 01 68 4b a0 35 f6 61 04 00 DGC RAID 3...

Страница 149: ...c Name Target Type 0 50 0a 09 81 95 95 82 2c 00 00 00 NETAPP LUN 0 Src Dest 1 50 06 01 68 4b a0 35 f6 61 04 00 DGC RAID 3 Src Dest 2 21 00 00 14 c3 3d d3 25 48 00 dc SEAGATE ST336754FC 2 Src Dest 3 21...

Страница 150: ...luninfo 6 76 ISR654608 00 B EUI Based WWULN 46 30 31 49 43 74 62 00 0a 98 00 68 70 54 51 61 T10 Based WWULN NETAPP LUN hpTQaF01ICtb LUN Path Information Controller Id WWPN PortId IQN IP Path Status 2...

Страница 151: ...time for a serial scheduled job The start time is set using the start_serial_jobs command see start_serial_jobs on page 6 87 Authority guest Examples The following example shows the show migration_pa...

Страница 152: ...096 77 GB License consumed by active jobs 0 00 GB Total capacity available 11191 23 GB Array Based Licenses Array based licenses issued 20 Array based licenses used 4 Available array based licenses 16...

Страница 153: ...Bytes s Bytes s Bytes s Bytes s Bytes s Number init_r init_w tgt_r tgt_w total GE1 0 0 0 0 0 GE2 0 0 0 0 0 FC1 23M 0 0 0 23M FC2 0 23M 0 0 23M In the following example 10GbE ports are present and show...

Страница 154: ...es sec total Press any key to stop display GE1 GE2 FC1 FC2 0 0 189M 189M 0 0 188M 188M 0 0 182M 182M 0 0 187M 187M 0 0 188M 188M 0 0 186M 186M 0 0 187M 187M 0 0 186M 186M 0 0 170M 170M 0 0 189M 189M I...

Страница 155: ...6 Command Line Interface show perf byte ISR654608 00 B 6 81 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0...

Страница 156: ...20 04 00 c0 dd 13 17 3e WWPN 21 04 00 c0 dd 13 17 3e Port ID 64 0b 01 Port FC1 Type FC MAPS TO WWNN 50 06 01 60 cb a0 35 de WWPN 50 06 01 69 4b a0 35 de VPGroup 1 iSCSI Presented Targets Name iqn 2004...

Страница 157: ...ISR654608 00 B 6 83 MAPS TO WWNN 20 70 00 c0 ff d5 9a 05 WWPN 21 70 00 c0 ff d5 9a 05 VPGroup 1 Name iqn 2004 08 com qlogic isr6200 0834e00029 b2 01 500601604ba035de Port GE1 MAPS TO WWNN 50 06 01 60...

Страница 158: ...es 6 84 ISR654608 00 B show properties Displays the CLI properties Authority guest Examples The following example shows the show properties command iSR6200 1 show properties CLI Properties Inactivty T...

Страница 159: ...LUNs are exposed to the router ports from the target no information is shown Authority guest Examples The following example shows the show targets command iSR6200 1 show targets Target Information WW...

Страница 160: ...ual port from each Fibre Channel port Because there are four virtual ports per Fibre Channel port there are four VP groups Authority guest Examples The following example shows the show vpgroups comman...

Страница 161: ...he following example shows the start_serial jobs command iSR6200 1 miguser start_serial_jobs Serial Job Start Time 1 Now 2 Delayed Now 2 Please specify a Date Time in MMddhhmmCCYY format when the seri...

Страница 162: ...rgetmap add Index WWNN WWPN iSCSI Name 0 50 0a 09 80 85 95 82 2c 50 0a 09 81 85 95 82 2c 1 50 06 01 60 cb a0 35 f6 50 06 01 60 4b a0 35 f6 2 20 00 00 14 c3 3d ea e9 21 00 00 14 c3 3d ea e9 Please sele...

Страница 163: ...ngs and hosts will loose access to disks Index State VpGroup Port WWNN WWPN iSCSI Name 0 Online 1 FC1 20 06 00 c0 dd 13 2c c4 21 06 00 c0 dd 13 2c c4 1 Online 1 FC1 20 04 00 c0 dd 13 2c c4 21 04 00 c0...

Страница 164: ...6 Command Line Interface targetmap 6 90 ISR654608 00 B...

Страница 165: ...speed RAID configuration of LUNs Amount of host I O on the LUN Maximizing Performance Suggestions for maximizing performance include the following Use the Array Bandwidth feature see Setting Array Pr...

Страница 166: ...LUNs are synchronized until the migration job is acknowledged Optimal Configuration and Zoning In order to get the best performance from the router configure your system as follows In the physical top...

Страница 167: ...ecommendations pertain to high availability HA and redundant configurations The iSR6200 is capable of detecting and performing load balancing over multiple paths To achieve the highest data migration...

Страница 168: ...erformance during data migration General Precautions Note the following general precautions While performing offline data migration ensure that hosts connected to source and destination LUNs are eithe...

Страница 169: ...priority Array reconfiguration precautions include the following If the LUN presentation from the array to the iSR6200 is changed click the Refresh button two or three times to see the changes Wait fo...

Страница 170: ...7 Performance and Best Practices Best Practices 7 6 ISR654608 00 B...

Страница 171: ...ed to a migration job remove or acknowledge the job If the LUN is masked to an initiator remove the LUN mask If a data migration job is completed or stopped on a specified LUN you must acknowledge or...

Страница 172: ...the LUN is masked to an initiator remove the LUN mask 2 On the switch remove the configured zones containing iSR6200 Fibre Channel ports and controller ports of the array 3 Wait for up to 30 seconds...

Страница 173: ...g multi pathing software under the following operating systems Windows 2003 Windows 2008 Red Hat Enterprise Linux RHEL 4 and 5 Novell SUSE Linux Enterprise Server SLES 10 and 11 HP UX 11 23 and 11 31...

Страница 174: ...path from controller port for example Port A 1 Zone out the first direct path from the Fibre Channel switch 2 Refresh the Device Manager to verify that the path has been removed from the disk list Ad...

Страница 175: ...ed in the DSM GUI on the host Adding router path for the removed controller port for example Port A The newly added path appears online and active on the host in the DSM GUI Depending upon the policy...

Страница 176: ...r example Port A The newly added path appears active or ready on the host in the multipath ll output Depending on the policy settings part of the host I O may start flowing through the path presented...

Страница 177: ...er path for the removed controller port for example Port A Perform a rescan on the Linux host to identify the new paths The Fdisk l command displays the LUN through the newly added path The powermt di...

Страница 178: ...gh the path presented by the router 1 To verify run the show perf byte command on the router to view the traffic flowing through the router ports 2 To rescan the new path through the router issue the...

Страница 179: ...ng command vgreduce dev vg1 dev dsk c1t0d1 where dev vg1 is the volume group and dev dsk c1t0d1 corresponds to the physical volume PV device entry for the con troller port that is removed from being d...

Страница 180: ...oving first direct path from controller port for example Port A It is not necessary to perform vgreduce on the direct path The powermt display dev all command displays the path state as dead The other...

Страница 181: ...r active path Adding router path for the removed controller port for example Port A 1 On the HP UX host after zoning in the router presented target controller for example Port A issue the ioscan comma...

Страница 182: ...first direct path from the Fibre Channel switch 2 To rescan the paths issue the devfsadm command and verify that the disabled path is no longer available 3 To check the number of paths now available...

Страница 183: ...th device command and ensure that the path in in an offline state Adding router path for the removed controller port for example Port B 1 Add the second router path by zoning the targetmap and host po...

Страница 184: ...A Configuring the Data Path Through iSR6200 for Online Data Migration Solaris Multipath Configuration A 12 ISR654608 00 B...

Страница 185: ...urfer iSCSI FC Router Manager or the CLI Table B 1 describes the SNMP parameters Table B 1 SNMP Parameters Parameter Description Read community A password that authorizes an SNMP management server to...

Страница 186: ...r disables the generation of traps in response to authentication fail ures The default is disabled Table B 2 SNMP Trap Configuration Parameters Parameter Description Trap n enabled Enables or disables...

Страница 187: ...rJobOpCode qsrJobOperation qsrJobPriority qsrJobStartType qsrJobErrorCode qsrEventTimeStamp qsrEventSeverity qsrBladeSlot Data Migration Service Notification Object Types qsrJobId OBJECT TYPE qsrJobOw...

Страница 188: ...us Current Description Data migration job type either online or offline Syntax Integer Status Current Description Data migration job operation type either migration or com parison Syntax Integer Statu...

Страница 189: ...eady started regardless of the start type Syntax Integer Status Current Description Data migration job error codes for all failed migration jobs For all other jobs and job states this field remains as...

Страница 190: ...B Simple Network Management Protocol Notifications B 6 ISR654608 00 B...

Страница 191: ...the iSR6200 For more information see show targets on page 6 85 The migration add command does not show any source or destination array By default the target type attribute for an array is Unknown Use...

Страница 192: ...g associated migration jobs and zoning out the original set of LUNs In order to keep the LUN object database maintained by the iSR6200 in a sane state ensure that you explic itly acknowledge or remove...

Страница 193: ...nline and the LUN state is offline make sure that the LUN presented to the iSR6200 at the time of configuring the job has not been replaced by another LUN at the time of starting the job This is a cas...

Страница 194: ...C Troubleshooting C 4 ISR654608 00 B...

Страница 195: ...red in a table form Each line in the file corre sponds to a row in the table Within a line fields are separated by commas each field belonging to one table column data migration The process of transfe...

Страница 196: ...O iSCSI Internet small computer system interface Transmits native SCSI over the TCP IP stack In a system supporting iSCSI a user or software application issues a command to store or retrieve data on a...

Страница 197: ...rate disks into one logical storage unit LUN to improve reliability and or perfor mance redundant array of independent inexpensive disks See RAID SAN Storage area network Multiple storage units disk d...

Страница 198: ...world wide port name See WWPN world wide unique LUN name See WWULN WWNN World wide node name Unique 64 bit address assigned to a device WWPN World wide port name Unique 64 bit address assigned to eac...

Страница 199: ...practices 7 5 data migration license applying to specific in CLI 6 45 definition of Glossary 1 details removing from persistence 6 6 information viewing 6 50 license applying to specific in GUI 4 4 a...

Страница 200: ..._luns rm 6 14 compare_luns start 6 15 compare_luns stop 6 16 initiator mod 6 17 iscsi discover 6 18 iscsi login 6 19 lunmask 6 20 migration acknowledge 6 22 migration add 6 23 migration pause 6 31 com...

Страница 201: ...ow typical 5 2 typical steps 5 1 user session 3 8 data migration job groups creating in CLI 6 37 creating in GUI 5 10 editing name in CLI 6 38 feature details 3 2 name selecting in CLI 6 28 removing i...

Страница 202: ...faults resetting factory 6 41 delayed schedule 3 5 deleting array licensed ports offline 6 7 data migration job groups in CLI 6 39 data migration job in CLI 6 33 LUN compare job in CLI 6 14 destinatio...

Страница 203: ...2 2 hardware setup 2 9 help troubleshooting C 1 high availability See HA history revision ii host multipathing software configuring A 1 I I O definition of Glossary 2 size for migration job setting in...

Страница 204: ...I 6 13 scheduling in CLI 6 9 stopping in CLI 6 16 lunmask command 6 20 LUNs definition of Glossary 2 detailed information viewing 6 64 ID restriction on changing 8 1 information showing 6 74 mapping t...

Страница 205: ...hanging initiator s 6 17 overview DMS 1 1 user guide xv P parameters SNMP B 1 password SNMP default B 1 path definition of Glossary 3 information for LUN viewing 6 61 pausing compare LUN job in CLI 6...

Страница 206: ...aming data migration job group in CLI 6 38 reset command 6 41 restarting compare LUN job in CLI 6 15 data migration job in CLI 6 35 restoring factory defaults 6 41 restrictions 8 1 resuming compare LU...

Страница 207: ...ented targets 6 82 virtual port group information 6 86 small computer system interface See SCSI SNMP B 1 definition of Glossary 3 notifications B 2 object types B 3 B 5 parameters configuring B 1 trap...

Страница 208: ...ons CLI 6 1 admin 6 1 miguser 6 2 user sessions types of 3 8 V verify jobs status of viewing 6 52 Verify Migration Job dialog box 5 24 Verify Schedule Options dialog box 5 24 verifying data migration...

Страница 209: ...ide unique LUN name See WWULN WWNN definition of Glossary 4 viewing for array 6 78 viewing for Fibre Channel port 6 53 viewing for targets 6 85 WWPN definition of Glossary 4 viewing for array 6 78 vie...

Страница 210: ...demark of Network Applicance Inc Novell and SUSE are registered trademarks of Novell Inc Oracle is a registered trademark of Oracle Corporation Red Hat is a registered trademark of Red Hat Inc Solaris...

Отзывы:

Нет отзывов

Бренды по названию

Популярные бренды

Загрузить еще бренды