manualshive.com logo in svg

Sun Microsystems StorEdge 3510, Manual

Share
Download
Sun Microsystems StorEdge 3510 Manual Download Page 37

Best Practices for the Sun StorEdge 3510 and 3511 FC Arrays

33

Full-Fabric SAN Configurations

FIGURE 11

Typical Full-Fabric SAN Configuration

Note –

The Sun StorEdge 3511 SATA array cannot be used to store single instances

of data but can be used in multi-path and multi-host configurations where the array
has a backup or archival role.

 

Summary of Contents for StorEdge 3510

Page 1: ...n com Submit comments about this document at http www sun com hwdocs feedback Sun StorEdge 3000 Family Best Practices Manual Sun StorEdge 3510 FC Array Sun StorEdge 3511 FC Array with SATA Part No 816 7325 15 June 2004 Revision A ...

Page 2: ...LEGALLY INVALID Copyright 2004 Dot Hill Systems Corporation 6305 El Camino Real Carlsbad Californie 92009 Etats Unis Tous droits réservés Sun Microsystems Inc et Dot Hill Systems Corporation peuvent avoir les droits de propriété intellectuels relatants à la technologie incorporée dans le produit qui est décrit dans ce document En particulier et sans la limitation ces droits de propriété intellectu...

Page 3: ...rage Architectures 5 Fibre Channel Protocols 6 Supported RAID Levels 7 Logical Drives 7 Cache Optimization 9 Array Management Tools 11 Saving and Restoring Configuration Information 12 Direct Attached Storage 12 Storage Area Networking 13 Scaling Capacity 14 First Steps 16 General Configuration Considerations 17 Configuring an Array s RCCOM Channel 18 Cautions 20 ...

Page 4: ...Setup Details 28 Six Node High Availability DAS Setup Details 31 Full Fabric SAN Configurations 33 Full Fabric SAN Tips and Techniques 34 Full Fabric SAN Setup Details 35 High Performance SAN Configurations 38 High Performance SAN Tips and Techniques 39 High Performance SAN Setup Details 40 Scaling Arrays Into High Capacity Configurations 43 Limitations 43 Sun StorEdge 3510 FC Array High Capacity ...

Page 5: ...al Note The primary use of the two arrays is very different due to different disk technologies Be sure to read the following Overview section and the Comparison of the Sun StorEdge 3510 FC Array and the Sun StorEdge 3511 SATA Array on page 3 for optimum use of each array Overview Today s business educational and consumer environments continue to create a seemingly inexhaustible amount of informati...

Page 6: ...n of the StorEdge 3511 SATA array The StorEdge 3511 SATA array is designed for applications requiring lower cost bulk storage not a trait of FC disk based solutions where application or data availability is not a primary concern The StorEdge 3511 SATA array is only used for archival backup or static storage it is not used to store single instances of data and cannot serve as a boot device Designed...

Page 7: ...ses data corruption TABLE 1 Comparison of Sun StorEdge 3510 FC Array and the Sun StorEdge 3511 SATA Array Features Sun StorEdge 3510 FC Array Sun StorEdge 3511 SATA Array Applications Best suited for production applications where the superior features of FC technical characteristics and performance is a requirement This includes the below online applications Database Decision Support Data warehous...

Page 8: ...shares the same loop as channel 0 of the bottom RAID controller This provides four distinct loops for connectivity The individual loops provide LUN failover without causing HBA path failover in the event of a controller failure A single RAID controller configuration is slightly different The lower I O board has drive channels but does not have host channels Overall the same number of loops are ava...

Page 9: ...n the lower controller Channels 0 and 1 support 1 Gbit or 2 Gbit data transfer speed Channels 4 and 5 provide two ports per loop one port on each controller Channels 4 and 5 only support 2 Gbit data transfer speed Each RAID controller has two ports designated as disk drive loops The drive ports support only 2 Gbit data transfer speed These ports connect to the internal Serial ATA disk drives using...

Page 10: ...o point protocol with the Sun StorEdge 3500 series arrays requires a switched fabric network SAN whereas selecting FC AL mode enables the arrays to be used in either DAS or SAN environments Using point to point protocol enables full duplex use of the available channel bandwidth whereas selecting FC AL mode limits host channels to half duplex communication In a point to point configuration only one...

Page 11: ...ely event of disk failure It is good practice to use spare drives when configuring RAID devices Refer to the Sun StorEdge 3000 Family RAID Firmware User s Guide for detailed information about how RAID levels and spare drives are implemented Logical Drives A logical drive LD is a group of physical drives configured with a RAID level Each LD can be configured for a different RAID level Sun StorEdge ...

Page 12: ...6 2 14 31 14 31 28 36 14 36 73 4 7 28 7 28 12 30 6 27 146 8 4 14 4 14 6 26 3 13 TABLE 3 Maximum Usable Capacity Gbyte per Sun StorEdge 3510 FC Array Logical Drive Disk Capacity RAID 5 Random RAID 5 Sequential RAID 3 Random RAID 3 Sequential RAID 1 Random RAID 1 Sequential RAID 0 Random RAID 0 Sequential 36 2 471 1086 471 1086 507 543 507 1122 73 4 440 1982 440 1982 440 1101 440 1982 146 8 440 1908...

Page 13: ...other cable is connected to a different channel on the lower controller Then if multipathing software is configured on the host a controller can be hot swapped in the event of failure without losing access to the LUN For example suppose partition 0 of LD0 is mapped to Channel 0 PID 42 and Channel 5 PID 47 To ensure that there is no single point of failure SPOF connect a cable from the host HBA or ...

Page 14: ...fter the controller resets There are two limitations that apply to the optimization modes One optimization mode must be applied to all logical drives in a RAID array Once the optimization mode is selected and logical drives are created the optimization mode of those logical drives cannot be changed The only way to change the optimization mode is to delete all logical drives select the new optimiza...

Page 15: ... be scripted and information can be passed to other programs Information about CLI functionality can be found in the Sun StorEdge 3000 Family CLI User s Guide and in the sccli man page once the package is installed The StorEdge 3511 SATA array will respond more slowly than the StorEdge 3510 FC Array when being managed via either CLI or Configuration Service Due to this it is not recommended to use...

Page 16: ...n also be used to rebuild all logical drives and therefore can be used to completely duplicate an array s configuration to another array Direct Attached Storage One powerful feature of Sun StorEdge 3500 series arrays is their ability to support multiple direct attached servers without requiring storage switches They accomplish this by using intelligent internal Fibre Channel networks Servers can b...

Page 17: ...controller or channel 1 both FC1 ports of either controller on a Sun StorEdge 3511 SATA array you must use host filtering if you want to control host access to storage Refer to the user documentation for your clustering software to determine whether the clustering software can manage host access in this configuration Storage Area Networking Combining storage switches with a Sun StorEdge 3500 serie...

Page 18: ...age capacity can be allocated among servers and eliminates cabling changes when reallocation of storage becomes necessary When a Sun StorEdge 3500 series array is deployed in a SAN both point to point full fabric and arbitrated loop public loop modes are supported Point to point mode allows for slightly better full duplex performance but limits the total number of addressable LUNs to 128 or to 64 ...

Page 19: ...y be connected with Sun StorEdge 3511 SATA expansion units Arrays and expansion units for the two systems can not be mixed Sun StorEdge 3500 series arrays remain single storage systems as expansion units are added even though there are multiple interconnected physical units Expansion units simply add bays to base units to increase the total number of disks that can be supported A fully configured ...

Page 20: ...re four or fewer servers a DAS solution is sufficient Sun StorEdge 3511 SATA Array Seven or more servers If there are six or fewer servers a DAS solution is sufficient If you connect two servers to channel 0 or to channel 1 use host filtering if you want to control host access to logical drives With either the Sun StorEdge 3510 FC array or the Sun StorEdge 3511 SATA array a SAN solution can be a p...

Page 21: ...on of data flow Single controller arrays are provided for small configurations requiring fast scratch disk as in EDA environments Sun StorEdge 3500 series arrays are extremely flexible but when designing storage solutions remember to keep them as simple as possible Keep the following suggestions in mind when designing the configuration of a Fibre Channel storage system To ensure power redundancy c...

Page 22: ...twork Sun Alert 26464 After completing the configuration of a Sun StorEdge 3500 series array the configuration should be saved using the firmware Save nvram to disks menu option and the Sun StorEdge Configuration Service Console s save configuration utility Configuring an Array s RCCOM Channel Redundant controller communication RCCOM provides the communication channels by which two controllers in ...

Page 23: ...onfirm 10 Choose Yes to reset the controller Using Channels 4 and 5 as RCCOM Channels When only channels 0 and 1 are used for communication with servers another option is to assign channels 4 and 5 as dedicated RCCOM channels This reduces the impact of RCCOM on the drive channels by removing RCCOM from drive channels 2 and 3 In this configuration however channels 4 and 5 cannot be used to communic...

Page 24: ...es to confirm 18 Choose Yes to reset the controller Cautions Caution The UNIX and Solaris format and Solaris probe scsi all commands do not display all mapped LUNs if there is not a partition or logical drive mapped to LUN 0 Caution Do not use both in band and out of band connections at the same time to manage the array Otherwise conflicts between multiple operations might occur Caution Suspend al...

Page 25: ...t a connection becomes unreliable or fails This is not a recommended configuration unless host based mirroring is utilized to protect against single points of failure FIGURE 4 Three Non Redundant DAS Configurations Note The Sun StorEdge 3511 SATA array cannot be used to store single instances of data but can be used in multi path and multi host configurations where the array has a backup or archiv...

Page 26: ...tions Dual Server Configurations Quad Server Configurations Number of Servers 1 2 4 RAID Enclosures 1 1 1 Expansion Units As needed As needed One or more Number of Controllers 1 1 1 Number of Disks 5 or more 12 or more 24 or more Cache Optimization Sun StorEdge 3510 FC array Random or sequential Random or sequential Random or sequential Cache Optimization Sun StorEdge 3511 SATA array Sequential Se...

Page 27: ...ort 2 Gbit FC HBA in single server or dual server configurations makes optimum use of the Fibre Channel array s performance Mapping logical drive partitions to two paths while using multipathing software and load balancing provides the best performance Non Redundant DAS Setup Details FIGURE 5 and FIGURE 6 show a Sun StorEdge 3500 series arrays in a non redundant configurations FIGURE 5 Sun StorEdg...

Page 28: ...sary to support the connections needed 2 Connect expansion units if needed Sun StorEdge 3510 FC Array See Sun StorEdge 3510 FC Array High Capacity Configurations on page 44 Sun StorEdge 3511 SATA Array See Sun StorEdge 3511 SATA Array High Capacity Configurations on page 53 TABLE 8 Setup Summary for Non Redundant DAS Channel Number Primary ID Number Secondary ID Number 0 40 N A 1 43 N A 2 14 N A 3...

Page 29: ...channel 5 7 Map Logical Drive 2 if created to controller channel 1 8 Map Logical Drive 3 if created to controller channel 4 9 Connect the first server to controller port FC0 10 Connect the second server if needed to controller port FC5 11 Connect the third server if needed to controller port FC1 12 Connect the fourth server if needed to controller port FC4 13 After completing the configuration sav...

Page 30: ...ces of data but can be used in multi path and multi host configurations where the array has a backup or archival role TABLE 9 Configuration Overview for High Availability DAS Single Server Configurations Dual Server Configurations Quad Server Configurations Number of Servers 1 2 4 RAID Enclosures 1 1 1 Expansion Units As needed As needed One or more Number of Controllers 2 2 2 Single Server Dual S...

Page 31: ...e redundancy and high availability use multipathing software such as Sun StorEdge Traffic Manager To configure multipathing Establish two connections between a server and a Sun StorEdge Fibre Channel array Install and enable the software on the server Number of Disks 5 or more 12 or more 24 or more Cache Optimization Sun StorEdge 3510 FC Array Random or sequential Random or sequential Random or se...

Page 32: ...RE 9 show a Sun StorEdge 3510 FC array and a Sun StorEdge 3511 SATA array in a high availability DAS configuration FIGURE 8 Sun StorEdge 3510 FC Array High Availability DAS Connections Note The Sun StorEdge 3511 SATA array cannot be used to store single instances of data but can be used in multi path and multi host configurations where the array has a backup or archival role Server 1 Server 3 Serv...

Page 33: ...f installed SFP modules Move them as necessary to support the connections needed 2 Connect expansion units if needed Sun StorEdge 3510 FC Array See Sun StorEdge 3510 FC Array High Capacity Configurations on page 44 TABLE 10 Setup Summary for High Availability DAS Channel Number Primary ID Number Secondary ID Number 0 40 N A 1 N A 42 2 14 15 3 14 15 4 44 N A 5 N A 46 H D RCC H D RCC Server 1 Server...

Page 34: ...rimary controller 10 Map Logical Drive 3 if created to channels 1 and 4 of the secondary controller 11 Connect the first server Server 1 to port FC0 of the upper controller and port FC5 of the lower controller 12 Connect the second server Server 2 if needed to port FC1 of the lower controller and port FC4 of the upper controller 13 Connect the third server Server 3 if needed to port FC0 of the low...

Page 35: ...n StorEdge 3511 SATA array cannot be used to store single instances of data but can be used in multi path and multi host configurations where the array has a backup or archival role The general procedure for creating this configuration follows 1 Add SFPs to support twelve connections 2 Connect expansion units if needed See Sun StorEdge 3511 SATA Array High Capacity Configurations on page 53 3 Conf...

Page 36: ...r 2 to the right most port FC0 of the upper controller and port FC5 of the lower controller 13 Connect the third server Server 3 to port FC4 of the upper controller and the left most FC1 port of the lower controller 14 Connect the fourth server Server 4 to port FC5 of the upper controller and the right most FC1 port of the lower controller 15 Connect the fifth server Server 5 to the left most FC1 ...

Page 37: ...l Fabric SAN Configurations FIGURE 11 Typical Full Fabric SAN Configuration Note The Sun StorEdge 3511 SATA array cannot be used to store single instances of data but can be used in multi path and multi host configurations where the array has a backup or archival role ...

Page 38: ...to 8 2 to 16 Cache Optimization Sequential Sequential Sequential Sun StorEdge 3510 FC array Number of Servers 2 to 4 2 to 14 2 to 30 Cache Optimization Random or sequential Random or sequential Random or sequential Common Parameters RAID Enclosures 1 1 1 Expansion Units As needed As needed As needed Number of Controllers 2 2 2 Number of Disks 12 or more 12 or more 12 or more RAID Levels Applicatio...

Page 39: ...e 3511 SATA array no connections can be made with the other three ports of that channel If channel 0 port FC0 is connected to a fabric switch for example the second port for channel 0 on that controller and the FC0 ports on a redundant controller cannot be used Similarly if channel 1 port FC1 is connected to a fabric switch the second FC1 port on that controller and the FC1 ports on a redundant co...

Page 40: ... installed SFP modules Move them as necessary to support the connections needed 2 Connect expansion units if needed Sun StorEdge 3510 FC Array See Sun StorEdge 3510 FC Array High Capacity Configurations on page 44 TABLE 12 Setup Summary for Full Fabric SAN Channel Number Primary ID Number Secondary ID Number 0 40 N A 1 N A 42 2 14 15 3 14 15 4 44 N A 5 N A 46 H D RCC H D RCC Server 1 Server 2 Swit...

Page 41: ...ntroller 9 Map Logical Drive 1 to channels 1 and 5 of the secondary controller 10 If more than two logical drives were created map even numbered logical drives to channels 0 and 4 of the primary controller and odd numbered logical drives to channels 1 and 5 of the secondary controller 11 Connect the first switch to port FC0 of the upper controller and port FC1 of the lower controller 12 Connect th...

Page 42: ...be used in multi path and multi host configurations where the array has a backup or archival role TABLE 13 Configuration Overview for High Performance SAN Small Configuration Medium Configuration Large Configuration Number of Servers Sun StorEdge 3511 SATA array 2 to 4 2 to 4 2 to 8 Number of Servers Sun StorEdge 3510 FC array 2 to 4 2 to 14 2 to 62 RAID Enclosures 1 1 1 Expansion Units As needed ...

Page 43: ... Sun StorEdge 3511 SATA array no connections can be made with the other three ports of that channel If channel 0 port FC0 is connected to a fabric switch for example the second port for channel 0 on that controller and the FC0 ports on a Number of Disks 12 or more 12 or more 12 or more Cache Optimization Sun StorEdge 3510 FC array Random or sequential Random or sequential Random or sequential Cach...

Page 44: ...port for channel 1 on that controller and both FC1 ports on a redundant controller cannot be used High Performance SAN Setup Details FIGURE 15 and FIGURE 16 shows a Sun StorEdge 3510 FC array and a Sun StorEdge 3511 SATA array in a high performance SAN configuration FIGURE 15 Sun StorEdge 3510 FC Array High Performance SAN Connections Server 1 Server 2 Switch 1 Switch 2 ...

Page 45: ...f installed SFP modules Move them as necessary to support the connections needed 2 Connect expansion units if needed Sun StorEdge 3510 FC Array See Sun StorEdge 3510 FC Array High Capacity Configurations on page 44 TABLE 14 Setup Summary for a High Performance SAN Channel Number Primary ID Number Secondary ID Number 0 40 N A 1 N A 42 2 14 15 3 14 15 4 44 N A 5 N A 46 H D RCC H D RCC Server 1 Serve...

Page 46: ...al Drive 1 to channels 0 1 4 and 5 of the secondary controller 10 If more than two logical drives were created map even numbered logical drives to channels 0 1 4 and 5 of the primary controller and odd numbered logical drives to channels 0 1 4 and 5 of the secondary controller 11 Connect the first switch to port FC0 of the upper controller and port FC1 of the lower controller 12 Connect the second...

Page 47: ... capacity configurations Use sequential optimization instead Random cache optimization greatly reduces the maximum number of supported disks Only the cabling configurations detailed in this section are supported when configuring high capacity Sun StorEdge 3500 series arrays Maximize the size of each logical drive up to 1 908 Gbyte for RAID 5 logical drives before creating another logical drive Oth...

Page 48: ... to a Sun StorEdge 3511 SATA array Recommendations These configurations work best when you select the highest capacity disk available without exceeding maximum limits set by the firmware Refer to the Sun StorEdge 3000 Family FRU Installation Guide for information about supported disk drives cables SFPs and other user replaceable items The use of a full fabric SAN configuration is highly recommende...

Page 49: ...Best Practices for the Sun StorEdge 3510 and 3511 FC Arrays 45 Connecting One Expansion Unit FIGURE 17 Sun StorEdge 3510 FC Array Configuration with One Expansion Unit ...

Page 50: ...46 Sun StorEdge 3000 Family Best Practices Manual June 2004 Connecting Two Expansion Units FIGURE 18 Sun StorEdge 3510 FC Array Configuration with Two Expansion Units ...

Page 51: ...Best Practices for the Sun StorEdge 3510 and 3511 FC Arrays 47 Connecting Three Expansion Units FIGURE 19 Sun StorEdge 3510 FC Array Configuration with Three Expansion Units ...

Page 52: ...48 Sun StorEdge 3000 Family Best Practices Manual June 2004 Connecting Four Expansion Units FIGURE 20 Sun StorEdge 3510 FC Array Configuration with Four Expansion Units ...

Page 53: ...ation using five expansion units requires the configuration of RAID channels 4 and 5 as drive channels This restricts host connections to RAID channels 0 and 1 affecting supported host configurations Use four expansion units or fewer when possible FIGURE 21 Sun StorEdge 3510 FC Array Configuration with Five Expansion Units ...

Page 54: ...tion using six expansion units requires the configuration of RAID channels 4 and 5 as drive channels This restricts host connections to RAID channels 0 and 1 affecting supported host configurations Use four expansion units or fewer when possible FIGURE 22 Sun StorEdge 3510 FC Array Configuration with Six Expansion Units ...

Page 55: ...tion using seven expansion units requires the configuration of RAID channels 4 and 5 as drive channels This restricts host connections to RAID channels 0 and 1 affecting supported host configurations Use four expansion units or fewer when possible FIGURE 23 Sun StorEdge 3510 FC Array Configuration with Seven Expansion Units ...

Page 56: ...ion using eight expansion units requires the configuration of RAID channels 4 and 5 as drive channels This restricts host connections to RAID channels 0 and 1 affecting supported host configurations Use four expansion units or fewer when possible FIGURE 24 Sun StorEdge 3510 FC Array Configuration with Eight Expansion Units ...

Page 57: ...on details about the new SATA disk technology and the Sun StorEdge 3511 SATA array be sure to check the Sun StorEdge 3511 FC Array with SATA Release Notes on the Sun product web sites Recommendations Refer to the Sun StorEdge 3000 Family FRU Installation Guide for information about supported disk drives cables SFPs and other user replaceable items The use of a full fabric SAN configuration is high...

Page 58: ...54 Sun StorEdge 3000 Family Best Practices Manual June 2004 Connecting One Expansion Unit FIGURE 25 Sun StorEdge 3511 SATA Array Configuration with One Expansion Unit H D RCC H D RCC ...

Page 59: ...Best Practices for the Sun StorEdge 3510 and 3511 FC Arrays 55 Connecting Two Expansion Units FIGURE 26 Sun StorEdge 3511 SATA Array Configuration with Two Expansion Units H D RCC H D RCC ...

Page 60: ...56 Sun StorEdge 3000 Family Best Practices Manual June 2004 Connecting Three Expansion Units FIGURE 27 Sun StorEdge 3511 SATA Array Configuration with Three Expansion Units H D RCC H D RCC ...

Page 61: ...Best Practices for the Sun StorEdge 3510 and 3511 FC Arrays 57 Connecting Four Expansion Units FIGURE 28 Sun StorEdge 3511 SATA Array Configuration with Four Expansion Units H D RCC H D RCC ...

Page 62: ... five expansion units requires the configuration of RAID channels 4 and 5 as drive channels This restricts host connections to RAID channels 0 and 1 affecting supported host configurations Use four expansion units or fewer when possible FIGURE 29 Sun StorEdge 3511 SATA Array Configuration with Five Expansion Units H D RCC H D RCC ...

Page 63: ... a modular architecture with flexible configurations For example a solution can be deployed as direct attached storage DAS or as part of a storage area network SAN Configuration preferences include RAID protection levels single or redundant controllers total storage capacity multipathing and more Modularity and flexibility allow Sun StorEdge 3500 series array storage solutions to be quickly and ea...

Page 64: ...60 Sun StorEdge 3000 Family Best Practices Manual June 2004 ...

Reviews:

No comments

Brands by name

Popular brands

Load more brands