Lenovo ThinkAgile CP 4000 Series Upgrade Manual Download Page 14 | Manualshive

Page: 14 / 68

background image

Services

Lenovo Deployment Services mandatory

Lenovo Hardware Installation Service optional

Software

Software preloaded on compute, storage, and switch

Guardian edition (see

Licensing considerations

for details about the Guardian edition).

6

Lenovo ThinkAgile CP Storage Capacity Upgrade Guide

«
...
12
13
14
15
16
...
»

Summary of Contents for ThinkAgile CP 4000 Series

Page 1: ...Lenovo ThinkAgile CP Storage Capacity Upgrade Guide Models CP4000 CP6000 ...

Page 2: ...dition be sure that you are familiar with the terms and conditions of the Lenovo warranty for your solution which can be found at the following address http datacentersupport lenovo com warrantylookup First Edition March 2020 Copyright Lenovo 2018 2020 LIMITED AND RESTRICTED RIGHTS NOTICE If data or software is delivered pursuant to a General Services Administration GSA contract use reproduction o...

Page 3: ... 19 Hot swap drive installation preparations 20 Preparing the drives 21 Installing the drives 22 Adding drives to the Cloud Controller 25 Install the ThinkAgile CP storage block 37 Install the storage slide rails into a round hole rack 39 Install the storage slide rails into a square hole rack 41 Install the storage enclosure 43 Chapter 4 Compute block capacity upgrade 47 Install a compute node 47...

Page 4: ...ii Lenovo ThinkAgile CP Storage Capacity Upgrade Guide ...

Page 5: ...lling the rail in a square hole rack 41 13 Removal of side cover 43 14 Installing the enclosure into the rack 44 15 Installing screws on front of enclosure 44 16 Reinstalling the side cover 45 17 ThinkAgile CP compute slide rails box contents 49 18 Slide rails 50 19 Left slide rear installation 50 20 Left slide front installation 51 21 Securing the compute block slide rails 51 22 Front latches on ...

Page 6: ...iv Lenovo ThinkAgile CP Storage Capacity Upgrade Guide ...

Page 7: ...Tables 1 Storage block parts listing 10 2 Compute block part listing 12 3 Storage block capacity upgrade options 19 4 Compute block capacity upgrade options 47 Copyright Lenovo 2018 2020 v ...

Page 8: ...vi Lenovo ThinkAgile CP Storage Capacity Upgrade Guide ...

Page 9: ...key features Modular and scalable ThinkAgile CP Series configurations of an on premises cloud platform featuring the second generation of the Intel Xeon Processor Scalable Family that are designed to optimize your workload s performance and provide the IT agility for your business demands Factory preloaded ready to go cloud platform that is delivered with all the infrastructure you need for your w...

Page 10: ...provides enterprise class storage functionality and enables linear performance and capacity scaling Figure 1 Storage block Compute Blocks A Compute Block is a modular 2U enclosure that contains up to four nodes and it delivers processor and memory resources to the cloud The compute nodes run the cloud hypervisor that combines open KVM based virtualization software hardware integration and automati...

Page 11: ... to provide out of band OOB management for the Interconnect Compute Blocks and Storage Blocks The switch can be supplied by Lenovo ThinkSystem NE0152T RackSwitch or customers may provide their own switch Figure 4 Management switch Cloud Controller Cloud Controller orchestrates and manages the on premises infrastructure and workloads however it resides in the cloud It automates and orchestrates inf...

Page 12: ...ovo ThinkAgile CP4000 Series comprises the following components Storage block 1 Storage Block SB S10 Dual controller single CPU per controller 8x SFP Base T SFP transceivers 8x CAT6 cables 1 5m and other lengths permitted 2x CAT5e cables 1 5m and other lengths permitted 32 GB RAM per controller 8 16 24 drives 8 drives per drive pack 800 GB 1 6 TB NVMe drives per controller Drives must be consisten...

Page 13: ...ches Maximum weight 55 kg 121 2 lb Interconnect 1 or 2 CP I 10 Interconnect switches 48x 10 Gb SFP fabric ports 6x 40 Gb QSFP fabric ports Dimensions 438 4 x 473 x 43 4 mm 17 26 x 18 62 x 1 71 inches Maximum weight 8 95 kg 19 73 lb with two installed PSUs Management switch Lenovo ThinkSystem NE0152T RackSwitch Note A dedicated out of band management switch is required for this solution If the Leno...

Page 14: ...ry Lenovo Hardware Installation Service optional Software Software preloaded on compute storage and switch Guardian edition see Licensing considerations for details about the Guardian edition 6 Lenovo ThinkAgile CP Storage Capacity Upgrade Guide ...

Page 15: ...torage block 1 Storage Block maximum 5 blocks SB D20 Dual controller 2CPU per controller 8x SFP Base T SFP adapters 8x CAT6 cables per Storage Block 1 5m and other lengths permitted 64 GB RAM per controller 8 16 24 drives 8 drives per drive pack 1 6 TB 3 2 TB 6 4 TB NVMe drives per controller Drives must be consistent within a controller Dimensions 87 6 x 446 4 x 857 2 mm 3 4 x 17 6 x 33 7 inches ...

Page 16: ...1 7 x 22 2 x 8 8 inches Maximum weight 55 kg 121 2 lbs Interconnect 2 CP I 10 Interconnect switches 48x 10 Gb SFP fabric ports 6x 40 Gb QSFP fabric ports Dimensions 438 4 x 473 x 43 4 mm 17 26 x 18 62 x 1 71 inches Maximum weight 8 95 kg 19 73 lb with two installed PSUs Management switch Lenovo ThinkSystem NE0152T RackSwitch Note A dedicated out of band management switch is required for this solut...

Page 17: ...s mandatory Lenovo Hardware Installation Service optional Software Software preloaded on compute storage and switch Guardian edition see Licensing considerations for details about the Guardian edition Chapter 1 ThinkAgile CP Overview 9 ...

Page 18: ...er 2 CRU yourself or request Lenovo to install it at no additional charge under the warranty service type designated for your storage Field replaceable unit FRU FRUs must be installed only by trained service technicians Consumable and structural parts Purchase and replacement of consumable and structural parts components such as a cover or bezel is your responsibility If Lenovo acquires or install...

Page 19: ...Figure 5 Storage block components Note For more information about ordering the parts shown here see the Lenovo Data Center Support page 7Y66 for this product Chapter 1 ThinkAgile CP Overview 11 ...

Page 20: ...ty If Lenovo acquires or installs a structural component at your request you will be charged for the service Table 2 Compute block part listing Index Description Tier 1 CRU Tier 2 CRU FRU Consuma ble and Structural part 1 PCIe adapter 2 Air baffle 3 Processor and heat sink assembly 85mm heat sink 4 Processor and heat sink assembly 108mm heat sink 5 Processor and heat sink assembly 108mm heat sink ...

Page 21: ...Figure 6 Compute block components Note For more information about ordering the parts shown here see the Lenovo Data Center Support page 7X20 for this product Chapter 1 ThinkAgile CP Overview 13 ...

Page 22: ...e used in the United States and Canada are listed by Underwriter s Laboratories UL and certified by the Canadian Standards Association CSA For units intended to operate at 115 volts Use a UL listed and CSA certified cord set consisting of a minimum 18 AWG type SVT or SJT three conductor cord a maximum of 15 feet 4 6 meters in length and a parallel blade grounding type attachment plug rated 15 ampe...

Page 23: ...n optional component Keep the working area clean and place removed components on a flat and smooth surface that does not shake or tilt Do not attempt to lift an object that may be too heavy for you If you have to lift a heavy object read the following precautions carefully Make sure that you can stand steadily without slipping Distribute the weight of the object equally between your feet Use a slo...

Page 24: ...e servers might come with more than one air baffle Operating the server with a missing air baffle might damage the processor All processor sockets must contain either a socket cover or a processor with heat sink When more than one processor is installed fan population rules for each server must be strictly followed Do not operate the enclosure without the System Management Module SMM assembly inst...

Page 25: ...increases static electricity Always use an electrostatic discharge wrist strap or other grounding system especially when working inside the solution with the power on While the device is still in its static protective package touch it to an unpainted metal surface on the outside of the solution for at least two seconds This drains static electricity from the package and your body Remove the device...

Page 26: ...18 Lenovo ThinkAgile CP Storage Capacity Upgrade Guide ...

Page 27: ...th additional hot swap drives Use this information to install a set of eight hot swap drives You can install a hot swap drive without turning off the storage which helps you avoid significant interruption to system operation Attention Before installing a hot swap drive read and follow the steps in the Hot swap drive installation preparations Notes The term hot swap drive refers to all the supporte...

Page 28: ...e storage enclosure where I want to add the disks No How many drives I can install at a time You can add as many drives as needed The current capacity of the storage enclosure is 24 drives The only requirement is that you must add drives in sets of eight 8 Can the drives be of different capacity than the drives already present No Should all drives have the same firmware level Yes Note To check the...

Page 29: ... an existing ThinkAgile CP storage block array follow these steps to destroy the namespace 1 Execute the following command u us sr r s sh ha ar re e c cllo ou ud diis st tiic cs s e en nc cr ry yp pt tiio on n iig gn niit te e_ _b bu uiilld d_ _s se ed d f f d d v v 2 Rescan the PCI bus by executing the following commands m mo od dp pr ro ob be e r r n nv vm me e e ec ch ho o 1 1 s sy ys s b bu us...

Page 30: ...service Notes The drive bays are numbered to indicate the installation order starting from number 01 Follow this installation order when you install a drive You cannot mix drives of different capacities in one system To install a hot swap drive complete the following steps Step 1 Check that the NVME namespace before installing the new drives lls s d de ev v n nv vm me e Following is an example out...

Page 31: ...ck To check the storage drive configuration use the following command lls sb bllk k Following is an example output NAME MAJ MIN RM SIZE RO TYPE MOUNTPOINT nvme7n1 259 7 0 740 4G 0 disk sed7 253 7 0 740 4G 0 crypt md125 9 125 0 4 3T 0 raid5 md124 9 124 0 4 3T 0 raid0 vdo_data 253 9 0 4 3T 0 dm vdo 253 10 0 43 4T 0 vdo CBS_POOL_data 253 8 0 43 3T 0 dm CBS_POOL 253 12 0 43 3T 0 dm SPECIAL_METADATA_ST...

Page 32: ...X0JC02198 1 795 00 GB 795 00 GB 512 B 0 B GPNA9B3Q dev nvme6n1 S3HCNX0JC02188 1 795 00 GB 795 00 GB 512 B 0 B GPNA9B3Q dev nvme7n1 S3HCNX0JC02195 1 795 00 GB 795 00 GB 512 B 0 B GPNA9B3Q Check that the NVME namespace before installing the new drives lls s d de ev v n nv vm me e Following is an example output dev nvme0 dev nvme1 dev nvme2 dev nvme3 dev nvme4 dev nvme5 dev nvme6 dev nvme7 dev nvme8 ...

Page 33: ... array follow these steps Step 1 Create the RAID5 device for the eight drives u us sr r s sh ha ar re e c cllo ou ud diis st tiic cs s lle en no ov vo o c cllo ou ud diis st tiic cs s n nv vm me e c co on nt tr ro oll p py y e ex xp pa an ns siio on n Following is an example output all disks are attached correctly to this controller Raid device created dev md123 Congratulations You have successful...

Page 34: ...s displayed in the example output from the previous step the reshape process has a completion time of 424 9 minutes finish 424 9min In hours this is a little over seven 7 hours 424 9 minutes 60 7 08 hours Step 5 Wait until the completion time is up in this example more than seven 7 hours and then check that the process has indeed finished c ca at t p pr ro oc c m md ds st ta at t Following is an e...

Page 35: ...0JC02189 1 795 00 GB 795 00 GB 512 B 0 B GPNA9B3Q dev nvme5n1 S3HCNX0JC02198 1 795 00 GB 795 00 GB 512 B 0 B GPNA9B3Q dev nvme6n1 S3HCNX0JC02188 1 795 00 GB 795 00 GB 512 B 0 B GPNA9B3Q dev nvme7n1 S3HCNX0JC02195 1 795 00 GB 795 00 GB 512 B 0 B GPNA9B3Q dev nvme8n1 S3HCNX0K100085 1 795 00 GB 795 00 GB 512 B 0 B GPNA9B3Q dev nvme9n1 S3HCNX0K100072 1 795 00 GB 795 00 GB 512 B 0 B GPNA9B3Q In the exa...

Page 36: ...t 9538 04 GB Step 8 Check the RAID level m md da ad dm m d de et ta aiill d de ev v m md d m md d5 50 0 In the example output from the previous step the RAID level is 0 Note If the RAID level is RAID4 then change the RAID4 level to RAID0 m md da ad dm m g gr ro ow w lle ev ve ell 0 0 r ra aiid d d de ev viic ce es s 2 2 d de ev v m md d m md d5 50 0 m md da ad dm m l le ev ve el l o of f d de ev v...

Page 37: ... es s 2 2 W Wo or rk ki in ng g D De ev vi ic ce es s 2 2 F Fa ai il le ed d D De ev vi ic ce es s 0 0 S Sp pa ar re e D De ev vi ic ce es s 0 0 C Ch hu un nk k S Si iz ze e 5 51 12 2K K C Co on ns si is st te en nc cy y P Po ol li ic cy y n no on ne e N Na am me e a an ny y m md d5 50 0 U UU UI ID D d d3 35 5a a4 47 76 63 3 b b4 4b b9 9b b4 49 90 0 b b8 85 56 61 14 4d db b 6 6a ae eb b6 69 96 6a ...

Page 38: ...e in the Adding the new drives to the RAID array section The size of the RAID50 device is 18 628 988 928 The size of the internal ThinkAgile CP VDO specific metadata is 2 048 Therefore the new VDO size is 18 628 988 928 2 048 18 628 986 880 512 byte sectors Step 2 Increase the size of the VDO data and reload the VDO d dm ms se et tu up p r re ello oa ad d v vd do o_ _d da at ta a t ta ab blle e 0 ...

Page 39: ... 253 12 0 43 3T 0 dm SPECIAL_METADATA_STORE_a0528f49b71948aa8be9d7f4d490b97f 253 13 0 1G 0 dm SPECIAL_TEMPLATE_STORE_0657a4c083b44d8bb0d22cb4e6d0d750 253 14 0 43 3T 0 dm CBS_POOL_meta 253 11 0 16G 0 dm CBS_POOL 253 12 0 43 3T 0 dm SPECIAL_METADATA_STORE_a0528f49b71948aa8be9d7f4d490b97f 253 13 0 1G 0 dm SPECIAL_TEMPLATE_STORE_0657a4c083b44d8bb0d22cb4e6d0d750 253 14 0 43 3T 0 dm Step 6 Increase the ...

Page 40: ...BS_POOL 253 12 0 43 3T 0 dm SPECIAL_METADATA_STORE_a0528f49b71948aa8be9d7f4d490b97f 253 13 0 1G 0 dm SPECIAL_TEMPLATE_STORE_0657a4c083b44d8bb0d22cb4e6d0d750 253 14 0 43 3T 0 dm CBS_POOL_meta 253 11 0 16G 0 dm CBS_POOL 253 12 0 43 3T 0 dm SPECIAL_METADATA_STORE_a0528f49b71948aa8be9d7f4d490b97f 253 13 0 1G 0 dm SPECIAL_TEMPLATE_STORE_0657a4c083b44d8bb0d22cb4e6d0d750 253 14 0 43 3T 0 dm Step 8 Save t...

Page 41: ...is 67 608 872 Step 3 Calculate the new size for the CBS pool and CBS pool data according to the following formula new CBS pool and CBS pool data size size of VDO data size of ThinkAgile CP superblock In our example this becomes new CBS pool and CBS pool data size 186 287 915 008 67 608 872 186 220 306 136 Step 4 Increase the size of the CBS pool data Note All CBS pool input output halts while the ...

Page 42: ...tu up p r re ello oa ad d C CB BS S_ _P PO OO OL L t ta ab blle e 0 0 1 18 86 62 22 20 03 30 06 61 13 36 6 t th hiin n p po oo oll d de ev v m ma ap pp pe er r C CB BS S_ _P PO OO OL L_ _ m me et ta a d de ev v m ma ap pp pe er r C CB BS S_ _P PO OO OL L_ _d da at ta a 8 81 19 92 2 0 0 0 0 d dm ms se et tu up p r re es su um me e C CB BS S_ _P PO OO OL L Step 7 Check the size of the CBS pool lls s...

Page 43: ...ing_enabled true name CBS Superblock pool_device size_sectors 93066911448 block_size_sectors 8192 data_device offset_sectors 67608872 start_offset_sectors 0 size_sectors 93066911448 metadata_device offset_sectors 34054440 size_sectors 33554432 thin_block_metadata record_size_bytes 256 record_count 1000000 superblock_offset_bytes 4096 version 2 metadata_backup_device offset_sectors 500008 size_sect...

Page 44: ...54432 thin_block_metadata record_size_bytes 256 record_count 1000000 superblock_offset_bytes 4096 version 2 metadata_backup_device offset_sectors 500008 size_sectors 33554432 Step 5 Copy the configuration to the CBS superblock header c ca at t t tm mp p s su up pe er rb bllo oc ck k t tm mp p d de ev v m ma ap pp pe er r v vd do o Step 6 Restart the storage controller c cllo ou ud diis st tiic cs ...

Page 45: ... storage enclosure Firstly unpack the storage block box and check the contents One storage block One storage slide rails box One left slide rail One right slide rail Six M5 screws Eight screws for square hole rack Two Category 5e patch cables Eight Category 6 patch cables Eight SFP 10 GbE transceivers Note If any of the slide box items are missing or are damaged contact your place of purchase Figu...

Page 46: ... four screw pins used for round holes The screw pins used for square holes are provided separately Ensure that you use the pins that are appropriate for the mounting holes in your rack Refer to the following figure Figure 10 Screw pin types included with rail kit 38 Lenovo ThinkAgile CP Storage Capacity Upgrade Guide ...

Page 47: ...the rear mounting rail brackets before installing the front mounting brackets Figure 11 Installing the rail in a round hole rack Step 1 Open the hinge bracket on the rear of the rail Step 2 Line up the pins on the rear of the rail with the corresponding holes in the rear mounting flange of the rack and then insert the pins into the holes in the rack flange Step 3 Close the hinge bracket to secure ...

Page 48: ...lange Note Do not secure the front mounting bracket of the rail with screws until you install the storage enclosure into the rack Step 7 Repeat steps 1 through 6 to install the opposite rail in the rack The installation of the storage block slide rails in a round hole rack is now complete To continue with the installation of the ThinkAgile CP storage block follow these steps Install the storage en...

Page 49: ...ing the front mounting brackets Figure 12 Installing the rail in a square hole rack Step 1 Open the hinge bracket on the rear of the rail Step 2 Remove the preinstalled screw pins for round hole rack Step 3 Line up the holes on the rear of the rail with the corresponding holes in the rear mounting flange of the rack Step 4 Close the hinge bracket to secure the rail to the rack flange Step 5 Secure...

Page 50: ...nstalled screws for round hole rack Otherwise the storage enclosure cannot be secured to the front mounting bracket After fastening the two screws for square hole rack do not further secure the front mounting bracket of the rail with screws until you install the storage enclosure into the rack Step 9 Repeat steps 1 through 8 to install the opposite rail in the rack The installation of the storage ...

Page 51: ...lowing CAUTION Ensure that at least two people lift and install the enclosure together Step 1 Remove both of the side covers on the enclosure by grasping and pulling out the bottom of each side cover and then pulling it straight up Figure 13 Removal of side cover Step 2 Lift the enclosure and slowly place the enclosure on the rail Chapter 3 Storage block capacity upgrade 43 ...

Page 52: ...ntil the enclosure is fully inserted Figure 14 Installing the enclosure into the rack Step 4 Secure the enclosure with the thumbscrews and the M5 screws on the front Figure 15 Installing screws on front of enclosure 44 Lenovo ThinkAgile CP Storage Capacity Upgrade Guide ...

Page 53: ...on the top of the side cover and push the bottom of it inward to reinstall the side cover to the storage enclosure Figure 16 Reinstalling the side cover The installation of the storage block in a rack is now complete Chapter 3 Storage block capacity upgrade 45 ...

Page 54: ...46 Lenovo ThinkAgile CP Storage Capacity Upgrade Guide ...

Page 55: ...or field service To add a compute node to your ThinkAgile CP configuration perform the following steps Step 1 Physically install the compute node in the compute enclosure and power it on Step 2 Launch the Cloud Controller and register the compute nodes All compute and storage hardware assets connected to the network interconnect s are displayed on the Hardware page in the Cloud Controller and are ...

Page 56: ...set of nodes Applications can migrate among nodes within a migration zone but cannot migrate to nodes outside of the migration zone To create a migration zone a In the Migration Zone drop down select New migration zone b Enter a name for the migration zone c Click Create Step 10 Click Register Node to complete registration Step 11 Repeat this process to register all remaining nodes Power on the co...

Page 57: ...de rails 4 Slide the compute enclosure into the rack Firstly unpack the storage block box and check the contents One compute block One compute slide rails box One left slide rail One right slide rail Two M5 screws Two washers One Category 5e patch cable Two power cords Two SFP 10 GbE Direct Attach Cables DACs Note If any of the slide box items are missing or are damaged contact your place of purch...

Page 58: ...the following Step 1 Ensure that the slide rail is shortened to its shortest position Step 2 From the front of the rack cabinet line up the pins on the rear of the slide rail with the flange holes at the rear of the rack Step 3 Push the slide rail so that the pins and the latch snap into place Note The holes on the rack are either be square shaped or round shaped Figure 19 Left slide rear installa...

Page 59: ... the rack 2 Moving the slide rail backward and forward to ensure that it does not pop out Step 6 Insert a M5 screw and washer into the rear bracket of each slide rail and then fasten the two M5 screws to secure the slide rails to the rack flanges Figure 21 Securing the compute block slide rails The installation of the compute block slide rails in a rack is now complete To continue with the install...

Page 60: ...the rails click into place Step 2 Push up the front latches Step 3 Pull the slide rails all the way out Attention You can only install the compute block enclosure successfully when the slide rails are fully extended Step 4 Remove all compute nodes and the shuttle from the enclosure Step 5 Carefully lift the enclosure Step 6 Tilt and lower the enclosure then push the slide rails toward the enclosur...

Page 61: ...closure into the rack first push up the rear latches on the slide rails Step 9 Push the enclosure until the slide rails click into place Step 10 Push up the front latches on the slide rails Step 11 Push the enclosure all the way into the rack Figure 24 Enclosure installation into rack Step 12 Fasten the two thumbscrews located on the front of the compute enclosure Chapter 4 Compute block capacity ...

Page 62: ...e thumbscrews Step 13 Insert back into the enclosure the shuttle and all the previously removed compute nodes The installation of the compute block in a rack is now complete 54 Lenovo ThinkAgile CP Storage Capacity Upgrade Guide ...

Page 63: ...ails of the ThinkAgile CP Guardian editions Guardian OS for compute nodes and storage controllers RHEL 7 Network OS for Interconnect Switches Pica8 OS At Rest Encryption Compliance KMIP Compliant FIPS 140 2 Common Criteria USGv6 DOD IPv6 STIG Copyright Lenovo 2018 2020 55 ...

Page 64: ...56 Lenovo ThinkAgile CP Storage Capacity Upgrade Guide ...

Page 65: ...n If you need help service or technical assistance or just want more information about Lenovo products use the Lenovo Support Plan for ThinkAgile CP Details for the ThinkAgile CP Support Plan are available at the following site https datacentersupport lenovo com products solutions and software thinkagile cp Copyright Lenovo 2018 2020 57 ...

Page 66: ...58 Lenovo ThinkAgile CP Storage Capacity Upgrade Guide ...

Page 67: ......

Page 68: ......

Reviews:

No comments

Related manuals for ThinkAgile CP 4000 Series

Brand: EAW Pages: 6

Brand: EAW Pages: 6

Brand: Xinje Pages: 76

Brand: Moxa Technologies Pages: 19

Brand: NETGEAR Pages: 14

Brand: Toto Link Pages: 55

Brand: Justec Pages: 61

Brand: Gbord Pages: 8

LBON320AC Series

Brand: Lindsay Broadband Pages: 4

Hotwire 8775 MSDSL

Brand: Paradyne Pages: 10

4 Channel Input Buffer Board SDAIBB

Brand: B&B Electronics Pages: 22

Brand: SeaLevel Pages: 21

Brand: Vecow Pages: 61

Brand: Valcom Pages: 3

OfficeConnect 3CXSH654B

Brand: 3Com Pages: 52

Brand: Belkin Pages: 42

Wireless Kit 108MBPS

Brand: Topcom Pages: 100

Brand: NetComm Wireless Pages: 154

Brands by name

0 1 2 3 4 5 6 7 8 9 A B C D E F G H I J K L M N O P Q R S T U V W X Y Z

Popular brands

Load more brands