background image

38

10.  Calibration

10. Calibration

10.1 What is calibration?

10.1.1 The Necessity of Calibration

Calibration is required to accurately weigh items with an electric balance. Calibration must be per-
formed in these conditions: 
• When the location of the installation site is changed (even when moved within the same room).
• When the room temperature changes.
• Also, daily calibration before use is recommended. 

The AUW-D/AUW/AUX series are set to operate fully-automatic span calibration PSC by default. The
AUY series requires span calibration using external weights. 

The Essential Role of Span Calibration for the Use of Electronic Balances

The measurement desired when using an electronic balance is the measurement of mass. However, an elec-
tronic balance cannot detect mass directly. Instead, it detects the weight (the weight is the Earth’s attraction on
the item, gravity) and displays the mass as computed from the weight. The proportion of mass to weight
depends on the gravitational acceleration at the location. By placing calibration weights of accurately known
mass on the electronic balance, the corresponding weight for that mass can be recorded. This allows the mass
of any item that is subsequently weighed to be computed from its weight and accurately displayed. The record-
ing and setting of weight-mass relation is known as span calibration.
The necessity can be recognized this way for example, the gravitational acceleration in the Japanese cities of
Kyoto and Tokyo are 979.70775 cm/s

2

 and 979.76319 cm/s

2

 respectively, with a difference of about 0.0057%.

This means that if a balance is calibrated in Kyoto and the balance is moved to Tokyo, an object of 100.0000g
mass will exhibit 100.0057g on the balance, generating an error of two digits.
Always perform span calibration at the installation site before using the balance to correct for this effect.
In addition, electronic balances use a permanent magnet and a coil in their weight detecting system. Even with
compensation, a permanent magnet generates a sensitivity difference of up to 

±

 2ppm (two millionths) with every

1°C fluctuation in temperature. When measuring for example, a 100g object, this difference amounts to 

±

2mg,

which means a possible error on the final two digits displayed on the electronic balance. If the temperature
changes by 5°C after calibration, an object of 100.0000g may appear to increase to a maximum of 100.0010g.
When there is a change in temperature, always calibrate again for accurate measurement.

   Note

Using a verified balance as a legal measuring instrument in the EU:

The balance must be used within the temperature range indicated on the
verification label.
When PSC (refer to 

10.3.2

), fully-automatic span calibration, is not acti-

vated, operator must carry out span calibration (refer to 

10.2

) upon blinking

of the Weight Symbol.

Summary of Contents for AUW120

Page 1: ...ustin Ft Worth NicolScales com 800 225 8181 Contact Us Nicol Scales Measurement is an ISO Accredited Calibration Company that has provided calibration repair and sales of all types of weighing and mea...

Page 2: ...ual AUW D series AUW220D AUW120D AUW series AUW320 AUW220 AUW120 AUX series AUX320 AUX220 AUX120 AUY series AUY220 AUY120 O T 1d 10d UNIT PR INT PO WER B R K C A L ME NU Read the instruction manual th...

Page 3: ......

Page 4: ...on of whole or part of the content without permission of the company are strictly prohibited Microsoft Windows and Excel are registered trademarks of Microsoft Corporation of the U S A in the United S...

Page 5: ...njury to personnel or equipment damage Note Provides additional information needed to properly use the balance Item Description 1 2 3 Indicates the step number in a procedure or a sequence of changes...

Page 6: ...correct weighing units can lead to accidents as a result of weighing errors Check that the weighing units are correct before starting weighing Do not use the balance outdoors or anywhere where it will...

Page 7: ...tically Therefore begin operation from 4 4 Turning On the Power page 12 again Treat the balance with care and respect The balance is a precision instrument Subjecting it to impacts could cause it to f...

Page 8: ...pre hensive laboratory data management system Shimadzu CLASS Agent Ask your Shimadzu representative about it Shimadzu WindowsDirect When Shimadzu balances are integrated with laboratory software by me...

Page 9: ...professional use only Contact Shimadzu service representative when the equipment has reached the end of its life They will advise you regarding the equipment take back With your co operation we are ai...

Page 10: ...ing the Weighing Range AUW D series only 17 5 4 For Stable Measurement in Semi micro Range AUW D series only 18 6 WindowsDirect Function 20 6 1 What is WindowsDirect 20 6 2 WindowsDirect Settings 20 6...

Page 11: ...43 10 3 Calibration Settings 44 10 3 1 Selecting Preset Calibration Method 44 10 3 2 PSC Fully automatic span calibration AUW D AUW AUX series only 45 10 3 3 Clock CAL Fully automatic span calibration...

Page 12: ...g the Cable 80 14 2 2 Data Format 81 14 2 3 Command Codes 83 14 3 Communication Settings 85 14 3 1 What are communication settings 85 14 3 2 Standard Setting 85 14 3 3 User Setting 86 14 4 Decimal Poi...

Page 13: ......

Page 14: ...e provided in the AUW D AUW AUX AUY series balance please read this instruction manual before using the balance and keep the manual for future reference For information on the following points please...

Page 15: ...Please do not remove Level screws Adjusted for level installation of the balance Display panel Displays information such as results errors functions in progress and information for function settings...

Page 16: ...ection Enter calibration or menu item selection O T Tares the balance Displays zero 1 UNIT Switches the units of measurement PRINT Outputs the displayed values to an electronic printer computer or oth...

Page 17: ...the bracket is are the auxiliary indicating device Number symbol Indicates numeric value entry Menu symbol Appears during menu selection Always shown when the menu is locked Add on symbol Indicates s...

Page 18: ...ring mode 3s 120g range 10s 42g range Pouring mode 3 s Calibration weight Built in None Operation tem perature range 5 to 40 deg C Temperature coefficient of sensitivity 10 to 30 deg c 2ppm deg C when...

Page 19: ...cale interval e 0 01ct 0 01ct 0 01ct 0 01ct 0 01ct 0 01ct 0 01ct 0 01ct 0 01ct 0 01ct Number of verification scale interval 110000 60000 160000 110000 60000 160000 110000 60000 110000 60000 Scale inte...

Page 20: ...special accessory battery pack can be properly used Verify that the power voltage conforms to that indicated on the AC adapter 2 Installation site Sites with air current from air conditioners ventila...

Page 21: ...lly appropriate for vibration free measurement 4 2 Unpacking and Delivery Inspection Caution The glass doors open backwards beyond the rear end of the main body Make certain enough space is saved to a...

Page 22: ...Standard packed items quantity Balance main body 1 Pan 1 Pan supporter 1 Anti draft ring 1 AC adapter 1 Adapter cable holder 1 Instruction manual 1 Explanatory operation sheet 1 Inspection certificat...

Page 23: ...ighing chamber 2 Gently place the pan on the pan supporter 3 Place the anti draft ring 4 Adjust the horizontal level level adjustment There are two level screws on the front of this bal ance The screw...

Page 24: ...d UN IT PR INT PO WE R B R K C A L MEN U Note Using a verified balance as a legal measuring instrument in the EU Legal regulations require a verified balance be sealed This control seal is a self dest...

Page 25: ...R key however at least one span cali bration is necessary before use The AUY series does not perform calibration and the display showing CAL will not appear shows version number of software 3 Press th...

Page 26: ...display will automatically change and the motor sound of the weight loading system is heard In order to ensure proper PSC operation prevent vibrations and air flow When gram display returns after com...

Page 27: ...the glass door of the weighing chamber 5 After a short time the zero display will blink Remove the weight from the pan and close the glass door After CAL End appears the display returns to g display...

Page 28: ...e O T key taring The appearance of the stability mark indicates a stable state The display will read zero 3 Open the glass door place the items to be weighed in the weighing vessel and close the glass...

Page 29: ...ize the temperatures by leaving the item in the extra space within the chamber before weighing Notes Using a verified balance as a legal measuring instrument in the EU Indicates that the balance is se...

Page 30: ...he large range with a mini mum display of 0 1mg press the 1d 10d key except for AUW D series this key has a different func tion 9 2 When measurement exceeds the small range capacity 82g for AUW220D 42...

Page 31: ...obtain the best result Avoid air current from the air conditioner When the air conditioner is in operation the temperature of the air current from it has a large difference from the room temperature A...

Page 32: ...glass door minimum Use long tweezers etc Equalize the temperature of the samples to the chamber s Remove influence of the heat emitted from human body and the heat from the sample to be weighed Equali...

Page 33: ...nd codes 14 2 3 is required Only numerical values can be transferred through WindowsDirect 6 2 WindowsDirect Settings Simple settings are made for the balance and the computer Connection is by RS 232C...

Page 34: ...step 1 instead of SEtwin The SEtwin setting menu display appears when the MENU key is pressed one more time from SEtwin The communication parameters selected by SEtwin or SEtwin set tings here are li...

Page 35: ...t Accessibility Options 4 Verify that there are no check marks for any items on all five tabs including General When using WindowsDirect use a Null modem cable of one of the below wirings 1 2 D sub9 1...

Page 36: ...istrative options appears in the General tab Put check marks at both the items of Administrative options to maintain the settings even after restarting Windows 6 Open Settings 7 Select the serial port...

Page 37: ...ance Verify that the numeric value displayed on the bal ance appears at the cursor position on the screen of computer The effect is the same as typing the value from the computer keyboard and pressing...

Page 38: ...stalling it again Some notebook PCs feature a setting for disabling RS 232C ports as a power saving measure Before trying to use the WindowsDirect communication function make the setting that enables...

Page 39: ...ta in another application e g Notepad Q6 The operation is sometimes abnormal A6 Depending on the processing capability of the PC malfunctions may occur if the communications speed is high Set 300 bps...

Page 40: ...ions provided in the AUW D AUW AUX AUY series Procedures of each menu item selection are explained with the display examples in chapters 8 to 14 However when selecting menu items refer to the menu map...

Page 41: ...ay i CAL appears The type of regular use calibra tion appears i CAL is default of AUW D AUW AUX series In the AUY series this is E CAL or E tESt 2 After that pressing the CAL key changes the display i...

Page 42: ...red for specific gravity measurement see 13 2 13 3 and settings related to the clock Communication settings menu group Select This second level menu group includes settings for communication formats f...

Page 43: ...use of piece counting or percentage conversion and the set time of Interval Timer function will also be cleared The default settings are indicated with on the Menu Map 1 Press the CAL key repeatedly u...

Page 44: ...menu lock function is activated returning to the oFF display When the lock function is activated the MENU mark appears When menu is locked MENU symbol is illumi nated at STAND BY display too If a menu...

Page 45: ...and date respectively and press the O T key In the upper part of the dis play the mark and the symbol appear indicating number entry mode Also the current date setting appears as YY MM DD YY is the y...

Page 46: ...ss the O T key The display shows y m d After this pressing the CAL key cycles the dis plays in the order of y m d m d y d m y y m d y m d is for setting YYYY MM DD m d y is for MM DD YYYY and d m y is...

Page 47: ...pper part of the display the symbol and the symbol appear indicating number entry status Also the current time setting appears as HH MM SS HH is hours MM is min utes and SS is seconds with the leftmos...

Page 48: ...set ting on or oF 3 Press the O T key Ad on is displayed At this point pressing the CAL key switches the display between Ad on and Ad oF When the current setting is displayed the stability mark appear...

Page 49: ...moved from the display 1 To change the minimum display by one digit Press the 1d 10d key from the mass display The minimum display digit will be displayed with only three decimal places 2 To return th...

Page 50: ...From that point every time the CAL key is pressed the display switches between LiGt on on and LiGt oF off Here when the current setting is displayed the stability mark appears 5 Press the O T key when...

Page 51: ...relation is known as span calibration The necessity can be recognized this way for example the gravitational acceleration in the Japanese cities of Kyoto and Tokyo are 979 70775 cm s2 and 979 76319 cm...

Page 52: ...span cali bration made necessary by temperature changes and Clock CAL for performing automatic span cali bration at set times Calibration can also be done with external calibration weights E CAL E tES...

Page 53: ...display shows i CAL Preset calibration method is i CAL jump to Step 5 If the display shows another item Preset calibra tion method is not i CAL go on to Step 2 Refer to 10 3 1 for preset calibration...

Page 54: ...l FUnC SEL appears then press the O T key to display CAL 3 Press the O T key The display shows E CAL 4 While E CAL is shown press the O T key Span calibration begins and the zero display blinks 5 Rech...

Page 55: ...AL key repeatedly until FUnC SEL appears then press the O T key to display CAL 3 Press the O T key again The display shows E CAL 4 Press the CAL key repeatedly until the dis play shows i tESt 5 Press...

Page 56: ...epeatedly until the display shows E tESt 5 Press the O T key The calibration test begins and the zero display blinks 6 Recheck that there is nothing on the pan and wait 7 The set weight value Refer to...

Page 57: ...key repeatedly until the SEttinG menu appears Press the O T key CAL dEF appears 2 When CAL dEF appears press the O T key The E CAL display appear 3 Press the CAL key repeatedly until the desired setti...

Page 58: ...mass display mode In mass display mode when any of the conditions above has been met the weight symbol will blink for about two minutes as notification of span calibration before calibration begins T...

Page 59: ...oF and PSC on Here when the current setting is displayed the stability mark appears When the desired setting appears pressing the O T key changes the cur rent setting Pressing the POWER key returns th...

Page 60: ...ars Press the O T key to display CAL dEF 2 Press the CAL key repeatedly until tCAL appears The positions show the current set ting either on when on or oF when off 3 To change the setting press the O...

Page 61: ...o change the value of the blinking digit When the UNIT key is pressed the value of the blinking digit increases by 1 at a time The numerals progress in this order 0 1 2 9 _ 0 Set the hours in the rang...

Page 62: ...onditions free from the influence of vibration or air flow 1 From mass display press the CAL key repeat edly until SEttinG appears Press the O T key CAL dEF appears 2 Press the CAL key repeatedly unti...

Page 63: ...the symbol appear in order to indicate numerical input mode The leftmost numeral blinks The blinking digit may be changed 3 When the UNIT key is pressed the value of the blinking digit increases by 1...

Page 64: ...leftmost numeral blinks The blinking digit may be changed 3 When the UNIT key is pressed the value of the blinking digit increases by 1 at a time Press the PRINT key to move the blinking digit one pla...

Page 65: ...he current set ting on when set and oF when unset 3 To change the setting press the O T key when GLP is showing The display will show GLP on The becomes 4 From this point every time the CAL key is pre...

Page 66: ...the display panel the symbol and the symbol appear in order to indicate numerical input mode The left most digit of blinks The numeral of the blink ing digit can be changed 3 Press the UNIT key to inc...

Page 67: ...not print 3 To change the setting press the O T key when Prtdt is showing The display will show Prdt on The becomes 4 From this point every time the CAL key is pressed the display will switch between...

Page 68: ...ection mode High stability mode and Pouring mode are also available The currently set mode is easily checked by pressing the CAL key four times from mass display to produce the settings check display...

Page 69: ...til Hi Stb is displayed Press the O T key here to enter High stability mode Setting of this mode can be confirmed only in settings check display see 7 4 1 11 2 4 Pouring Mode fast response When using...

Page 70: ...StAbL Env or UnStb Env when you find the measurements are too slow or too unstable with the default normL Env Settings check display Setting of Pouring mode can be confirmed only in the settings check...

Page 71: ...isplay Setting the Stability Detection Band 1 Press the CAL key repeatedly from the mass display When FUnC SEL appears press the O T key CAL is displayed 2 Press the CAL key twice bAnd is shown The pa...

Page 72: ...T key to display CAL 2 Press the CAL key once trC is shown The part shows the current setting as on for on and oF for off 3 Press the O T key trC on appears The changes to At this point pressing the C...

Page 73: ...isplayed press O T key The item is set up and Stb SiGn is displayed 5 Press POWER key twice to return to the gram g display When Stability Mark Lighting Timing is set to FASt A Stability Mark lights u...

Page 74: ...gravity mea surement and 13 3 for liquid density measurement 12 1 Setting Units of Measurement 1 Press the CAL key repeatedly from the mass display until FUnC SEL is showing Press the O T key to displ...

Page 75: ...ilable for use 3 Select the units to register by pressing the O T key when the desired unit appears To remove a registered unit press the O T key when the unit to be removed appears with stability mar...

Page 76: ...gram display and wait for the stability mark to appear 5 Press the CAL key After SEt is displayed the mass of the standard item is set as 100 6 Remove the standard item and begin measure ment by load...

Page 77: ...change in this order Ld 10 Ld 20 Ld 50 and Ld 100 7 When the correct number of pieces on the bal ance is displayed and the stability mark has appeared press the O T key 8 SEt appears for several secon...

Page 78: ...ng pan into the liquid of the tank 3 Register d the solid specific gravity as a unit referring to 12 1 4 Input the density of the liquid to be used for solid specific gravity measurement a Press the C...

Page 79: ...edly to return to the mass display 5 When the UNIT key is pressed a number of times from the mass display Air gd appears for about two seconds Afterward the display switches to the gd display This is...

Page 80: ...late the spe cific gravity value by retrying the weight measure ment in water after removing the air bubbles from the item 11 To make the next measurement unload the pans press CAL and begin again at...

Page 81: ...ple liquid in the tank 3 Register d liquid density as a unit referring to 12 1 4 Input the sinker volume in cm3 for liquid den sity measurement a Press the CAL key repeatedly from the mass display unt...

Page 82: ...ain to return to the mass display 5 When the UNIT key is pressed a number of times from the mass display Airgd appears for about two seconds Afterward the display switches to the gd display This is th...

Page 83: ...that differs from the expected value you can recalculate the density by retrying the weight measurement in liquid 11 To make the next measurement unload the pans press CAL and begin again at Step 5 E...

Page 84: ...key The display will show CAL 2 Press the CAL key repeatedly until AtPrt appears the shows the current setting on for on and oF for off 3 Press the O T key The display shows AP on and after this press...

Page 85: ...ere MM is minutes and SS is seconds The leftmost digit blinks 4 Pressing the UNIT key increases the blinking digit by 1 Pressing the PRINT key moves the blinking digit one place to the right Set minut...

Page 86: ...puts the bal ance in power standby status Using the interval timer function for long periods of time may generate measurement errors due to drift of the balance Short interval settings may not operat...

Page 87: ...s pressing the CAL key switches the displays between Addon on and Addon oF When the current setting is displayed the stability mark appears Press the O T key when the desired setting is shown to chang...

Page 88: ...3 8 1 3 Place the sample first component in the con tainer Upon stability the mass value is outputted auto matically with the numbering CMP001 After out put the display is automatically tared 4 Repeat...

Page 89: ...step 1 Note When Add on mode is in use fully auto matic span calibration by PSC 10 3 2 or Clock CAL 10 3 3 is not performed Instead Weight symbol keeps blink ing when span calibration is necessary Sp...

Page 90: ...AL Setting Formulation Mode 1 Press the CAL key repeatedly from the mass display until FUnC SEL appears Press the O T key The display will show CAL 2 Press the CAL key repeatedly until Formu appears T...

Page 91: ...e step 2 until all the component samples have been weighed 4 Press the POWER key The measurements up to this point are summed up and displayed on the balance and outputted to the external device 5 Cle...

Page 92: ...F1 standard settings 1 See 14 3 2 2 When using a computer as well set to timer handshake see 14 3 3 1 in the user settings 3 Turn off the power when the balance is either oFF or STAND BY Then connect...

Page 93: ...ing the Cable For DOS V computers D sub9 pin Null modem Notes The cable must have the correct connections as shown in the diagram below Cables with the connections shown below and the special accessor...

Page 94: ...the position No 10 Positions 11 12 One or two letters indicating the weighing unit As shown in this example the code for space is entered at position No 12 if only one letter is used for the unit Pos...

Page 95: ...onger 3 Data format in case of oL or oL Overload The below is the data format for oL For oL negative overload Position 1 is replaced with minus ASCII code 2DH The following parts appearing in 2 Inform...

Page 96: ...e head of the data with output S when the stability mark is showing U when the mark is not showing D08 1 time output at stability After command input the data is output at the first appear ance of the...

Page 97: ...Liquid specific gravity removal C02 High stability mode setting C13 Anti convection mode setting C14 Standard mode setting C05 Stability detection band 1 count setting C06 Stability detection band 5...

Page 98: ...dividual items in the User Settings 14 3 2 Standard Setting The combinations shown in the table below are available as standard setting 1 to standard setting 6 In the communication settings menu the s...

Page 99: ...r settings 1 In mass display press the CAL key repeat edly until intFACE appears and press the O T key iF F1 appears 2 Press the CAL key repeatedly until iF USEr appears and press the O T key io b app...

Page 100: ...g appears press the O T key 2 Press the POWER key to return to io P 14 3 3 4 Stop bit settings 1 The display changes from io S to S S1 Pressing the CAL key cycles through the available settings The st...

Page 101: ...rrent setting is displayed When the desired setting appears press the O T key Press the POWER key to return to io H Display during setting F dF1 F dF2 F dF3 F dF4 Setting specifics Data format 1 Stand...

Page 102: ...ar 2 Press the CAL key repeatedly until dECPt appears indicates the current setting Pr for period Co for comma 3 Press the O T key The display shows dECPt Co and after this pressing the CAL key switch...

Page 103: ...oating and the display panel When the glass door does not slide smoothly In the AUW D AUW AUX AUY series the side glass doors can be removed to allow replacement and cleaning of the door rails 1 Remov...

Page 104: ...W AUX AUY series when the door rails of the side glass doors become dirty or worn the rails can be replaced Removing the door rail 1 Remove the glass door 2 Press down the outer edge of the door rail...

Page 105: ...he figures and carry it securely in both hands When using other methods of transport Use the packing box in which the balance was delivered Caution This is a precision instrument Handle with care and...

Page 106: ...rror in PCAL Use the correct calibration weight CAL E4 Large span error in span calibration Use the correct calibration weight CHE X X is a numeral when the display stops here Internal malfunction Ple...

Page 107: ...g chamber Leave the glass doors of the weighing chamber open 1 to 2 cm wide when not in use Effects of electronic noise or strong electromagnetic waves Move away from the noise source Internal trouble...

Page 108: ...unit Preset delete Taiwan tael unit Preset delete Malaysia tael unit Preset delete Chinese tael unit Preset delete dwt unit Preset delete GN unit Preset delete Mesghal unit Preset delete Baht unit Pr...

Page 109: ...AL SEt 1 PcAL 1 LigHt on 2 Clock CAL running time setting Clock CAL running time setting Clock CAL running time setting Setting of display mode for specific gravity value Hold display tCAL t1 3 tCAL t...

Page 110: ...CrLF d Cn d win d win Delimiter setting io F dF1 F dF1 F dF2 F dF3 F dF4 Data format setting io H oFF H oFF H SoFt H HArd H tr Handshake setting io P no P no P odd P EvEn Parity setting io S S1 S S1...

Page 111: ...door 3pieces 321 62985 Adapter cable holder 072 60330 02 Part name Part number Part number for RoHS Remarks Electronic Printer EP 80 321 62675 01 w o AC adapter 321 80016 01 w o AC adapter Impact dot...

Page 112: ...t match the connector threads on the balance Pin number Name Function Comment 1 FG Frame ground 2 TXD Data output 3 RXD Data input 4 RTS Internal connection with CTS 5 CTS Internal connection with RTS...

Page 113: ...0 0321507 Ozt 0 0267173 TL HK 0 0264555 TL Singapore 0 0266667 TL Taiwan 0 0264600 TL Malaysia 0 0266071 TL China 0 643015 dwt 15 4324 GN 0 216999 m 0 0657895 b 0 0857339 t 1 12877 o Note Units except...

Page 114: ...is removed Notes The following is a standard guideline used to determine whether the bal ance is working properly The specific criterion can be set according to each user s requirements Conduct the pe...

Page 115: ...he locations and in the order of the numbers given in the figure Record the results X1 through X5 for the locations 1 through 5 respectively If all the differences between the value measured in the ce...

Page 116: ...Appendices 103 A 7 Below weigh Hook Dimensions sensor Below weigh hook 2 Below weigh hook Balance bottom H o l e 2 0 1 5 1 5 3 6 3 5 2 5 16 5 Unit mm...

Page 117: ...in calibration weight 44 calibration test with external weights 44 calibration weight value 50 51 Clock CAL 13 39 47 52 command codes 20 83 communication setting 20 85 communication speed 85 86 compo...

Page 118: ...ce counting 64 pouring mode 56 power 12 21 79 preset calibration method 44 printer electronic printer PSC 13 45 R range weighing range response 55 RS 232C 2 21 80 99 RS 232C connector specification sp...

Page 119: ...25 93 94 types of calibration 39 U unit 17 61 unit conversion 100 unit display 17 Unpacking 8 user settings 85 86 V vibration 7 13 55 56 W warm up 12 13 15 40 45 49 102 warm up 37 weighing chamber 2...

Reviews: