6243/44 DC Voltage Current Source/Monitor Operation Manual
9.2.2 Voltage/Current Measurement
9-17
9.2.2
Voltage/Current Measurement
Measurement range:
However, when the integration time is 500
s or 1 ms, measurement resolution becomes as follows.
Overall accuracy:
Including calibration accuracy, 1-day stability, temperature coefficients, and linearity
Range
Measurement range
Resolution
Voltage measurement
320 mV
3.2 V
20 V
0 to
320.000 mV
0 to
3.20000 V
0 to
20.0000 V
1
V
10
V
100
V
Current measurement
320
A
3.2 mA
32 mA
320 mA
3.2 A
10 A
0 to
320.000
A
0 to
3.20000 mA
0 to
32.0000 mA
0 to
320.000 mA
0 to
3200.00 mA
0 to
10.0000 A
1 nA
10 nA
100 nA
1
V
10
V
100
V
Integration time
Resolution(digits)
500
s
5
1 ms
3
Voltage measurement
Range
Overall accuracy
(% of r V)
320 mV
3.2 V
20 V
0.03 + 200
V
0.03 + 200
V
0.03 + 1 mV
Current measurement
Range
Overall accuracy
(% of r A + A
Vo/1 V)
320
A
3.2 mA
32 mA
320 mA
3.2 A
10 A
0.03 + 80 nA + 3 nA
0.03 + 800 nA + 30 nA
0.03 + 8
A + 300 nA
0.05 + 80
A + 3
A
0.06 + 800
A + 30
A
0.1 + 8 mA + 300
A
Vo:
Compliance voltage (0 V to
20 V) (Auto Zero ON, integration time 1 to 100 PLC)