Section 2
TM9340-G-00
15 August, 2019
2-4
Table 2-2: Model Specifications
MSD
(Most Significant
Dial)
Maximum
Dial Output
(x10 Setting)
Coefficients
Maximum Limits
Stability
Temperatur
e
Power
Power
Amperes
Volts
(ohms)
(± ppm/yr) (± ppm/C)
(±
ppm/mW)
(W/step)
(Adc/Step)
(volts/step)
0.01
0.1
Ω
500
5
0.2
0.5
7
0.07
0.1
1
Ω
50
5
0.2
0.5
2
0.2
1
10
Ω
20
5
0.2
0.5
0.7
0.7
10
100
Ω
10
5
0.2
0.5
0.2
2
100
1
k Ω
10
5
0.2
0.5
0.07
7
1 k
10
k Ω
10
5
0.2
0.5
0.02
20
10 k
100
kΩ
10
5
0.2
0.5
0.007
70
100 k
1 M
Ω
10
5
0.2
0.5
0.002
200
1 M
10 M
Ω
10
5
0.2
0.5
0.7mA
700
10 M
100 M
Ω
20
20
1
0.1
0.1mA
1000
100 M
1 G
Ω
50
20
50
0.01
0.01mA
1000
1 G
10 G
Ω
500
100
1*
0.001
1.5uA
1500
10 G
100 G
Ω
1000
250
1*
0.0001
0.15uA
1500
100 G
1 T
Ω
2000
-250
-85*
N/A
0.015uA
1500
1 T
10 T
Ω
3000
-2500
-110*
N/A
0.0015uA
1500