Digital Sensor Calculator
ADC counts, measured value and resolution
An analogue to digital converter reports its input as an integer count. An n bit converter produces 2n distinct codes, numbered 0 to 2n − 1. Mapping those codes onto a measured range gives the value the count represents. PV is the process variable, the standard instrumentation term for the measured quantity, whatever it happens to be.
PV = PVmin + Count / (2n − 1) × (PVmax − PVmin)
Count = round[ (PV − PVmin) / (PVmax − PVmin) × (2n − 1) ]
Why the divisor is 2n − 1 and not 2n
Both divisors appear in datasheets, and they answer different questions. This tool uses the endpoint mapping, where count 0 sits exactly at the bottom of the range and the highest count sits exactly at the top, so the step between adjacent counts is the span divided by 2n − 1. That is the convention for scaling a reported count back into engineering units, and it is what the value per count above reports.
The other convention describes the converter's own quantisation step, the width of one code bin, which is the full-scale input span divided by 2n. It is the right figure when reasoning about the converter as a quantiser rather than about the number it reported. At 12 bit the two differ by one part in four thousand and nothing depends on which you pick. At 8 bit the difference is 0.4 %, and at low bit counts it is worth being explicit about which one a datasheet means.
Resolution is not accuracy
The quantisation error above is the floor set by the arithmetic alone. Real converters add noise, so the effective number of bits is lower than the nameplate figure, sometimes by several bits on a 24 or 32 bit device, where the last bits are usually below the noise floor of the converter itself. Offset, gain and linearity errors sit on top of that, and the sensor in front of the converter usually contributes more error than the converter does. Treat the value per count as the smallest change the number can express, rather than as the smallest change the instrument can measure.
What this assumes
The mapping is linear, unipolar and unsigned, with count 0 at the bottom of the measured range. A bipolar or signed converter, an offset binary or two's complement output, or a sensor that uses only part of the converter's input span needs its own mapping. Where a transmitter drives a 4-20 mA loop into an ADC that covers 0 to 25 mA, the counts corresponding to 4 mA and 20 mA are what belong in the two range fields, not the extremes of the converter.
Application notes
Nitrous Oxide Monitoring in Wastewater Treatment: TDLAS for Laughing Gas Measurement
In Brief Nitrous oxide (N₂O) is a potent greenhouse gas produced during biological nitrogen removal in…
CO Monitoring in Waste Incineration: Combustion Control, Safety, and Compliance
In Brief Waste incineration produces CO concentrations that fluctuate rapidly and unpredictably because the fuel, municipal…
CO Analysis in Cement and Steel Production: Process Control, Safety, and Kiln Diagnostics
In Brief Carbon monoxide is one of the most informative gases in cement and steel production.…
Industrial Oxygen Measurement with TDLAS: Combustion Control, Inerting, and Process Monitoring
In Brief Oxygen measurement serves fundamentally different purposes depending on the application. In combustion, O₂ in…
Gas Analysis in Biogas Production: CO₂, CH₄, and H₂S Monitoring from Digester to Grid
In Brief Biogas production depends on a controlled anaerobic digestion process whose health and output are…
Combustion Gas Analysis in Power Plants: CO₂, CO, and O₂ for Efficiency and Emissions Control
In Brief Combustion optimization in power plants requires continuous measurement of exhaust gas composition, primarily CO…
Gas Analysis Across the Carbon Capture and Storage Chain: From Flue Gas to Geological Storage
In Brief Carbon capture and storage requires gas analysis at every stage of the process: measuring…
Oxygen Monitoring in Chemical Processes: Inerting Verification, Reaction Atmosphere Control, and Safety
In Brief Oxygen concentration is a critical control parameter in chemical manufacturing, where it determines whether…
Oxygen monitoring in confined spaces using TDLAS
In Brief Oxygen concentration in confined spaces must stay within the 19.5% to 23.5% range to…
Oxygen monitoring for combustion control using TDLAS
In Brief Combustion efficiency depends on maintaining the correct excess oxygen level in the flue gas.…
Gas monitoring in water and wastewater treatment using TDLAS
In Brief Water and wastewater treatment facilities produce and consume several gases that require continuous monitoring:…
TDLAS gas analyzers as process control instruments
In Brief A gas analyzer used for process control must meet requirements that go beyond analytical…
TALK TO OUR TDLAS EXPERTS
Interested in learning more?
Talk to an engineer or contact us to learn more about our products and technology, and explore how our next-generation TDLAS gas analyzers can solve your gas analysis applications.