In short
Every measuring instrument has a least count — the smallest reading it can resolve. A metre scale reads to 1 mm, a Vernier calliper to 0.01 cm (0.1 mm), and a screw gauge to 0.01 mm. The reading from any instrument follows the pattern: Main Scale Reading + (coinciding division × least count) ± zero error correction. Choosing the right instrument means matching its least count to the precision your experiment demands.
Open the physics lab cupboard in any Indian school, and you will find three instruments sitting on the shelf in ascending order of delicacy: a wooden metre scale, a steel Vernier calliper, and a screw gauge wrapped in cloth. Your teacher hands you a thin copper wire and asks you to measure its diameter. The metre scale is useless — the wire is thinner than one millimetre division. The Vernier calliper gets you close — maybe 0.8 mm. But the screw gauge reads 0.82 mm, and that extra digit is the difference between a correct and incorrect value of the wire's resistivity when you plug it into a formula later.
That is the central idea of this article: different instruments see different levels of detail, and the instrument you choose determines how much truth you can extract from a measurement.
The precision hierarchy — why multiple instruments exist
A measurement is only as good as the instrument making it. The key property of any instrument is its least count — the smallest difference it can detect.
| Instrument | Typical least count | What it measures well |
|---|---|---|
| Metre scale | 1 mm (0.1 cm) | Lengths of notebooks, tables, pendulum strings |
| Vernier calliper | 0.1 mm (0.01 cm) | Diameter of a cricket ball, thickness of a glass slab, depth of a beaker |
| Screw gauge (micrometer) | 0.01 mm | Diameter of a wire, thickness of a ₹10 coin, thickness of a glass sheet |
| Spherometer | 0.01 mm | Radius of curvature of a lens or mirror surface |
| Travelling microscope | 0.01 mm | Small displacements — fringe spacing in interference, capillary rise |
Each instrument is built around a different mechanical trick to subdivide a millimetre. The metre scale simply rules lines 1 mm apart — what you see is what you get. The Vernier calliper uses a sliding secondary scale to interpolate between millimetre marks. The screw gauge uses a rotating screw to convert angular motion into tiny linear motion. Understanding how each instrument achieves its precision is the key to reading it correctly.
The Vernier calliper — reading between the lines
Construction
A Vernier calliper has two scales: a main scale (fixed, graduated in millimetres, like a ruler) and a Vernier scale (sliding, with slightly different spacing). It also has a pair of external jaws (for measuring outer dimensions like the diameter of a ball), internal jaws (for measuring the inner diameter of a hollow tube), and a depth rod (for measuring the depth of a hole or beaker).
The secret: 10 Vernier divisions = 9 main scale divisions
Here is the clever trick that makes the Vernier work. On a standard Vernier calliper:
- 1 main scale division (MSD) = 1 mm
- 10 Vernier scale divisions (VSD) span exactly 9 mm
So 1 VSD = 9/10 mm = 0.9 mm.
The difference between one MSD and one VSD is:
Why: because each Vernier division is slightly shorter than a main scale division, the two scales go in and out of alignment as the Vernier slides. At any position, exactly one Vernier line will align with a main scale line — and which one tells you the fractional part of the reading in units of the least count.
This is the Vernier principle: the mismatch between two nearly-equal spacings lets you interpolate between the main scale marks to a precision of 0.1 mm — ten times finer than the main scale alone.
How to take a reading
Step 1: Read the main scale. Look at where the zero of the Vernier scale falls on the main scale. Read the main scale division just to the left of the Vernier zero. Call this the Main Scale Reading (MSR).
Step 2: Read the Vernier scale. Look along the Vernier scale and find which Vernier division aligns most closely with any main scale division. The number of that Vernier division is the Vernier Scale Reading (VSR). It can be 0 through 10.
Step 3: Calculate.
For the standard calliper with LC = 0.01 cm:
Why: the MSR gives you the whole millimetres. The VSR tells you how many tenths of a millimetre the Vernier zero has moved past the last main scale mark. Multiplying VSR by the least count converts that count into actual length.
Zero error — when zero is not zero
Close the jaws of the Vernier calliper completely, with nothing between them. In an ideal instrument, the zero of the Vernier scale should perfectly align with the zero of the main scale. If it does not, the instrument has a zero error.
Positive zero error: The Vernier zero lies to the right of the main scale zero. The instrument adds a small extra amount to every reading. To correct: subtract the zero error from the reading.
Negative zero error: The Vernier zero lies to the left of the main scale zero. The instrument reads slightly less than the true value. To correct: add the magnitude of the zero error to the reading.
The corrected reading is:
Why: if the zero error is positive (say, +0.03 cm), the instrument reads 0.03 cm too high on every measurement. Subtracting it gives the true value. If the zero error is negative (say, −0.02 cm), subtracting a negative number is the same as adding — the reading goes up, compensating for the instrument reading too low.
How to find the zero error: Close the jaws, then read the Vernier as if you were measuring an object. If the Vernier zero is to the right of the main scale zero, the zero error is positive and equals VSR × LC. If the Vernier zero is to the left, the zero error is negative and equals −(10 − VSR) × LC (equivalently, −(number of divisions from the right) × LC).
The screw gauge (micrometer) — turning rotation into precision
Construction
A screw gauge uses a calibrated screw to translate rotation into linear motion. It has a U-frame that holds the object between a fixed anvil and a movable spindle. The spindle is connected to a thimble (the part you rotate), which in turn is connected to the screw. A linear scale (also called the pitch scale or sleeve scale) is printed on the barrel, and a circular scale is printed on the thimble's bevelled edge.
Pitch and least count
The pitch of the screw is the distance the spindle advances in one complete rotation of the thimble. For a standard screw gauge:
Why 0.5 mm and not 1 mm? The linear scale has marks at every 0.5 mm (the smaller marks between the numbered whole-millimetre marks). One full turn of the thimble moves the spindle from one mark to the next.
The thimble has 50 equal divisions around its circumference. So:
Why: each tiny click of the circular scale advances the spindle by 1/50th of the pitch. Since the pitch is 0.5 mm, each division corresponds to 0.01 mm — that is 10 micrometres, about one-fifth the thickness of a human hair.
This is ten times finer than the Vernier calliper. The screw gauge achieves this because the screw mechanism converts a large angular movement (rotating the thimble) into a tiny linear movement (advancing the spindle), and the 50 divisions on the thimble let you read that tiny movement precisely.
How to take a reading
Step 1: Read the linear scale. Look at the edge of the thimble. Count the number of divisions on the linear scale that are visible (not covered by the thimble). Remember that the small marks below the datum line indicate half-millimetres.
If you see the 3 mm mark and one additional half-mm mark beyond it, your Main Scale Reading (MSR) is 3.5 mm.
Step 2: Read the circular scale. Look at which circular scale division aligns with the datum line (the horizontal reference line on the sleeve). Call this the Circular Scale Reading (CSR).
Step 3: Calculate.
For the standard screw gauge with LC = 0.01 mm:
Why: the MSR gives you the reading to the nearest 0.5 mm. The CSR tells you how many hundredths of a millimetre the thimble has rotated beyond that last mark. Together, they give a reading precise to 0.01 mm.
Zero error in the screw gauge
Close the screw gauge gently using the ratchet (never force it by turning the thimble directly — you will damage the screw). With the jaws fully closed:
No zero error: The zero of the circular scale aligns exactly with the datum line, and the zero of the linear scale is just visible at the thimble's edge.
Positive zero error: The zero of the circular scale has passed below the datum line. The instrument reads higher than the true value. Zero error = +(number of divisions below datum × LC).
Negative zero error: The zero of the circular scale is above the datum line. The instrument reads lower than the true value. Zero error = −(50 − number of divisions above datum) × LC.
Why: the correction formula works the same way as for the Vernier — if the instrument reads too high (positive error), you subtract; if it reads too low (negative error), subtracting a negative adds.
Worked examples
Example 1: Reading a Vernier calliper — diameter of a cricket ball
You clamp a cricket ball between the external jaws of a Vernier calliper. The least count is 0.01 cm. The zero error was found to be +0.03 cm. Read the measurement from the scale shown below.
Step 1. Identify the Main Scale Reading.
The Vernier zero lies between 7.2 cm and 7.3 cm on the main scale. So MSR = 7.2 cm.
Why: you always take the mark just before (to the left of) the Vernier zero, not the mark after it. The fractional part will come from the Vernier reading.
Step 2. Identify the Vernier Scale Reading.
Scanning along the Vernier scale, the 4th division aligns most closely with a main scale division. So VSR = 4.
Step 3. Calculate the observed reading.
Step 4. Apply zero error correction.
The zero error is +0.03 cm (positive — the instrument reads too high).
Result: The diameter of the cricket ball is 7.21 cm (or 72.1 mm).
A standard men's cricket ball has a diameter between 71.3 mm and 72.9 mm, so this reading is right in the expected range — a good sanity check.
Example 2: Reading a screw gauge with negative zero error — thickness of a ₹10 coin
You use a screw gauge (pitch = 0.5 mm, 50 circular scale divisions, least count = 0.01 mm) to measure the thickness of a ₹10 coin. When the jaws are closed (no coin), the circular scale reading is 46 — the zero mark on the circular scale sits 4 divisions above the datum line. With the coin clamped, the reading is as shown below.
Step 1. Determine the zero error.
When the jaws are closed, the circular scale reads 46 instead of 0. The zero mark is 4 divisions above the datum line (50 − 46 = 4). This is a negative zero error.
Why negative? The thimble has not rotated far enough to bring the zero to the datum line — the jaws close before the scale reaches zero. This means the instrument under-reads: it reports less than the true thickness.
Step 2. Read the linear scale.
The thimble edge is past the 2.5 mm mark (the half-millimetre mark after 2), but has not reached the 3 mm mark. So MSR = 2.5 mm.
Step 3. Read the circular scale.
The 32nd division on the circular scale aligns with the datum line. So CSR = 32.
Step 4. Calculate the observed reading.
Step 5. Apply zero error correction.
Why add? Subtracting a negative zero error is the same as adding its magnitude. The instrument was under-reading by 0.04 mm, so the true thickness is 0.04 mm more than what the scale showed.
Result: The thickness of the ₹10 coin is 2.86 mm.
For reference, a standard ₹10 bimetallic coin has a thickness of about 2.8–2.9 mm, so this measurement is consistent.
Common confusions
These are the mistakes that show up most often in lab exams and JEE problems. Read through them now so you do not make them under pressure.
-
Positive vs negative zero error — which way do you correct? The rule is always the same formula: corrected = observed − zero error. If the zero error is +0.02 cm, you subtract 0.02. If the zero error is −0.03 cm, you subtract (−0.03), which means you add 0.03. The confusion arises because students try to remember "add for negative, subtract for positive" as a separate rule — but it is not a separate rule, it is just how subtraction works with signed numbers.
-
Least count of a Vernier is not 0.1 cm. The least count is 0.01 cm (= 0.1 mm). Students often confuse the two because the Vernier has 10 divisions, and 1/10 = 0.1 — but 0.1 of what? It is 0.1 of a millimetre, not 0.1 of a centimetre. The least count is (1 MSD − 1 VSD) = 1 mm − 0.9 mm = 0.1 mm = 0.01 cm.
-
Forgetting the half-millimetre mark on the screw gauge. The linear scale of a screw gauge has marks at every 0.5 mm. If the thimble edge is past a small mark (below the datum line) that you missed, your reading will be off by 0.5 mm — a massive error for an instrument that reads to 0.01 mm. Always check: is there a half-mm mark visible between the last whole-mm mark and the thimble edge?
-
Confusing pitch with least count. The pitch (0.5 mm) is the distance per full rotation. The least count (0.01 mm) is the distance per one circular scale division. They differ by a factor of 50. If a problem says "the screw gauge has a pitch of 1 mm and 100 divisions," the least count is 1/100 = 0.01 mm — the same as a gauge with pitch 0.5 mm and 50 divisions.
-
Applying zero error correction in the wrong direction. Some students memorize that positive zero error means the Vernier's zero is "to the right" and try to recall which direction means add or subtract. Instead, think of it physically: if the jaws are closed and the instrument reads +0.02 cm instead of zero, then every reading is inflated by 0.02 cm. You must subtract to get the true value. Similarly, if the closed instrument reads −0.03 cm (i.e., the zero is before the main scale zero), every reading is 0.03 cm too small, so you add 0.03.
Systematic vs random errors in instruments
Every measurement you make with any instrument is affected by two kinds of error:
Systematic errors affect every reading in the same direction by the same amount. Zero error is the classic example — if the Vernier's zero is shifted by +0.03 cm, every single measurement you take with that calliper will be 0.03 cm too high. Other sources of systematic error include a ruler that has expanded due to heat (every reading slightly too small) or parallax from always reading the scale from the same wrong angle.
The defining feature of systematic errors: they do not average out. Taking 50 readings and averaging them will not remove a zero error — the average will be just as wrong as each individual reading. Systematic errors can only be fixed by calibrating the instrument, correcting the technique, or applying a known correction (like zero error subtraction).
Random errors scatter readings unpredictably — sometimes too high, sometimes too low. Your hand trembles slightly as you close the jaws, you read the scale from a slightly different angle each time, the object's thickness varies slightly at different spots. Each reading is a little different.
The defining feature of random errors: they do average out. Take 10 readings of the same wire's diameter, and their mean will be closer to the true value than any individual reading. This is why your lab manual asks you to repeat measurements and report the average.
| Property | Systematic error | Random error |
|---|---|---|
| Direction | Same direction every time | Equally likely high or low |
| Fixed by averaging? | No | Yes |
| Fixed by? | Calibration, correction, better technique | Repeated measurements, averaging |
| Example | Zero error, thermal expansion of scale | Parallax variation, hand tremor |
Why this matters: when you report a measurement, you must handle both types. Correct for systematic errors (zero error, known biases) first. Then take multiple readings and report the mean to reduce random errors. Ignoring either type gives you a number you cannot trust.
Going deeper — more instruments and choosing wisely
If you have understood the Vernier calliper and screw gauge, you have the conceptual tools for every precision instrument. The rest of this section covers instruments that appear in JEE and advanced lab practicals.
The metre scale — when rough is good enough
A wooden or steel metre scale has a least count of 1 mm. It is the right instrument when you need a length to the nearest millimetre and no finer — the length of a pendulum string, the distance between two marks on a bench, the height of a liquid column in a wide tube.
The main source of error with a metre scale is parallax. If you look at the scale from an angle, the reading shifts because the graduated surface is a few millimetres above the object being measured. Always position your eye directly above the mark you are reading, perpendicular to the scale. Some scales have markings engraved into the surface rather than printed on top — these reduce parallax because the marks are closer to the object.
The spherometer — measuring curvature
A spherometer is a specialised screw gauge designed to measure the radius of curvature of a spherical surface — the face of a lens, the inside of a watch glass, the surface of a concave mirror.
It has three outer legs arranged in an equilateral triangle and one central leg that is a micrometer screw. You place the three outer legs on the curved surface and screw the central leg until it just touches. The height h between the plane of the outer legs and the tip of the central leg, combined with the distance l between the outer legs, gives the radius of curvature:
Why this formula? The three outer legs define a circle of radius a = l/\sqrt{3} on the spherical surface. The central leg measures the sagitta (the height of the spherical cap above this circle). From the geometry of a circle, the radius of the sphere, the radius of the base circle, and the sagitta are related by R = \frac{a^2}{2h} + \frac{h}{2}. Substituting a = l/\sqrt{3} gives a^2 = l^2/3, and so R = \frac{l^2}{6h} + \frac{h}{2}.
The least count of a spherometer is the same as a screw gauge (0.01 mm), because the central leg works on the same screw principle. The instrument is useful because measuring the radius of curvature of a lens directly (with a ruler, say) is nearly impossible — the curvature is too gentle to see.
The travelling microscope — measuring the unmeasurable
A travelling microscope is a compound microscope mounted on a precision linear stage with a Vernier scale. You focus the microscope on one edge of the thing you want to measure, note the Vernier reading, then travel the microscope to the other edge and note the new reading. The difference is the measurement.
Its least count is typically 0.01 mm — the same as a screw gauge — but it can measure things that no calliper can grip: the spacing between interference fringes, the diameter of a capillary tube from inside, the meniscus height in a narrow tube.
The travelling microscope eliminates parallax entirely because the crosshairs in the eyepiece are in the same focal plane as the object. When the image is in sharp focus, there is no parallax between the crosshairs and the object.
Choosing the right instrument
The decision is driven by two questions: what is the expected size of the quantity? and what precision does the experiment need?
Rule of thumb: the least count of your instrument should be at most one-tenth of the acceptable uncertainty. If you need the diameter of a wire to within 0.1 mm, use a screw gauge (LC = 0.01 mm). If you need the length of a pendulum to within 1 mm, a metre scale is fine.
| Measurement task | Expected size | Required precision | Use |
|---|---|---|---|
| Length of a pendulum string | ~100 cm | 1 mm | Metre scale |
| Diameter of a cricket ball | ~7 cm | 0.1 mm | Vernier calliper |
| Thickness of a glass slab | ~5 mm | 0.1 mm | Vernier calliper |
| Diameter of a copper wire | ~0.5 mm | 0.01 mm | Screw gauge |
| Thickness of a ₹10 coin | ~2.8 mm | 0.01 mm | Screw gauge |
| Radius of curvature of a lens | ~20 cm | 0.01 mm (for h) | Spherometer |
| Fringe spacing | ~0.5 mm | 0.01 mm | Travelling microscope |
The mistake students make is using too precise an instrument for a coarse measurement (wasting time) or too coarse an instrument for a precise measurement (getting meaningless digits). If you are measuring the distance between two interference fringes that are 0.3 mm apart, a metre scale cannot even see them — you need a travelling microscope.
Where this leads next
- Errors in Measurement — how to quantify, propagate, and report uncertainty in your measurements.
- Significant Figures and Rounding — how many digits to keep in a measurement and a calculation.
- Units and the SI System — the foundation: what you are measuring in.
- Estimation and Order of Magnitude — when you do not have an instrument at all, and need to estimate.