Coordinate Measuring Machines: Japanese CMM Technology and Tolerance Stack-up Analysis
§ 01
- When One Measurement Replaces Twenty
- How a CMM Works: The Mechanical and Electronic System
- The MPEE Specification: What CMM Accuracy Actually Means
- Thermal Compensation: The Critical Software Layer
- Tolerance Stack-up Analysis: What the CMM Enables
- Probe Qualification and Its Effect on Measurement Uncertainty
- Practical CMM Usage: The Japanese Production Floor Standard
When One Measurement Replaces Twenty
Before coordinate measuring machines, verifying a complex machined part — a transmission housing with dozens of bores, faces, and datum relationships — required a separate measurement operation for each feature: a bore gauge for each hole, a height gauge for each step, a sine bar for each angle. A skilled metrologist might spend an hour on a single part, and the measurement result was still limited by the cumulative uncertainty of many sequential individual measurements, each introducing its own error.
A modern Mitutoyo CRYSTA-Apex CMM replaces all of those sequential measurements with a single coordinated operation. The part is placed on the CMM table, a probing program runs automatically, and within minutes the software reports every dimension, form error, and positional tolerance on the drawing — all referenced to a common coordinate system that eliminates the datum transfer errors inherent in sequential measurement. More fundamentally, the CMM reports not just whether each dimension passes or fails, but the actual measured value and its relationship to every other feature on the part — enabling statistical process control, root cause analysis, and tolerance optimisation that is impossible with single-feature gauging.
§ 02
How a CMM Works: The Mechanical and Electronic System
The Structural Architecture
A CMM consists of a granite surface plate (the datum reference frame), a moving bridge or gantry structure that positions the probe in three dimensions, linear scales along each axis that measure the probe position, and a probe system that detects contact with the part surface. The Mitutoyo CRYSTA-Apex series uses a moving bridge design — the most common configuration for mid-size CMMs — in which the bridge moves along the X axis (the longest axis of the machine), the probe head moves along Y (across the bridge), and the quill carrying the probe moves along Z (vertically).
The granite base is not simply a flat surface — it is a precision-lapped granite slab whose flatness and thermal stability define the measurement reference frame. Granite is chosen for CMM bases because of its low coefficient of thermal expansion (~5.5 μm/m·°C for black granite, compared to ~11.5 μm/m·°C for steel), its high compressive strength (150–200 MPa), its inherent vibration damping (granite’s internal damping ratio is approximately 10–15× that of steel), and its dimensional stability over time — granite does not creep or relax under sustained load as steel does.
Linear Scales and Position Measurement
The position of the probe along each axis is measured by a linear encoder — either an optical grating (Mitutoyo’s standard) or a laser interferometric scale (in the highest-accuracy models). The Mitutoyo CRYSTA-Apex uses glass scale encoders with 0.1 μm resolution (digital output), read by an optical head that counts grating lines as the bridge moves. The scale uncertainty — including grating pitch error, thermal expansion, and cosine error from scale misalignment — is the primary contributor to the CMM’s volumetric accuracy.
The Probe System
The probe is the CMM’s contact with the physical world. Mitutoyo CMMs support two probe types: touch-trigger probes (TTP) and scanning probes. A touch-trigger probe (such as Renishaw’s TP20, commonly used with Mitutoyo CMMs) generates a discrete trigger signal when the probe stylus deflects on contact with the part surface — the CMM records the probe position at the moment of trigger and adds the stylus ball radius offset to compute the surface point. A scanning probe continuously measures surface position as it moves across the part at constant contact force — collecting a stream of measured points at speeds up to 120 mm/s on the CRYSTA-Apex.
§ 03
The MPEE Specification: What CMM Accuracy Actually Means
CMM accuracy is specified by the Maximum Permissible Error for length measurement (MPE_E or E0,MPE in ISO 10360-2), expressed as a function of the measured length:
MPE_E = A + L/K (μm)
where: A = constant term (μm) — captures probe, scale, and structural errors
L = measured length (mm)
K = slope coefficient (dimensionless)
Mitutoyo CRYSTA-Apex S (500/700/900 series):
MPE_E = (1.7 + 3L/1000) μm
Typical general-purpose CMM:
MPE_E = (2.5 + 4L/1000) μm
At L = 300mm:
CRYSTA-Apex S: MPE_E = 1.7 + 0.9 = 2.6 μm
General CMM: MPE_E = 2.5 + 1.2 = 3.7 μm
The practical significance of the MPE_E specification is its relationship to part tolerances. The standard metrology rule — the 10:1 accuracy ratio — requires that the measurement system uncertainty be no more than one-tenth of the tolerance being verified. For a practical 5:1 ratio (one-fifth of tolerance), the CMM must achieve MPE_E ≤ tolerance/5.
For a part tolerance of ±0.02 mm (40 μm total), the CMM uncertainty must be ≤ 8 μm (one-fifth of 40 μm). The CRYSTA-Apex S achieves MPE_E = 1.7 + 3L/1000 μm — this specification remains below 8 μm for measured lengths up to L = (8 – 1.7) × 1000/3 = 2,100 mm. For a general CMM at MPE_E = 2.5 + 4L/1000, the same constraint limits the effective measurement range to L = (8 – 2.5) × 1000/4 = 1,375 mm. The higher accuracy specification of the CRYSTA-Apex S gives it more than double the effective measuring range in terms of accuracy-guarantee capability.
§ 04
Thermal Compensation: The Critical Software Layer
The CRYSTA-Apex S includes an advanced temperature compensation system — a network of thermal sensors on the CMM scales and a separate set of workpiece sensors — that continuously measures the thermal state of both the machine and the part, and applies real-time corrections to all measured coordinates.
Without thermal compensation, a CMM measuring a steel part at 23°C (3°C above the ISO reference of 20°C) would introduce a systematic error of:
ΔL = α_steel × L × ΔT
For L = 200mm, ΔT = 3°C, α_steel = 11.5 μm/m·°C:
ΔL = 11.5×10⁻⁶ × 200 × 3 = 6.9 μm
This exceeds the CRYSTA-Apex S MPE_E at 200mm
(1.7 + 0.6 = 2.3 μm) by a factor of 3×
With compensation (residual uncertainty ~0.5–1.0 μm):
Thermal contribution reduced to ~0.5 μm — within MPE_E
The compensation system requires the user to input the thermal expansion coefficient of the workpiece material — the CMM controller stores the expansion coefficient of its own scale material permanently, but the part’s material must be specified to apply the correct correction. An engineer measuring an aluminium part (α = 23.6 μm/m·°C) without changing the material setting from steel will apply an incorrect thermal correction, introducing a systematic error proportional to the CTE difference.
§ 05
Tolerance Stack-up Analysis: What the CMM Enables
The most powerful application of CMM measurement in Japanese precision manufacturing is not individual part inspection but tolerance stack-up analysis — the systematic evaluation of how dimensional and geometric errors in individual components combine to affect the performance of an assembled system.
The Stack-up Problem
Consider an assembly consisting of a housing, a shaft, and two bearings. The shaft-to-housing clearance is determined by three dimensions: the housing bore diameter, the outer diameter of the bearing outer ring, and the bore diameter of the bearing outer ring relative to the shaft. Each dimension has a tolerance; the clearance in the assembled system has an effective tolerance that is the combination of all three individual tolerances. If the component tolerances are set independently without analysing their combined effect, the assembled clearance may be inadequate — either too tight (interference fit, bearing locked) or too loose (excessive radial play) — even when every individual component is within its own tolerance.
Worst-Case vs Statistical Stack-up
Two methods are used to calculate the combined tolerance of a stack:
Worst-Case (arithmetic):
T_total = Σ|tᵢ| (sum of all individual tolerances)
Statistical (RSS — Root Sum of Squares):
T_total = √(Σtᵢ²) (square root of sum of squared tolerances)
Example: 5 components, each ±0.02mm tolerance
Worst-case: T_total = 5 × 0.02 = ±0.10 mm
RSS: T_total = √(5 × 0.02²) = √(0.002) ≈ ±0.045 mm
RSS assumes tolerances are statistically independent and
normally distributed — valid when production Cpk ≥ 1.33
Japanese precision manufacturing practice — particularly in automotive and precision instrument production — uses statistical stack-up analysis to set individual component tolerances more economically than worst-case analysis allows. The RSS method shows that five components each at ±0.02 mm produce an assembly variation of only ±0.045 mm, not ±0.10 mm — meaning that individual component tolerances can be relaxed (relative to what worst-case analysis would require) while still achieving the required assembly performance. The cost reduction from relaxed tolerances — wider tolerance means higher yield from machining — is significant in high-volume production.
CMM Data as the Foundation for Stack-up Verification
CMM measurement data provides the empirical foundation for statistical stack-up analysis. By measuring a sample of production parts on the CMM and collecting the actual distribution of each critical dimension, the engineer can determine whether the production process is centred and whether the actual Cpk justifies the RSS assumption. Mitutoyo’s MCOSMOS software — the standard CMM measurement software on CRYSTA-Apex machines — includes statistical analysis functions that compute Cp, Cpk, histogram, and SPC charts directly from CMM measurement data, enabling real-time feedback between the measurement system and the production process.
§ 06
Probe Qualification and Its Effect on Measurement Uncertainty
A CMM probe consists of a stylus (typically a ruby ball on a tungsten carbide stem) mounted on a probe head. The ruby ball’s centre is offset from the probe head’s nominal position by the stylus length and ball radius. Before measurement, the probe must be qualified — its actual position and ball radius determined by probing a calibration sphere (a precision ruby sphere of known diameter mounted on the CMM table) from multiple directions.
The qualification process determines the probe’s effective radius — the radius that, when subtracted from the measured contact point coordinates, gives the surface point. If the ruby ball is not perfectly spherical (roundness error, typically 0.1–0.5 μm for premium styli), the effective radius varies with probe approach direction, introducing a systematic error in the surface point coordinates that depends on the angle at which the probe contacts each measured surface feature.
For production CMM applications, the probe qualification uncertainty is typically the largest single contributor to measurement uncertainty — larger than the CMM scale uncertainty or the thermal correction residual. Mitutoyo addresses this through probe calibration qualification routines in MCOSMOS that characterise the probe’s lobing error (directional radius variation) and apply corrections to measured points. For the highest-accuracy applications, scanning probes (which average over many contact points per measured feature) reduce the effect of probe lobing relative to touch-trigger probes (which rely on single contact points).
§ 07
Practical CMM Usage: The Japanese Production Floor Standard
Japanese precision manufacturing plants using Mitutoyo CRYSTA-Apex CMMs follow a set of operating practices that reflect the physics of CMM measurement uncertainty:
- Temperature equilibration: Parts must be at 20°C ± 2°C before measurement. Parts are placed in the CMM room at least one hour before measurement; for large parts (>200 mm), two hours. The CMM room is maintained at 20°C ± 1°C year-round.
- Probe qualification frequency: Probe qualification is performed at the start of each measurement session and after any probe change or crash. If the CMM room temperature changes by more than 0.5°C during a session, qualification is repeated.
- Workpiece material entry: The workpiece CTE is entered in the temperature compensation settings before each measurement programme. A default setting of steel CTE is not acceptable for aluminium, titanium, or ceramic parts.
- Stylus selection: Stylus length is minimised to reduce probe deflection under contact force. A stylus 4× longer than necessary for feature access introduces 64× more bending compliance — the longest stylus that clears obstructions, and no longer.
- Measurement strategy: For bore diameter measurement, a minimum of 4 points uniformly distributed around the bore circumference is required; 8 or more points for bores where roundness is critical. Single-point bore measurements are not acceptable in Japanese automotive and aerospace supply chains.
Mitutoyo CRYSTA-Apex S series — the standard CNC CMM in Japanese precision manufacturing. MPE_E = (1.7 + 3L/1000) μm, supporting touch-trigger and scanning probes, with MCOSMOS software and temperature compensation.
Mitutoyo CMM systems — Amazon US
For engineers who need CMM capability without a full bridge CMM: Mitutoyo’s portable measuring arm and Keyence’s wide-area 3D CMM represent the expanding category of flexible coordinate measurement solutions for production floor use.
Portable coordinate measuring systems — Amazon US


Comments