Risk and Resilience

Normalisation and the Illusion of Precision in Tender Scoring

How normalised tender scoring changes relative rankings, why small score differences can be misleading and where executive judgement must remain visible.

EraNorth Insights · 6 min read

A decimal point can make a tender ranking look scientific even when much of the underlying judgement remains human.

The Week 9 sources show methods for normalising both price and non-price scores. In one common historical approach, the highest non-price score becomes 10 and other suppliers are scaled proportionally. Price may similarly be normalised against the lowest tendered price.

This creates a common scale that allows different dimensions to be combined.

It also creates a risk: leaders may confuse mathematical consistency with decision certainty.

The Strategic Context

Raw qualitative scores are not naturally comparable with dollars.

Normalisation solves that technical problem by converting values onto a relative scale.

But relative scaling means the result depends on the competitive field.

A supplier's normalised score can change because another bidder performs better, even though the supplier's own submission has not changed.

That is not necessarily a flaw.

It is simply what the method does.

The danger arises when leadership forgets that the final number is a constructed comparison, not an objective measurement of absolute value.

What Leaders Commonly Misread

The first mistake is believing normalisation removes subjectivity.

It does not. It transforms scores after human judgement has occurred.

The second is assuming a difference of 0.05 means the higher-ranked tender is meaningfully better.

The third is failing to test how sensitive the ranking is to one evaluator's score.

The fourth is allowing a formula to override known material risk.

The fifth is applying a historic equivalency or threshold rule without checking whether it remains current policy.

Reframing the Issue

Normalisation should be treated as a decision-support transformation.

It helps compare bids consistently.

It does not remove the need to ask whether:

  • the criteria were well chosen;
  • scoring was calibrated;
  • the evidence was reliable;
  • the price formula behaves sensibly;
  • the final difference is decision-significant.

This distinction protects leadership from false precision.

Strategic Analysis

The Week 9 Tasmanian material includes a historical 3 per cent equivalency rule for close-ranked bids, justified by observed variability in subjective committee scoring.

Whether that rule remains current must be independently verified. [FACT CHECK REQUIRED]

But the principle is valuable: small differences in final scores may sit inside the noise of evaluator judgement.

A committee that ranks Tenderer A at 8.91 and Tenderer B at 8.88 should not necessarily describe A as decisively superior.

Leadership should inspect what actually created the difference.

Was it price?

Was it one subjective methodology score?

Was it a policy weighting?

The number should trigger analysis, not end it.

Executive Trade-offs

Normalisation improves consistency and prevents one dimension from dominating simply because it uses a larger numerical scale.

It can also amplify small differences.

A lowest-price formula may give a large competitive advantage to an unusually low bid.

A highest-score normalisation may compress or stretch non-price differences depending on the field.

The stronger approach is to scenario-test the formula before tender release.

Decision Framework

Before adopting normalisation, test:

Behaviour

How does the formula rank realistic bids?

Sensitivity

Would small raw-score changes reverse the result?

Outliers

What happens if one price or non-price score is unusually high or low?

Interpretability

Can executives explain what the final number means?

Consistency

Are the same transformations applied to all bidders?

Judgement

What qualitative review occurs when scores are very close?

The model should make judgement disciplined, not invisible.

From Strategy to Execution

Immediate action: run hypothetical bids through the evaluation model before releasing the tender.

Medium-term capability building: conduct moderation sessions so evaluators understand how raw scores interact with normalisation.

Long-term strategic positioning: retain evaluation data and compare close-score decisions with delivery outcomes.

Over time, the organisation can learn whether particular formulas are producing useful discrimination or only numerical theatre.

Governance Implication

Normalisation should be accompanied by a narrative moderation step. Evaluators should review why the leading bids differ, whether the mathematical gap is material and whether any result is being driven by an outlier or scoring inconsistency.

This matters because normalisation can make a small raw difference appear more consequential once it is converted onto a common scale. A disciplined committee should therefore preserve the raw scores, the normalised scores and the reasoning that connects them.

Where a historic threshold or equivalency rule is proposed, the current policy authority and rationale should be recorded rather than inherited from an old spreadsheet.

Signals to Monitor

Watch for rankings decided by tiny decimal differences, evaluators treating formula outputs as unquestionable, large changes in ranking after one minor score adjustment and teams unable to explain the normalisation method to an approval authority.

Questions for the Leadership Team

  1. What exactly is being normalised and why?
  2. How sensitive is the result to small scoring changes?
  3. Are any outliers distorting the competitive field?
  4. What does a small final score difference actually mean?
  5. Would we make the same recommendation if the decimal points were removed?
  6. Is the formula supporting judgement or replacing it?

Closing Perspective

Normalisation is useful mathematics.

It is not certainty.

The strongest evaluation committees use quantitative models to structure comparison while keeping the underlying judgement, uncertainty and trade-offs visible.

Related article: Comparative Price, Matrix or Normalised Scoring? Match the Evaluation Method to Procurement Complexity

Related article: The Evaluation Report Is the Decision: Turn Scores into a Defensible Recommendation


About EraNorth Insights
EraNorth Insights publishes practical analysis on strategy, projects, operations, transformation and decision intelligence for professional and organisational use. About EraNorth.