Professional Detailing2 min read

Survivorship Bias in Coating Reviews: Include Samples That Left the Test

Track samples that leave a coating trial and avoid presenting only surviving vehicles as representative durability evidence.

Updated · NANOLAB Knowledge

Survivorship bias occurs when a conclusion is based only on the samples that remain visible or available. In a coating evaluation, vehicles that were repolished, repaired, sold or withdrawn can disappear from the record, leaving an unrepresentative group of survivors.

Track the original cohort

Start with a list of every enrolled sample and its planned observations. At each review, record whether it remains in the test and why it left. Do not replace a withdrawn vehicle with a new one while keeping the original trial label and elapsed time.

An illustrative year-end report showing eight attractive surviving vehicles says little about overall performance if twelve others left and their histories are omitted. The reasons for leaving may or may not concern the coating, but they are essential context.

Separate failure from unrelated removal

A panel repainted after an accident is not necessarily a coating failure. A coating removed because of an appearance problem may be directly relevant. Retain both categories without forcing them into the same outcome.

Use predefined event categories and preserve the original notes. If a reason is uncertain, label it uncertain. Retrospectively assigning every departure to an unrelated cause makes the dataset less credible.

Write a bounded conclusion

Report how many samples began, how many remained, which events occurred and how many outcomes could not be assessed. Show results for the observed group without implying that it represents everyone automatically.

For product development, departure records can be as useful as the final photographs because they reveal where a process or study design needs improvement. For marketing, avoid presenting only the longest-lived example as a typical result. A reliable coating review explains who remained in the evidence and who did not, with enough detail to judge the limits of the conclusion.

Related guidance

For product-specific application instructions, consult NANOLAB technical documentation or ask about your surface and intended use.