The grading exists so that reports from different contractors are comparable. A Grade 4 in one report should mean the same as a Grade 4 in another, which lets you get comparable repair quotes.
Grades apply to individual observed defects, not to the run as a whole. A run with one Grade 5 collapse and otherwise Grade 1 conditions needs one localised repair, not a wholesale reline.
Use the grades to prioritise. Fix the 4s and 5s, monitor the 3s, ignore the 1s.