Faults that occur on weights of semantic segmentation networks can significantly compromise the final result of the output mask. In particular determining the degree of such criticality is not a trivial task and, in some cases, it is also extremely crucial. For this purpose, various techniques have been developed to evaluate the output mask. The state of the art methods consist in the comparison between the faulty and faultless output of the network, based on two main segmentation metrics: mean intersection over union (mIoU) and pixel accuracy (PA). These methods, which turns out to be very effective, actually hides several problems and in particular, the main one is that, in real cases, there is no guarantee to have access to the faultless output.