Unlike a missing component, an assembly defect requires the model to tell not just "is something there" but "is it there in the right orientation and position". This is usually harder than detecting absence, because the difference between correct and defective assembly can be geometrically subtle.
That is why training data has to cover the real assembly-error variants that actually occur on the line — not just one "textbook" example of reversal. During the pilot we agree with you which error variants are critical and which are cosmetic, and that shapes how decision thresholds are chosen.
As with other scenarios, the final decision is made locally at the Production station, with no need to send images outside the plant.