Indirectly, those guys(the non scoring wrestlers) prevent other teams from scoring points by winning - so it does have a significant impact.