[openEuler-5.10 281/496] soundwire: bus_type: fix remove and shutdown support