[PATCH openEuler-22.03-LTS-SP2 2/3] spi: cadence-quadspi: Handle spi_unregister_master() in remove()