base-manager: never create kernel device objects for remove events

There is no point in creating a new kernel device object just to process a remove event; instead, do any matching with existing kernel device objects by subsystem and name, which is what the generic backend already did anyway.

This avoids unnecessary lookup of information in sysfs during removal events, because the port is anyway already gone when we try to look those up.