discoverer: Don't assume GSource was attached to default GMainContext
g_source_remove() works only for a GSource which was attached to default GMainContext, but the GSource might be attached to custom context depending on how gst_discoverer_start() was called.