xwayland: don't fall back to wl_drm with explicit modifier

It's incorrect to strip an explicit modifier. Daniels' docs 1 states:

when importing a buffer, the user may supply DRM_FORMAT_MOD_INVALID as the buffer modifier (or not supply a modifier) to indicate that the modifier is unknown for whatever reason; this is only acceptable when the buffer has not been allocated with an explicit modifier