It's fine to make that trip. If the dinghy motor quit the prevailing wind is going to keep you in the Channel so no safety issues. Keep in mind however it will be slower and bumpier coming back into the wind.
G