Energy after Brexit – will energy security be affected?

Predictions of gloom and doom in the event of a no deal Brexit are not hard to find at the moment. So should energy consumers be concerned?