Fighting the United Kingdom meant you were fighting Canada, Australia, new Zealand, south Africa and potentially millions of colonial troops. Also the Americans wouldn't be far behind.
Hitler extended some mercy to English soldiers at Dunkirk in an effort to have a negotiated peace with the British Empire.
Hitler has no Quarl with the British. He was really about finishing off the slavs, jews and communists.