For terrestrial units I use metric measurements as most of the world works in this system. For nautical units I use nautical miles as each of these equals a degree of latitude and so is very easy to read off a chart.
Interestingly, the original calculation for the metre was also a terrestrial unit. In 1791 its length was defined as one ten-millionth of the distance from the equator to the north pole. I suspect it was chosen as a rationalization of the yard, pace or step which had been in use up to that time.
Another quirk of measurement is the unit used to express depths on nautical charts. Standard British Admiralty practice from the 1970s is to use metres for depth measurements. Even so, many older charts exist with depths expressed in fathoms, one fathom being six feet: so read the units when you go into port on a ship.
Aviation uses nautical miles for linear measurement, which is sensible as the distortions to distance imposed by various map projections make this the easiest unit to use. However, altitude seems to work best in metric with aircraft often flying at a height of around 10,000 metres, the Alps and Andes often topping out around 5,000 metres and the Himalayas at around 9,000 metres. For mountaineering, metres can also be useful as 100 metres of altitude roughly brings about a temperature change of 1° Celsius, which is a useful rule of thumb when choosing equipment.
Horses for courses as often mentioned above. One personal note to add: I habitually carry a steel rule with me, usually one with both metric and imperial units marked on it. Accurate measurement in any system saves so much trouble.