As a child of the 60s I can mentally juggle most everyday units but there are a couple that really throw me, and I'm reduced to counting on my fingers.
The first is use of lbs for any large quantity (bigger than, say, a turkey). Mainly Americans do this, for example giving the weight of people or vehicles in lbs. What's that all about? Use kg, tons, tonnes, cwt, stone and I'm fine ... but not lbs. And 2.2 is a really awkward factor for convering to kg.
The second is feet for any large quantity. I'm fine with feet for the height of people, the depth of ditches and so on but anything bigger than that really throws me. 2,000 feet? WTF? Yards, metres, miles, km fine. But feet? Are you insane? (or a commercial pilot). Fortunately a quick division by 3 reduces it to yards, which are roughly a slightly smaller version of metres.
Both of the above I suspect are Americanisms. (Who also have their own pints, tons and hundredweight plus a slightly different mile standard I think)
Also fluid ounces. But I have never in my life had any reason to be interested in fl oz, and I doubt I ever will.