And over periods of millions of years, we also have geological activity raising landmasses.
Even faster than that, land is rising very fast in places previously glaciated. Unsurprisingly, taking a mile thick glacier weighs the land down a bit.
https://en.m.wikipedia.org/wiki/Post-glacial_rebound
And sea levels change radically according to ice age cycles, by over 100 metres.

