Using the standard castors then yes. Iit has nothing to do with saddle height though, it is your foot length and your heel catching the outer edge of the castor.
You can either
1) Ride with you foot placed wrong & too far forward on the pedals.
2) Undo the castors and flip them round so the fattest end is inside not out. this has a minor effect on folded stability but the bike still stands up ok and when I did this, my feet (euro size 42-44 uk 8-9) missed the castors completely.
3) Fit easy wheels.