When you change your preferences while a document is open, you will only change the preferences for that particular document.
To change your default preferences, make sure no documents are open. Then make the changes.
So, in your case, close all documents, then go to Preferences > Units and...