The configuration file is ~/.exrc, which is read by vi and most clones. (If you're using vim, you can also use ~/.vimrc.) Any set commands and such that you put in this file will be run on startup. Mine contains (from memory):
set tabstop=4
set number
set showmode
For specifics on the settings available, you should consult the man page or similar documentation.