You have a few options at this stage, I would recommend you look at few CVS GUI's. The ones we tend to use here are TkCVS and WinCVS. I have used both and although WinCVS is probably a better package, I actually prefer the simplicity of TkCVS - although it tends to require you to define modules to work.
I have only used both GUI's to access a repository via 'pserver' (i.e. not ssh or rsh) - So I would setup 'pserver' access on CVS:
add a new entry to /etc/inetd.conf (if you are using xinetd it is a little different) - make sure the paths are correct for your machine/setup.
2401 stream tcp nowait root /usr/local/bin/cvs
cvs -f --allow-root=/usr/local/cvsroot pserver
Then restart inetd.
I assume you have already done the 'cvs init' to start the repository...
Scotty