If it's an rpm-based distro like RedHat ot Mandrake, just remove the old program and install the new one. Be sure to back up the databases beforehand. I've done this before with no issues. I also went from 4.1 to 5.0.
If it was compiled, then installed, by all means, read the doc on mysql.org first.
Mark