Are you talking about the server or client farley?
For the client, look for a file called $HOME/.ssh/id_rsa or $HOME/.ssh/id_dsa or $HOME/.ssh/identity and remove it (or better rename it) - There should be a corresponsing public key file with the same name, but .pub on the end - you need to remove that also.
For the server, look for a file called $HOME/.ssh/authorized_keys - edit it and either remove or comment out the line for the client you wish to disable/remove.
Tell us how you get on,
Scotty