You should remove manually:
1) interface definition in .idl
2) .h and .cpp files of ATL object.
3) some strings in main project's .cpp file.
4) resourse "registry".
and may be something else...
The easiest way to determine what you should remove - create empty projectm, remember, add ATL object, compare.