[sarcasm]
Just exclude everything other than scsi, usb, video, etc for your minimal kernel.
[/sarcasm]
In all seriousness, without mentioning why and for what you want to create a minimal kernel for AND what type of hardware you have on your target, we really can't say.
Compiling a kernel with scsi, usb, video, etc is NOT a minimal kernel IMHO.
--== Anything can go wrong. It's just a matter of how far wrong it will go till people think its right. ==--