Are you talking about sysvol here or your own DFS?
How much data are you replicating?
Are the servers on VAN or LAN?
You do not want to manually delete any files from staging folders, if FRS can't find the file it needs, it will stop replicating.
Yes, there are ways to invoke the cleanup, but...