It's not gut feeling with me.
I've done a lot of reading on it. My three favorite papers that I keep referring to are:
Media Management in Final Cut Pro 4 by Andrew Balis
Technique: Using Media Manager to get rid of unused media by Larry Jordan
'I Said TRIM, dang it' by Charles Roberts
So far it's gone very smooth.