I'm the poor shmuck who just has a couple hundred folders under ~/Library/Fonts and I just drop stuff in there manually.
I've never bothered with a font manager, but I imagine the problem becomes pretty gnarly if you have a thousand or more custom fonts, right? How big is "big" for font collections?