I had the same issue with 10.9. Turns out that I, too, run the Digidesign drivers for my old MBox 2 Mini which I haven't used in a while.
I removed the Digidesign CoreAudio.plugin file from the HAL directory and all seems well now.
This issue has been bugging me for years. Thanks for posting about it!