It is NOT enough to delete audio files in Windows, and expect the DPS Library to automatically know what you have done! To do so is folly, foryou will end up with orphaned library entries. (They will point to audio that no longer exists!)
From the DPS Library itself, you can either remove items from the library (leaving them intact on the hard drive) or simultaneously delete them from the hard drive AND remove them from the library.