"Cache" implies they're only temporarily on your device. This is false: the files are downloaded and encrypted on your device, and do not go away unless you explicitly tell Spotify/Rdio to remove them.
Spotify/Rdio will remove those files at any time if they lose the license to play them. This is not the case with media files you own, and have complete control over (lacking DRM).