After re-reading your post, i think the issue may be a bit different. I was cleaning up my dev machine yesterday and noticed over 1k quarantined items, all for database connections that don't exist, but the history providers still did. I managed to clear out the history providers with this post:
However the quarantined items remain, i am not sure if that's the same issue you are experiencing.