I hate loose ends, especially financial loose ends.  If you have old accounts that you no longer use like credit cards, home equity lines or other bank accounts, you should close them.  In case you need convincing, I've created a list of the reasons you should close unused accounts.
When ING kept sending me statements [...]