This has happened to me so many times, that I just stopped caring to be honest. I know that this is wrong, but it is a quite difficult thing to do, trying to explain that to an angry driver will just not work, so I pretend I don't listen to their shoutings and stuff and move on.