Dear Yahoo – Please get with the program (or, why am I still getting traffic to my old IP even though I updated my DNS entires?)
Monday, April 6th, 2009Recently we move our wedding website application to ec2 servers. Part of doing so meant updating DNS entries. 5 days after changing them, I’m still seeing traffic to the old servers… 
Part of moving to ec2 required us to move to a 3rd party DNS solution. We chose DynDNS. Their offering is pretty good, but I’m less then impressed with their support. [their response time is about 24 hours and when I asked why I'd still be getting traffic to the old IP and what I might do about it they basically said "that's not our problem"...]
Anyway – before changing hosts I set the DNS TTL to 20s. I was surprised to see traffic to the old IP a day later. On the second day I got worried. After a few more days I was even more so…
After looking through the logs a bit more it seems that almost all of the traffic in the last two days is coming from the IP 72.30.79.108 – which turns out to be one of yahoo’s crawlers…
So, Yahoo, if you read this, please make sure your crawlers respect DNS records… Otherwise you’re getting stale data…
