@edebill @srol
I wouldn't worry about it too much, unless it is a really busy server odds are not many people will have the current DNS answer cached. And usually the DNS servers that do the caching have a shorter maximum TTL.
In my experience around 4 hours is the longest you will usually wait for a domain to point to the new webserver.
Will you also change the email destination (MX-records)?