Interesting enough, I did this on my Lab System and there was no reboot. The NTP service was already running and I just added 2 new IP addresses into the field and then removed 2 stale ones. I had a continuous ping going and didn't lose any replies. I then did this on all my other systems, including hubs and didn't have the reboot issue.