I think it’s like jet lag. We have our own natural time and sleep rhythms. If you go to bed late yes your tired the next day, but your time sleep rhythm is not affected, your body knows it is short of sleep. When someone messes with the clock your body is out of sync for a number of days.