As others have noted above - it depends on the adventure. On a couple of the Back Stage Magic ABD's we've done, we had to meet at something like 6 am one morning. Also, expect to have some events run late into the evening/night, combined with an early get up the next day.
You definitely don't want to start an ABD sleep deprived so plan on getting to the starting city a day or two early to adjust to local time and/or jet lag.