Here are some of the things that will affect your timeframe.
Super Soap Weekend (MGM)(11/7-9)
Food and Wine Festival (EPCOT)
Festival of the Masters (DtD)(11/9-10)
Jersey Week
Veteran's Day (11th)
Fairy Tale Package (FTP)(until the end of Nov)
(My dates may be off slightly--I couldn't find my Mickey Monitor to confirm the dates, but they are close)
So with all of that and the threads on the resort boards about the Poly being overbooked and Disney trying to relocate 150 families, I think it might be fair to say you're not going to be alone. Of course, you'll still have a good time, regardless. I say, prepare for the worse, then if the crowds are not there...or if you manage to stay one step ahead of them, you'll be OK. But, of course, I would make sure you have your priority seatings taken care of before leaving home if you have any favorite places you want to dine.
Doing the single digit dance here!