We went for my first son's first birthday, and will be going for my second son's first birthday next year. We had a great time, and while he won't remember the trip, we will. We definitely went a lot slower, and didn't do many rides. There was a lot more of just hanging out in the parks enjoying the atmosphere.
The only thing that would give me pause in your situation is the time difference. Have you considered going to
Disneyland Paris instead? Might help with the Disney itch, without dealing with the transatlantic flight.