I hate when that happens.

Well you could argue that Harry could choose early retirement for reasons like spending time with the family, slower pace, coaching Quidditch, or Auror injury. That could put him at retired and his kids still being young.

My favourite part of story writing is developing the backstory and plotting the details. It's the actual writing that usually causes me problems. I love the plotting.