Hmm, I can't really think of any issue with the replay system as it is now. It does what I want it to do. I can press X to move through my units, set the speed really fast, and internally process what happened between each one.
I guess the only minor nitpick is I'd get rid of that 500 or so millisecond delay before the unit moves and just start moving the unit immediately when I hit X.