Sure, you're focused on the kicker and the holder, but you can see the snap peripherally, just as the kicker does. And if the kicker starts forward and stops, that's a huge clue something's not right.
I don't understand how it doesn't get called, and I coach kickers! This is a mistake, and a foul, by the kicker. Flag him for it!