Looking at the video yesterday, A5 was in on 3rd down, came off, the sideline had some indecision about whether to punt or go and eventually went back out on the field but never went inside the numbers before the snap. He was never replaced so he was the 11th player. We should have ruled it Illegal Formation instead. We'll go over communication in pregame this week.
This is going to be a tough one to catch live, but by rule I think it would still be illegal substitution. 3-7-3 prevents a player from "withdrawing and re-entering as a substitute" and 2-32-15 defines a substitute as (amongst other things) a player who may fill a vacancy. Once the player left the field with the intention of being replaced, he created a vacancy on the field -- anybody who becomes player #11 is therefore a substitute, even if it's the same player.
That being said, I don't think we need to over officiate this. There's enough substitution confusion that happens every game that's not an attempt to deceive or gain an advantage. Two people come on and three run off, then coaches start yelling, "Not you, Bubba! Stay out there!" -- technically illegal substitution if he returns, but have you ever thrown a flag for that?
Similarly, a player comes on and says "Bubba, you're out!" and Bubba starts off the field -- then coaches yell "No, Tank, not Bubba!". Since Bubba was told he was being replaced, he is, by rule, a replaced player and cannot reenter. Again, we're not throwing a flag for that since there wasn't an intent to deceive.
In this situation, however, since he replaced himself in an unintentional hideout style, I'd vote illegal formation -- which means the end enforcement (live ball foul) was right for the wrong reason.
First off, I appreciate the responses and information. My first time on the forum and couldn’t be more satisfied to help our team.
So just to clarify, if that indecisive player never came off the field, and rather finished the third down play outside of the numbers and then came back to LOS to line up outside the numbers quickly (let’s say because of a 2 minute drill), is this illegal? Since he never left the field of play?
By rule, yes, that would be illegal. In practice, you'd look for the attempt to deceive the defense before flagging it. If the defense knows he's there, I'd just remind him before the next play to get inside the numbers, but not penalize.