Do you flag the offense for USC if the QB in the huddle loudly says "#33 sweep right" and then they throw a long pass to #80 on the left? If not, why throw a flag for running a play from an apparent take-a-knee formation?
It's not about the formation, it's about informing the officials and using the officials communication to the defense to put the defense at a relaxed position.
If you and/or your crew have the philosophy of not getting involved, and the offense is in 'victory' formation, but runs a play, that's not a penalty.
But if you choose to tell the defense that the offense is taking a knee, you can't let a regular play be run.
To me, that's an argument to not get involved at all, other than maybe a "be smart" warning.