Very true. In my specific line of work, it can cause issues (alongside the issues of sensitive information being uploaded to the AI and stored who knows where.)
Here's an example of incorrect-ness:
Me: Give me a case play involving a roughing the passer penalty, describe the foul, and where the ball will be placed using NCAA rules
ChatGPT: Sure, here's an example of a roughing the passer penalty in a college football game under NCAA rules:
Scenario: During a pass play, the quarterback throws the ball and is hit by a defensive player after the ball has left his hand. The hit is late and excessive, causing the quarterback to fall to the ground.
Foul: Roughing the passer penalty. This is a violation of NCAA football rule 9-1-4, which states that a defensive player may not "make forcible contact with the passer after the ball has left his hand" or "initiate a roll or lunge and forcibly hit the passer in the knee area or below."
Consequence: The penalty for roughing the passer is 15 yards, and the opposing team will be awarded an automatic first down. In this scenario, the ball will be placed 15 yards from the previous line of scrimmage, which is the spot where the quarterback released the ball. If the play resulted in a first down, the new series will begin at the spot where the ball was downed after the penalty was enforced. If the play did not result in a first down, the ball will be moved forward 15 yards from the previous line of scrimmage, and a new first down will be awarded to the offensive team.
Me: That is an incorrect rule reference. 9-1-4 addresses targeting, which this is not. What is the correct rule reference?
ChatGPT: I apologize for the error in my previous response. You are correct that rule 9-1-4 in NCAA football addresses targeting, not roughing the passer. The correct rule reference for roughing the passer in NCAA football is Rule 9-1-3:
Rule: Roughing the passer penalty. Rule 9-1-3 in NCAA football states that a defender may not "hit a passer forcibly at or below the knee level, even if the initial contact is above the knee." In addition, a defender may not "make forcible contact with the passer that is clearly unnecessary" or "initiate contact with the passer who is in a defenseless posture."
Consequence: The penalty for roughing the passer in NCAA football is 15 yards from the previous line of scrimmage, and an automatic first down is awarded to the offensive team. If the foul occurs during a play that resulted in a first down, the new series will begin at the spot where the ball was downed after the penalty was enforced. If the play did not result in a first down, the ball will be moved forward 15 yards from the previous line of scrimmage, and a new first down will be awarded to the offensive team.
Me: Rule 9-1-3 is also incorrect.
ChatGPT: I apologize for the confusion and any inconvenience caused. The correct rule reference for roughing the passer penalty in NCAA football is Rule 9-1-4-c, which states:
"A defensive player shall not use the hand(s) or arm(s) to initiate contact to the head or neck area of a passer who is in a passing posture (exception: a defender may use his hands/arms to ward off or push an offensive blocker’s hands/arms from him), or make forcible contact with the passer that is either unnecessary roughness or roughing the passer. This does not apply to a defender who is blocked (blocked meaning contact by an offensive player that deflects the defender from his path) into the passer."
Consequence: The penalty for roughing the passer in NCAA football is 15 yards from the previous spot and an automatic first down is awarded to the offensive team. If the foul occurs during a play that resulted in a first down, the new series will begin at the spot where the ball was downed after the penalty was enforced. If the play did not result in a first down, the ball will be moved forward 15 yards from the previous line of scrimmage, and a new first down will be awarded to the offensive team.
It's obviously not perfect, likely never will be, but I can still see value and opportunity here. You could create an entire quiz around a specific rule (assuming you check the answers.) I might try to do that later.