All the discussions I have been part of eventually culminated with..."If we see it, we will get it." We did not make any mechanics changes or suggestions as we know the limitations we are under with 5 (or fewer) sets of eyes available. There are some who will say err on the side of safety and flag it if you see the block but are not sure if blocker was restricted or not from blocking in the direction of the block at the spot where the block takes place. Maybe with a crew conference after the play is over, someone on the crew can chime in with info that will let you know if the player was truly restricted or not, i.e. where was he at the snap and what was he doing. If appropriate, wave it off. If not, or nobody knows, enforce it. That works for me assuming when you see the block you perceive it to be dangerous and not just because you see it is a low block.
In some cases, the B might be able to help keep track of things assuming he is not overwhelmed with multiple keys and pass coverage. But when we are confronted with spread offenses who are using multiple types of motion with receivers running routes all over the field, it is going to be very hard to watch everything that needs to be watched.