I've always wondered if the answer is to keep a BJ where he is and have the 6th official on the HL sideline (SJ). The HL would stay at the line (not literally, but moves with the play) until the ball moved across while the LJ would move as he does now. The BJ favors the LJ side but still keeps the TE on the HL side. The HL would have fewer downfield pass responsibilities. A side judge could really help out on punts and downfield blocking fouls.
However, if we could go 6, there really isn't much reason to not go 7.