It added a bit, but it was for the video package treatment. Stone Cold warned the Rock that if something happened to Debra, something happened to The Rock. IIRC, Angle got Debra in the Ankle Lock and The Rock received a Stunner afterwards for it.
Also when she came back then Jarrett was long gone so it was safe to kayfabe the fact that Austin and Debra were RL (at the time obviously) husband and wife. IIRC she hadn't been on TV since Jarrett left.
Debra actually turned face before JJ left. She hit him with a guitar at Unforgiven.