South African rugby in crisis without the fans