"He can say what he likes. The question is whether he can do the same sort of talking on the field. I'll simply do my talking on the field," Brits told www.supersport.co.za.
Brits also revealed that he had few concerns about Saturday given the strength of the Bok lineout.
He added: "I must say the Aussies are good in the lineout and it's going to be tough on Saturday.
"But having lock forwards such as Andries Bekker, Victor Matfield and Bakkies Botha makes my job easier.
"I'm looking forward to the weekend. I don't know whether I have ever looked forward to any match so much."