But Smit, who led the Boks to World Cup glory in 2007 and a memorable series victory over the Lions earlier this summer, believes both the Australian press and public have been too quick to judge the new-look Wallabies.
"The Wallabies are copping unfair criticism," said Smit.
"There is talk in their media that rugby is losing ground to the other football codes in this country.
"People have short memories. Australia and South Africa are the only teams to have won the World Cup twice. The Wallabies have had phenomenal teams in the past and are a phenomenal sporting country."
And Smit insists he is speaking not just from solidarity for his fellow professionals, but from his own first-hand experiences.
In both 2006 and 2008, the Boks coped plenty of negative press yet they went on to win the World Cup and re-establish themselves as the world's number one ranked side in the seasons that followed.
"You guys (the medfa) got stuck into us and, yes, the performances were very inconsistent. In 2006, when we had consistently bad results, it felt like we were playing the best side in the world every week," added Smit.
"A year later we won the World Cup. And a year after that we were no good once more. Now everybody loves us again!
"From personal experience, the pressure the Wallabies are under from their own supporters is too much. Coach Robbie Deans is still relatively new and he is trying to bring a new generation of players through in time for the 2011 World Cup in New Zealand.
"They have a young side that is developing. We have been through the same thing before. We lost five in a row in 2006, never mind four. Things change very quickly in sport."
South Africa face Australia in Brisbane on Saturday knowing that a single point will be enough to secure the Tri Nations title in their penultimate fixture.
