The Baa-Baas will be targetting a hat-trick of southern hemisphere scalps having already racked up recent wins over New Zealand and South Africa.
"Our two most recent games have been great spectacles and the victories over the All Blacks and Springboks have captured everyone's imagination," said Barbarians' president Micky Steele-Bodger.
"Our fixture against Australia in November provides us with a unique opportunity to complete a historic hat-trick so once again we will be inviting world-class stars to make up our team."
The sides share a long tradition of fixtures and have met on ten previous occasions with the Wallabies currently leading 7-3.
The clash will provide an opportunity to see a number of Wallaby stars likely to face the Lions during the 2013 tour down-under.