The Wasps flanker was omitted from England's starting line-up that crashed 34-3 in Sydney on Sunday.
His 50th cap was won off the bench as a replacement for Sale Sharks forward Magnus Lund as England suffered a fourth successive defeat following their miserable Six Nations Championship campaign last term.
Worsley is a strong bet to make the starting line-up at Telstra Dome next weekend, with centre Jamie Noon, hooker George Chuter and locks Chris Jones and Ben Kay pressing for inclusion when head coach Andy Robinson names his team on Wednesday.
More than a third of Worsley's caps have been gained as a replacement, and he battled to contain his frustration before England departed their Manly beach resort base on Monday for a Melbourne city centre location.
"I do get angry, but I never hold any grudges with the coaches - they go with how they feel. You can't be bad about it, you have got to carry on," he said.
"You can't be negative in a team environment. I never expect to be picked, and when you are left out, then that is the way it goes.
"Being dropped was the first disappointment, but above all, it is the defeat which tops that.
"Like any sportsman, you need a kick up the backside, and it hurts not being picked. I never hold any grudges when I am dropped, and I was the same when Clive Woodward was the head coach.
"You can't be negative, and I've been helping Magnus (Lund) and the others. I keep the anger for future games, and it shows to myself that I still want it."
Worsley though, could still afford a wry smile, adding: "I had a glass of champagne with Mike Catt (on Sunday) night, and we toasted being members of the 'most-dropped club'."
England had their chances to make life tough for an Australian side that struggled to find its feet under their new coaching team of John Connolly, Mchael Foley and Scott Johnson.
But a chapter of missed first-half chances ultimately cost them dear as Australia cut loose through three tries in 22 minutes from full-back Chris Latham, wing Mark Gerrard and prop Rodney Blake.
"We tested Australia in the first half, but we didn't show any composure when we created three or four chances," said England attack coach Brian Ashton.
"Even though Iain Balshaw went close (he was denied a try by Wallabies skipper George Gregan's superb tackle), we should be taking those opportunities.
"We can take a lot of lessons from the game, including the fact that we need more balance and can't just run the ball from side to side.
"We can have a team which potentially can run the ball from anywhere on the park.
"The coaches can't see there being a lot of pitch-training this week, and we know that we must improve our performance against Australia on Saturday, because they will be aiming to do the same thing as well."