World Cup winner Woodward had been sounded out about the performance director role with the RFU earlier this year, some eight seasons after he guided his country to the biggest prize in the global game. Speculation linking him to that role and the role of chief executive has continued to intensify following John Steele's sacking and this week's resignation of RFU chairman Martyn Thomas.
But Woodward is adamant he will stay with the BOA until after the London 2012 Games and possibly beyond.
"I am 100% staying and really looking forward to it and hopefully staying beyond the Olympics," said Woodward.
"I hope for the sake of rugby now that they move on, but I am totally focused on the London Olympics."
With the RFU receiving headlines for the wrong reasons away from the pitch at the moment, critics have suggested the England team and manager Martin Johnson could be unsettled as they prepare for the World Cup this autumn.
But Woodward believes the forthcoming global gathering in New Zealand could be a real blessing for the organisation who will be determined to focus on matters on rather than off the field of play.
"The World Cup can't come quick enough now, where we can concentrate on the actual rugby side of things," Woodward told the BBC.
"This is part of the history they won't look back too fondly on but I'm sure they'll get through it and we'll move on quickly.
"Thankfully there is a Rugby World Cup coming up so people can focus on matters on the pitch. There are a lot of good people at Twickenham and I'm sure they will get it sorted out."