The game finished 1-1 and went to extra time and then penalties were the Aussie's ran out 4-2 winners in front of 82,698 people.
Josip Skoko who was included in the Aussie team for the game, came on as a substitute for the final ten minutes. He didn't take a penalty!
The result is said to be the biggest sporting achievement for Australia since Cathy Freeman's win in the Olympics in 2000.
Liverpool's Harry Kewell told The Weekend Australian: "We're not going to Germany just to be one of the lightweights. We plan to make our mark and shock a few people.
"Look at what Greece did in Portugal. Who gave them a chance? Most people thought they were only there to make up the numbers. South Korea also made a big name for themselves and how about Croatia getting to the semi-finals (of France 98).
"Every big tournament produces one team that stands up from out of nowhere and upsets the big boys. Why shouldn't that team be us?"