In the first round, Istanbul and Madrid tied with 26 votes each. Tokyo had 42 votes, six short of a winning a majority. Istanbul then beat Madrid 49-45 in a tiebreak to advance to the final, which Tokyo won easily.
In their final presentations, Madrid made its case as the least-expensive option and Istanbul spoke of the historic opportunity to bring the Olympics to a predominantly Muslim country for the first time.
Madrid, bidding for a third straight time, had seemed to have gained the most momentum in recent weeks despite Spain's economic crisis and 27 percent unemployment rate. The Madrid team claimed the games would pose no financial risk because most of the venues were already built.
The Turkish delegation pressed its case of taking the games to a city linking the continents of Europe and Asia.
With the civil war in Syria posing a major issue, Turkish Prime Minister Recep Tayyip Erdogan said taking the games to Turkey "will send a very meaningful and strong message, not only to the world, but to our broader region."
"At this critical moment, we would like to send a strong message of peace to the whole world from Istanbul," Erdogan said.
IOC member Prince Albert of Monaco asked what hosting the games in Turkey would mean to the wider region.
"We believe that hosting the Olympics in Istanbul will give this signal, this spirit of friendship and sharing and peace," Erdogan said. "And our country is a place where there is a lot of unity and diversity, and that is the idea that we can share on a broader scale with the Olympics Games being hosted in Turkey."
Madrid said 80 percent of its venues were ready and only $1.9 billion was needed for construction, a fraction of the other two bids.
"Madrid has perhaps the most reasonable and responsible financial foundation in recent Olympic history," Spanish Prime Minster Mariano Rajoy said. "We can host the Olympics in 2020 with no risk to the Olympic movement."
AP Sports Writers Stephen Wade and Tales Azzoni contributed to this report. Follow Stephen Wilson on Twitter: http://twitter.com/stevewilsonap
- The LDS Church's call for balance between gay...
- Video: Islamic State group beheads Japanese...
- Cumberbatch, Fry, others urge UK to pardon...
- Former GOP nominee Romney will not run for...
- List: 10 Super Bowl ads you'll be talking about
- Obama budget sets up battle with...
- Top Catholics and evangelicals: Gay marriage...
- Prospective juror has sympathy for Tsarnaev,...
- Former GOP nominee Romney will not run... 79
- Top Catholics and evangelicals: Gay... 60
- Mitt Romney courts middle class, jabs... 40
- The LDS Church's call for balance... 35
- Attorney General nominee picks up... 14
- House GOP moves toward possible lawsuit... 11
- Prosecutors promise thorough probe of... 11
- Keystone XL pipeline wins Senate vote... 10