Barack Obama made history Tuesday reciting the oath of office to become the first black president of the United States.

He took the oath -- beginning with "I, Barack Hussein Obama, do solemnly swear" -- to become the 44th commander in chief. The oath was administered by U.S. Supreme Court Chief Justice John G. Roberts Jr. at the Capitol under sunny skies with temperatures in the 20s.

"Congratulations, Mr. President," Roberts said.

During the swearing-in, Obama placed his hand on a Bible used by Lincoln during his inauguration. Obama has drawn upon Lincoln's presidency for guidance.

Joe Biden received the vice presidential oath of office from Associate Justice John Paul Stevens.

For the last time, George W. Bush walked to the strains of "Hail to the Chief" played by the U.S. Marine Corps Band as he and Dick Cheney made their way to their seats.

The band struck up "Hail to the Chief" after Obama was sworn in.

Thousands of observers, reportedly stretching for two miles, overflowed the National Mall to watch the historic event, cheering and chanting Obama's name while waving American flags.

Sen. Diane Feinstein, D-Calif., chairwoman of the Joint Congressional Committee on Inaugural Ceremonies, opened the formal swearing-in ceremony.

"The world is watching today," Feinstein said. "We gather to etch another line in the solid stone of history."

Future generations will remember Tuesday as the "turning point for real and necessary change for our nation," she said.

The Rev. Rick Warren, pastor of the Saddleback Church in Orange County, Calif., delivered the invocation. His selection was decried by some groups because of his conservative views, particularly concerning gay rights.

"We celebrate a hinge-point of history with the inauguration of our first African-American president of the United States," Warren said. "We are so grateful to live in this land; a land of unequal possibilities."

Obama became the 44th president of the United States while listening to a musical interlude, CNN reported, because the Constitution states that his term begins at noon even without the oath.