(CNN) - Former Republican presidential nominee Mitt Romney said he has no ill will towards Gov. Chris Christie and weighed in on other flashbacks from the 2012 campaign in a wide-ranging interview with CNN Chief Political Analyst Gloria Borger.
The former Massachusetts governor also offered sharp criticism of the Obama administration over the recent Internal Revenue Service controversy and gave his thoughts on some potential 2016 presidential contenders.
Romney sat down with Borger this week in Park City, Utah, where he's holding a multi-day conference that features several prospective presidential candidates, as well as other national leaders with some of the party's major donors also in attendance.
Romney hopes this meeting, called "Experts and Enthusiasts," will allow the approximately 200 attendees to discuss the nation's problems and possible solutions in a different forum.
But it was just seven months ago on November 6 when Romney had a much more public life and was waiting to hear whether he'd become the next president of the United States.
The former candidate and his wife, Ann, said they went into the day certain that they would be celebrating victory later that night. As they saw the numbers trickle in, however, doubts began to set in.
"I think at 6:00, I was really worried," Ann Romney said. "By 8:00, I think we knew it was - it wasn't going well."
"We were together," Mitt Romney added. "And I said, boy, the exit polls are not good. And Ann said don't worry, we're going to win. And I said, well, we'll - we'll watch. And the numbers came in and you don't know immediately, because the numbers were close. And you don't know until the last counties are counted."
So sure he would win, Romney said he did not plan a losing speech. "I'd written a very good winning speech."
Read more: Romney regrets 47% comments
Talking about what went wrong, Romney said they didn't get the turnout from minority voters that they needed and he acknowledged his campaign was outmatched by his opponent's massive organization.
"I think he had as many as 10 times the number of ground workers, paid staff, that we had, because he could afford them and we couldn't," he said.
Asked what they did the next morning, Ann Romney said they spent time with their family but mostly returned to routine activities for the first time in a year and a half.
"Life goes on. It's just amazing. I mean you still - there's still laundry, you still have to get the groceries," she said.
While their Secret Service detail was supposed to stay with them for at least a full week after the election, the Romneys declined, saying they didn't want taxpayers picking up the tab any longer.
Within days, their circle of campaign staff, reporters and security agents had vanished.
"It was the two of us," Mitt Romney said, adding that their son Tagg and his family live only a mile away in Belmont, Massachusetts.
All is well between Romney and Christie
Less than a week before Election Day, a devastating storm–Superstorm Sandy–slammed into the northeast coast and caused massive destruction and took the lives of more than 100 people.
Both candidates took a break from the campaign, and Obama flew to New Jersey to survey the damage. Republican Gov. Chris Christie, a top surrogate for Romney, publicly embraced the president and stuck by his side as they toured the destroyed parts of the coast.
Some Republicans unleashed sharp criticism against Christie, hounding the Republican for appearing so close the president and bolstering Obama's image just days before voters were to head for the ballots.
Christie has since stood by his decision to be seen with Obama and invited the president against last month.
Asked if he blames Christie at all for the final results, Romney repeatedly said "no."
"I wish the hurricane hadn't have happened when it did because it gave the president a chance to be presidential and to be out showing sympathy for folks," Romney said, looking at the storm through a political lens. "That's one of the advantages of incumbency. But, you know, you don't look back and worry about each little thing and how could that have been different."
Pressed later about Christie's 2016 potential, Romney said the Republican has proved he's been a "very effective" governor in dealing with the hurricane and working with a Democratic legislature in a Democratic state.
"You have to look at Chris and say this is a guy who's been a very effective governor and has a great potential for leadership," Romney said.
Romney on 'three different Republicans' - and Clinton
But what about other potential White House candidates?
On Rep. Paul Ryan, his former running mate and House Budget Committee chair: "Oh, I love Paul. I mean I will always have a very special feeling for Paul, because I think he was one of the great vice presidential nominees in history. I think he would have been a terrific vice president. I don't have any idea whether he has presidential aspirations."
On Sen. Rand Paul, R-Kentucky: "Rand is also a very strong emerging voice in the Republican Party. Represents a different, if you will, vocal group within the party that's having a real impact.
"And with those three that happen to all be coming (Christie, Ryan and Paul), you're going to see three very different Republicans - one a governor, one a member of Congress who's a conservative, a long-term conservative; another who represents a more libertarian wing of our party. And each presenting their views about priorities. It's going to give us a chance to hear from all three and decide from - for ourselves what we think the right path will be."
On former Secretary of State Hillary Clinton: "Secretary Clinton's challenge will not just be Benghazi, but more the record of American foreign policy over the last four years, while she was secretary of state.
"We'll look at everything from North Korea to Iran to Pakistan, to Afghanistan, to Syria, to Egypt and you look across the world, and our prospects - the prospects for stability, for liberal democracy, for freedom, have retreated over the period of her administration in the Department of State. And I think that's something that - that it will be a challenge for her."
Would a 2012 IRS scandal have changed the election?
Asked about one of the biggest stories of the day - the IRS' admitted targeting of tea party and conservative groups that sought tax-exempt status - Romney said the incident was a "breach of trust" and argued the administration was purposely keeping the controversy under wraps during the campaign.
"I think they certainly hid the activities of targeting conservative groups. Otherwise, there would have been a hue and outcry about it," he said.
Romney did not go as far as saying the line of fault runs all the way up to the president's desk-as some other Republicans are attempting to prove-but said "time will tell" on who was involved.
Asked if he thinks it would have changed the outcome of the election had the public known about it, Romney said the results were so close–51% to 47%–that "a number of things could have changed the outcome."
"Again, you don't look back and say, oh, couldn't we have just changed this?" he said "The president won. I congratulate his campaign team on having won. That's the nature of politics is winning. They won. Nice work. And let's get on with it."
Romney says 'self-deportation' was 'overtaken'
Another issue in the Washington spotlight is immigration. Romney was famously known for saying in the GOP primary that he supported a policy of self-deportation, in which undocumented immigrants would voluntarily return to their countries and apply for legal re-entry.
Since the election loss, many Republicans have noted his comments as having a damaging effect on the party's image and some in the party have taken an aggressive approach to tackle immigration reform.
In the interview, Romney attempted to clarify what he meant by the term.
"It's interesting how the opposition campaign made a big deal of that. Self-deportation is as opposed to government deportation. The government deports people. Now, my view was that people should make their own choice. And so, people say, oh, he's for self-deportation, it sounds very, very, unkind."
Romney said his plan was "overtaken by events." While he favors some of the current proposals and disagrees with others, the Republican acknowledged "it's not my choice at this stage."
"But let's deal with the 11 million, and let's reform the legal system so the millions who are in line can understand how to get here legally and we can bring in those people that our economy needs and, frankly, that families we'd like to have reunited to come in legally," he said.
– CNN's Ashley Killough and Kevin Bohn contributed to this report.