WHITE HOUSE (CNN) -- President Barack Obama declined Wednesday to join congressional voices calling for an investigation into why the FBI did not notify the White House and other political leaders sooner about the investigation into the affair that led to the resignation of the director of the CIA.
"I am withholding judgment with respect to how the entire process surrounding Gen. Petraeus came up," Obama told reporters at the White House. "We don't have all the information yet, but I want to say I have a lot of confidence generally in the FBI. So I'm going to wait and see."
Obama said he agreed with David Petraeus' decision to resign after acknowledging an affair, but praised his service to the country.
"I want to emphasize that, from my perspective, at least, he has provided this country an extraordinary service," Obama said.
Obama: Fiscal cliff a 'solvable' problem
He also said he had seen no evidence of any potentially damaging breach in national security stemming from the affair.
"I have no evidence at this point from what I've seen that classified information was disclosed that in any way would have had a negative impact on our national security," Obama said.
In Congress, lawmakers in both parties have complained about not having been notified sooner of the investigation that led to Petraeus' resignation or about potential security breaches.
Sen. Lindsey Graham, R-South Carolina, said he was increasingly concerned about the potential fallout from the Petraeus affair and any national security implications, including possible links to the September 11th attack on the U.S. Consulate in Benghazi, Libya, that killed four Americans.
Graham has called for a special select committee to investigate the attack. "The goal of this investigation is to have professional staff that hears everyone testify, the same set of senators who hears everyone testify, so we can segregate out the weird from the national security," Graham said. "And there is beginning to be a national security component to the human failing that I want to know about."
House Intelligence Committee Chairman Mike Rogers, R-Michigan, and ranking member Dutch Ruppersberger, D-Maryland, were expected to ask about the resignation and whether Congress should have been notified sooner during private briefings with CIA and FBI officials.
FBI Director Robert Mueller joined Deputy Director Sean Joyce and acting CIA Director Mike Morell in briefing the lawmakers. Senate Intelligence Committee Chairwoman Dianne Feinstein, D-California, said Tuesday that she had "many questions about the nature of the FBI investigation, how it was instituted."
"And we'll be asking those questions," she said.
But the committee's ranking Republican member, Sen. Saxby Chambliss of Georgia, said Wednesday the group would not look into questions about the FBI investigation and how congressional leaders learned about it until after the bureau concludes its work.
Secretary of Defense Leon Panetta on Wednesday defended his request to withhold the nomination of Gen. John Allen to become NATO commander pending the investigation into his contacts with Jill Kelley, whose complaints about anonymous, harassing e-mails led to the discovery of Petraeus' affair with Paula Broadwell, his biographer.
Broadwell's government security clearance has been suspended pending the outcome of ongoing investigations, two U.S. officials with direct knowledge of the move told CNN Wednesday.
Defense officials announced Tuesday that the FBI had referred information to them indicating Allen may have exchanged potentially inappropriate e-mails with Kelley, who was a volunteer at MacDill Air Force Base.
Allen, who was once stationed at the base, has denied wrongdoing, a senior defense official said. Her access to MacDill without an escort has been suspended, a Defense Department official said Wednesday.
Kelley had been given special access to the base because of her position as a booster and promoter of programs to help U.S. troops, the official said. A U.S. official familiar with the e-mails Allen sent to Kelley described them as warranting the investigation.
"If they got out, John Allen would be very embarrassed by them," said the official, who added that there was no evidence of physical contact between the two. The official said that the e-mails under investigation -- which have been called "potentially inappropriate" -- are from Allen.
A second U.S. official, who has had the e-mails described to him, characterized their content as "sexy," but could not say whether they "crossed the line."
They "are not the type of e-mails you would want your wife to read," the second official said.
But a senior official close to Allen told CNN on Tuesday that the e-mails contained nothing pointing to sex or anything of a romantic nature. Allen may have said, informally, "thanks sweetheart" in an e-mail, the official close to Allen said.
"Anyone who knows him knows his style; he has a habit of replying to every single e-mail (he is sent). Kelley would e-mail his business and personal accounts," the official said.
It will be up to the Defense Department's inspector general to decide if the e-mails' content represents conduct unbecoming an officer, said a third source, a senior U.S. official.
Allen has yet to be questioned by Defense Department inspector general staff, but that could be completed in days or weeks, a U.S. official with knowledge of the investigation said.
The anonymous e-mail to Allen that allegedly came from Broadwell was sent after May, perhaps in June, the official said. The e-mail, which had also been sent to a number of other officers, bore the handle "kelleypatrol -- or something similar," the official said.
He described the e-mail as "a warning that Kelley was a seductress or something along those lines" and said it was vaguely threatening, but above all weird.
"Allen did not know it was (from) Broadwell," the official said.
The official also said it was unclear when Kelley went to the FBI or whether Allen's warning to her was the trigger, but that Allen saw nothing in the e-mail's wording to warrant referral by him to the FBI.
Kelley's version differs from one offered by the senior official close to Allen, who said it was Allen who received an anonymous e-mail about Kelley, and tipped her off that someone was threatening her.
One of the sources familiar with Kelley said she first mentioned the alleged harassment in a casual conversation with an FBI agent she knew socially. She did not seek him out specifically for action on the matter, but he was happy to help, the source said. The source added that Kelley did not know at first that the e-mails led to Petraeus.
A source familiar with Kelley's version of events said the anonymous e-mails traced to Broadwell began in June. It wasn't until two months later that the FBI told Kelley who had sent the e-mails, said the source, adding that Kelley does not know Broadwell.