Craig is surrounded by reporters his first day back on the Hill.
WASHINGTON (CNN) - Sen. Larry Craig of Idaho, who made a surprise visit to Capitol Hill Tuesday, directly apologized at a party luncheon to his Senate Republican colleagues "for any embarrassment," a member present at the lunch told CNN.
According to the source, Craig did not address at the lunch whether he plans to stay in Washington beyond September 30 - the date on which he had previously said he would resign.
Asked after the lunch by CNN if he is considering staying in the Senate, Craig said, "We're working on that now."
Sen. Arlen Specter, R-Pennsylvania, who has previously come to Craig's defense, shook hands with the Idaho Republican in front of reporters and told Craig it's "nice to see you smiling."
Later, Specter indicated Senate Republicans may be willing to support Craig if he decides to stay in the Senate.
“There’s been a lot of favorable talk about Larry in the cloak room," Specter told CNN. "And I think the initial shock has worn off."
"He’s been a colleague for a long time – 17 years – you don’t toss over a friend of that duration and intensity easily," Specter added.
Sen. Orrin Hatch, R-Utah, also offered support of Craig, saying, "I don’t think there was any underlying crime."
Hatch also said he thinks that "a good lawyer could win that case.”
– CNN's Jessica Yellin and Ted Barrett