Derry, New Hampshire (CNN) - The latest allegation of sexual impropriety against Herman Cain has cost him the support of at least one state representative in New Hampshire.
Rep. William Panek called the Cain campaign Tuesday morning to say he was dropping his endorsement, telling CNN he will shift his support to former House Speaker Newt Gingrich instead.
"One or two allegations, it kind of piqued my interest, but you know, it's politics," Panek said. "But with a long-term, ongoing affair I'd kind of had enough."
On Monday an Atlanta woman claimed she had had a 13-year affair with Cain in an interview with WAGA TV.
The allegation followed news that four women had accused Cain of sexual harassment while he headed the National Restaurant Association.
On a conference call Tuesday morning, Cain said he was considering whether to continue his run for president. He has denied all the allegations but said the news was taking a toll on his family and fundraising numbers.
The New Hampshire loss for Cain was first reported by local television station WMUR, which originally said another state representative, Sam Cataldo, had also dropped his endorsement. Cataldo told CNN Tuesday night, however, that he was sticking with Cain while the candidate reassesses his campaign.