[cnn-photo-caption image= http://i2.cdn.turner.com/cnn/2010/images/01/05/art.greer.rpof.jpg caption="Jim Greer (left), the outgoing chairman of the Republican Party of Florida, said his opponents want to 'burn the house down.'"](CNN) - Florida Republican Party chairman Jim Greer announced his resignation on a conference call with reporters Tuesday, accusing his conservative critics of being purists who are "shredding and tearing the fabric" of the GOP.
For months, Greer has been assailed by GOP activists accuse him of mismanaging party finances and favoring Gov. Charlie Crist in his Senate primary bid against Marco Rubio, the more conservative former House Speaker.
Greer said his opponents want to "burn the house down and destroy the Republican Party."
"I am not a purist," he said in describing his vision for the party. "I have never been a purist. I believe that our party stands for principles and values and that anyone who has an interest in our party should be able to participate."
Greer, who was appointed to his post by Charlie Crist in 2007, stressed that he has worked to create a more inclusive party in Florida and urged the GOP "to stop the fight between moderates and conservatives and put the focus on electing Republicans in 2010."
Greer avoided criticizing Rubio during his salvo.
"At the end of the day, the voters will decide what the Republican Party should look like," he said.