Get to the core of the issue:

Conservatives are angry about the IRS close scrutiny of some political groups 501(c)(4) status.

IRS 501(c)(4) generally requires civic organizations described in that section to be "operated exclusively for the promotion of social welfare".

Treasury regulations interpretion is that the organization "is operated PRIMARILY for the purpose of bringing about civic betterments and social improvements". As a result, the IRS traditionally has permitted organizations described in IRC 501(c)(4) to engage in lobbying and political campaign activities IF those activities are NOT the organization's PRIMARY ACTIVITY.

My question is, why are we not ANGRY that many of these political groups are TAX EXEMPT?

The primary reason many of them exist is for political purposes.

We really need to get all the money out of political campaigns.

so,who will pay for them?
And if you say,"Public Money",who are we going to trust to apportion the Money impartially?