A group of conservative Black pastors are working hard to kick Attorney General Eric Holder out of the White House after his recent remarks on…