He blamed "wealthy outside groups" for his loss.