An investigation of techniques that aim to improve the quality of labels provided by the crowd.