To explore the grinding performance of diamond agglomerate abrasive in resin bonded grinding wheels, we prepared ceramic bond diamond agglomerate abrasives with diamond concentrations of 150%, 200%, and 250%, respectively on ZLB-60 rotary granulator. The results show that the single-particle static pressure strength of diamond agglomerate abrasives was 61 N, 65 N, 36 N. We selected the agglomerate abrasive with a diamond concentration of 200% and the single-grain diamond with the same original particle size to prepare resin bond diamond grinding wheels with a diamond concentration of 100%, and conduct a YG8 cemented carbide grinding test on the grinding wheels through a self-made grinding platform. Results indicate that when the volume fraction of polycrystalline abrasive is 30%, the resin bond diamond wheel has the best grinding performance. The grinding ratio is 145.11 and the grinding efficiency is 13.64 g/h, which are increased by 152% and 40%, respectively when compared with those of the single-grain diamond wheels.