The stability and dispersion of graphene lamellae in cement are the key points to play the toughening role of graphene. In this paper, the graphene lamellae were transformed into aerogel to achieve uniform dispersion of graphene sheets on three dimensional scales. Subsequently, the graphene aerogels were introduced into the cement system to investigate the effect of graphene aerogels on the mechanical properties of cement composites. Fourier transform infrared spectroscopy, X-ray photoelectron spectroscopy, laser micro-Raman spectroscopy, scanning electron microscopy, universal testing machine and dynamic mechanical properties were used to characterize the surface chemical state, micro-morphology and mechanical properties of the materials. The results show that the graphene aerogels with relatively stable properties can be prepared by Hummers oxidation method combined with hydrothermal reaction process, and the characteristics of carbon atoms in aerogels are similar to those of graphene lamellar carbon atoms. Graphene aerogels have obvious toughening effect on cement-based materials, which shows great potential for application.