The dispersion curves of Rayleigh wave and Love wave were extracted from the seismic noise of 25 broad-band stations recorded by the Fujian Seismic Network, and inverted for the lithosphere wave structure. Furthermore, the velocity model was inspected by the blast observation outcome. The results indicate that the resolution of the lithosphere wave structure obtained by this method is good in the shallow part, but in the depth part the inverted result of the wave structure has low precision. It is mainly caused by the small inter-station distance chosen in the paper. So the wave dispersion curves have high precision in short-period part, but the warp of the wave dispersion curve in long-period part is big. Considering both the results of the noisy invert and the traditional invert, we finally present a new velocity model in which the theory calculated runtime can well match the blast observation runtime.