Topological insulators as a new type of quantum matter materials are characterized by a full insulating gap in the bulk and gapless edge/surface states protected by the time-reversal symmetry. We propose that the interference patterns caused by the elastic scattering of defects or impurities are dominated by the surface states at the extremal points on the constant energy contour. Within such a formalism, we summarize our recent theoretical investigations on the elastic scattering of topological surface states by various imperfections, including non-magnetic impurities, magnetic impurities, step edges, and various other defects, in comparison with the recent related experiments in typical topological materials such as BiSb alloys, Bi2Te3, and Bi2Se3 crystals.