Finite element models were established to analyze the influence of soft filler on stress concentration for a rectangular plate with an elliptic hole in the center. The influence was quantified by means of stress concentration factor (SCF). Seven shape factors of the elliptic hole and three levels of elasticity modulus of the soft filler were considered. The reduction coefficient and sensitivity index of SCF are the two indicators in evaluating the influence of soft filler. It was found that the reduction coefficient of SCF increases significantly as the shape factor and the elasticity modulus of the filler increase, indicating that soft filler can reduce the concentrated stress effectively, especially when the shape factor is great. Analysis for the sensitivity index of SCF indicates that SCF is more sensitive to materials with small elasticity modulus than to materials with large one.