A general method is proposed to treat rough boundary scattering in ray‐tracing propagation models. The angular intensity of the field reradiated from the rough boundary is interpreted as a probability density function of the angles of reflection. The influence of rough surface scattering on sound attenuation in shallow water is demonstrated for selected sound speed profiles by model calculations. The theoretical results are compared with experimental data.