We report excess X‐ray absorption toward two sources with quite different redshifts: thez=2.07 quasar PKS 0528+134 and the relatively nearby (z=0.077) radio galaxy OQ 208 (1408+286). Both sources exhibit features common to Giga‐Hertz Peaked spectrum (GPS) radio sources. Excess X‐ray absorption has been found toward other high‐zsources (many also GPS sources) and interpreted as either intrinsic to the host galaxy/cluster or absorption by an intervening galaxy or cloud along the line of sight (Elviset al. 1993). VLBI and X‐ray observations reveal a distorted jet‐like structure and relativistically beamed emission region in PKS 0528+134. The detection of excess absorption over a wide redshift range favors the intrinsic absorption model. The absorbing gas may also shape the radio morphology and spectrum of a GPS sources. ©1994 American Institute of Physics