Pigeons were trained on multiple schedules in which a fixed number of pecks produced either a fixed or a variable period of access to food, the average variable‐duration reinforcement equalling the fixed. Pecking rates were generally higher during the variable‐duration component. Subsequent performance on concurrent schedules revealed an initial preference for variable‐duration reinforcement for all subjects; for most subjects, this preference was sustained. For one subject, the average variable duration was gradually reduced to half the fixed duration: continued preference for the variable component resulted in a loss of up to 30% of available reinforcement time. A return to multiple schedules with unequal pay‐off shifted the preference to the greater fixed duration, and this preference was maintained even when the variable duration was again raised to equal the fixed duration. For the remaining subjects, the initial variable‐duration preference on concurrent schedules was gradually replaced by a side preference. When the range of variable durations was varied, keeping the average variable duration equal to the fixed, the occasional longer reinforcers sustained a preference for variable‐reinforcer durations for three of the fo