In the usual, countably additive definition of probability, it is not possible to have a distribution giving equal probabilities to every one of the natural numbers. Yet such a distribution would be interesting and potentially useful. This article considers an approach to this problem based on finitely additive probability. We give a necessary and sufficient condition for when specifications of the probabilities of an arbitrary collection of subsets of a space Ω can be extended to define a finitely additive probability on all the subsets of Ω. This is applied to probability statements modeling the uniform distribution on the natural numbers, using relative frequencies and residue classes to make precise notions of uniformity. Tight bounds are given on the possible values of the probability of an arbitrary set under both interpretations. These bounds are applied to several sets of interest.