This paper presents the preliminary results of a broader program to estimate the probabilities of factoring more general polynomials over ℤ . We anticipate that subsequent research will develop along the lines suggested by the quadratic case investigated here, specifically by using the method of parameterizing the maximum absolute value of coefficients and correlating the conditional probabilities of factorization with the size of the parameter.

The probability that a given general quadratic α x 2 + β x + γ ∈ ℤ [ x ] can be factored depends heavily on the commensurability of the coefficients [1] [2] [3]. Loosely speaking, if the coefficients are all about the same size in absolute value, and that size is small, the existence of a factorization is relatively more likely than otherwise. Our intention is to quantify this phenomenon. Dealing with the infinite number of choices available for coefficients is a problem. We sidestep this obstacle by adapting the method used to determine the probability of factorization of quadratics over finite fields. Briefly, we establish a cutoff, or size parameter n, for the absolute value of any coefficients appearing in any of the quadratics we wish to study. This makes the number of quadratics under consideration finite as well as the number of formal factored expressions that could possibly yield such a quadratic. Then the classical probability is just the ratio of the number of admissible factored expressions to the total number of quadratics which conform to the cutoff. This probability P ( n ) is, of course, a conditional probability given that the coefficients do not exceed n in absolute value. So the infinite character of the problem is initially made finitary where calculations can be done and then can be recovered by allowing n to approach infinity.

We consider three cases, the first of which, factoring quadratics over finite fields, is well-known [4]. For factoring quadratics over ℤ , we split the discussion into two parts: 1) the monic case, and 2) the general case. For simplicity we consider quadratics in ℤ [ x ] that have non-negative roots.

Figure 1 shows factorization probabilities calculated by the computer search. Currently we have no formula that estimates the case a x 2 + b x + c ∈ ℤ [ x ] with α ≠ 0 other than curve fitting. The trend in the graph in Figure 1 is borne out by the following proposition.

If a , b , c ∈ ℤ are selected randomly without restriction, then the probability of factoring a x 2 + b x + c over ℤ is zero.

Proof. Suppose we are given a x 2 + b x + c with a , b , c ∈ ℤ selected at random. This quadratic factors over ℚ , hence ℤ by Gauss’ Lemma, if the discriminant Δ = b 2 − 4 a c is a perfect square. We ask what is the probability that Δ is a perfect square if a and b have been selected and c is provisionally allowed to range over [ − n , n ] for some n ∈ ℕ . Then there are 2 n + 1 possible values of Δ spread over an interval of length | 8 a n | . The largest possible number of perfect squares in such an interval would occur when none of the interval intersected the open left half line and where the arithmetic density of squares was the greatest. This would occur if the interval were exactly [ 0, | 8 a n | ] . The number of squares in this interval does not exceed | 8 a n | . The classical probability that

one of these squares coincides with a value of Δ is therefore no more than | 8 a n | 2 n + 1 < 2 | a | 1 n . As the provisional restriction that c ∈ [ − n , n ] is relaxed by allowing n → ∞ , we see 2 | a | 1 n → 0 . It follows that the probability that Δ is a perfect square, and therefore a x 2 + b x + c is factorable over ℤ , is zero in the limit, which corresponds to no restrictions at all on c. Since this is true for any triple ( a , b , c ) , the proposition is established.

We wish to have a more granular understanding of the way in which factorability depends on commensurability of coefficients. Our approach to this question is motivated by solving the factorization probability problem in the context of finite fields, which we review below.

Suppose we are given a random monic quadratic over the finite field G F ( p ) . What is the likelihood that it factors [5] ?

We would like to adapt the same argument for factoring over ℤ as we used for finite fields, namely counting up the number of possible distinct factorizations and dividing by the number of distinct quadratic expressions to get a probability of being able to factor. Since ℤ is infinite this plan is immediately hobbled [6]. Consider the polynomial x 2 + a x + 1 , where α is random. There are only two hopes for factorization: α = ± 2 . Yet there are infinitely many choices for α , so the probability of factorization is evidently zero. To salvage any insight from this state of affairs, we have to content ourselves with a conditional probability based on limiting how “random” a random quadratic can be. A reasonable choice is to insist that its coefficients be commensurable with its possible zeroes. Clearly x 2 + 37 x + 1 does not have this property, which is informal at the moment, but which will soon be made precise. On the other hand, both x 2 + x + 1 and x 2 + 2 x + 1 seem to have it. In one case there is a factorization, in the other not. This conditional probability will be based on a relative likelihood calculation where the commensurability condition is quantified by a parameter. As the parameter increases, the commensurability decreases, and the probability of factorization will tend to zero. The point of our approach is to model the detailed behavior of this process. To introduce the specifics in a simple context, we first consider monic quadratics with the restriction that they have non-negative roots.

Let us define a “window of feasibility” W ( n ) in the plane as the rectangle of grid points [ 0, n + 1 ] × [ 0, n ] ⊂ ℤ 2 . Suppose we are given a random p ( x ) ∈ ℤ [ x ] of the form x 2 − α x + β with α , β ≥ 0 and β ≤ n . If p ( x ) factors as ( x − r 1 ) ( x − r 2 ) both roots are nonnegative and α = r 1 + r 2 and β = r 1 r 2 . If β > 0 these conditions imply that α ≤ n + 1 , and in the event β = 0 we impose this condition arbitrarily to ensure that all p ( x ) satisfying these conditions can be mapped in the obvious way to ( α , β ) ∈ W ( n ) . At the moment we have every point in W ( n ) as the image of some p ( x ) with α , β ≥ 0 . Clearly this is a bijective mapping. We call W ( n ) a window of feasibility since any p ( x ) with 0 < β ≤ n and α > n + 1 is necessarily impossible to factor. The motivation for constructing the window is to exclude those cases which overwhelm ordinary probability calculations. A quadratic inside the window may or may not be factorable, but if not, the reason will not be due to incommensurability of coefficients. Figure 2 shows this situation.

Note that a grid point of the form ( α ,0 ) corresponds to the quadratic x 2 − α x = x ( x − α ) , so factorization is always possible. A grid point of the form ( 0, β ) , provided β > 0 corresponds to the quadratic x 2 + β , which never factors.

Now denote by F ( n ) the grid points in W ( n ) corresponding to factorable polynomials. A factorable quadratic mapped to ( α , β ) must have α = r 1 + r 2 and β = r 1 r 2 for some r 1 , r 2 . Let us then plot pairs of roots on the W ( n ) grid and define ϕ ( r 1 , r 2 ) = ( α , β ) as the mapping that associates a root pair to the quadratic which factors with those roots. We will see shortly that there are substantial limitations on which points in W ( n ) can be root pairs. In other words,

the domain of ϕ will be relatively small, so surjectivity will clearly be out of the question. We would like ϕ to be injective, and since ϕ ( r 1 , r 2 ) = ϕ ( r 2 , r 1 ) we impose the condition r 2 ≤ r 1 without loss of generality. Graphically, this amounts to eliminating all root pairs strictly above the line r 2 = r 1 . Now W ( n ) \ { ( r 1 , r 2 ) : r 2 ≤ r 1 } is still not F ( n ) since there is another important condition on the root pairs, namely r 1 r 2 ≤ n . The only admissible root pair grid points whenever r 2 > 0 are also below the hyperbola r 2 = n r 1 . This is also true trivially if r 2 = 0 so the hyperbola is an upper bound for all root pairs corresponding to factorable quadratics. Now we estimate the number of points in F ( n ) by calculating the area inside the region of the plane defined by the line r 2 = 0 , the line r 2 = r 1 , and the hyperbola r 2 = n r 1 . The area of this region is A = ∫ 0 n ( r 1 ) d r 1 + ∫ n n + 1 ( n r 1 ) d r 1 = n l n n + 3 n 2 . We estimate the number of grid points in F ( n ) by assuming one grid point per unit of area. This estimate is asymptotically exact. Now W ( n ) has ( n + 1 ) ( n + 2 ) total grid points. Finally, our conditional probability estimate is n l n n + 3 n 2 ( n + 1 ) ( n + 2 ) . We have proved:

Consider the lattice cube L ( n ) = [ 0, n ] 3 ⊂ ℤ 3 as the three-dimensional analog of the preceding window of feasibility. The general quadratic [7] p ( x ) = α x 2 − β x + γ ∈ ℤ [ x ] with α > 0 , β , γ ≥ 0 can be associated injectively with the point ( α , β , γ ) ∈ L ( n ) provided m a x { α , β , γ } ≤ n . Since α ≠ 0 , there are ( n − 1 ) n 2 grid points in L ( n ) which represent distinct quadratics of this type. We would like to estimate the number of these which are factorable so that we can calculate the conditional probability P ( n ) of factorability in the manner of the finite field and monic cases above. Suppose p ( x ) does factor in ℤ as ( a x − b ) ( c x − d ) , with a , c > 0 and b , d ≥ 0 . Note that the greatest common divisor of α , β and γ does not appear as a separate factor but is considered to be bundled into the term ( a x − b ) . Then α = a c , β = b c + a d , and γ = b d . Since the maximum α is n, it follows that admissible pairs ( a , c )

would satisfy c ≤ n a . As in the monic case, we embed ℤ 2 in ℝ 2 , calculate the appropriate area under the given hyperbola, and then assume one grid point (admissible pair) per unit of area with the understanding that this is asymptotically correct. The area in the first quadrant of the ac plane is ∫ 1 n n ( δ a ) a − n = n l n n − n = n ( l n n − 1 ) . Since the maximum γ is n, but either b or d (or both) could be zero, the appropriate area in the first quadrant of the bd plane would be ∫ 1 n n ( δ b ) b + n = n l n n + n = n ( l n n + 1 ) . Evidently there are [ n ( l n n − 1 ) ] ⋅ [ n ( l n n + 1 ) ] = n 2 ( ( l n n ) 2 − 1 ) = F ( n ) expressions of the form ( a x − b ) ( c x − d ) which could factor the quadratic α x 2 − β x + γ subject to the constraints imposed on those coefficients. Certainly not every point in L ( n ) corresponds to a factorable quadratic, but we can be assured that any points which are associated with a factorable quadratic have a factorization counted by F ( n ) . Since the factor pairs commute, we divide F ( n ) by two and it follows that the conditional probability of factorization is estimated by P ( n ) = F ( n ) 2 n 3 = n 2 ( ( l n n ) 2 − 1 ) 2 n 3 = ( l n n ) 2 − 1 2 n .

We have proved:

We have described two methods for estimating the conditional probability that a random quadratic in ℤ [ x ] with non-negative bounded coefficients can be factored as a function of the bounding parameter. The simpler case is based on mapping monic quadratics injectively to a two-dimensional lattice in ℤ 2 and enumerating the formal expressions that could possibly represent factorizations of them. The ratio of the number of admissible formal factorizations to the total number of points in the lattice defines the conditional probability of factorization for the given coefficient bound. The more complicated case involves mapping general quadratics to a three-dimensional lattice in ℤ 3 and reprising the calculation for the two-dimensional case. Both methods have their provenance in the problem of calculating the likelihood that a quadratic over a finite field may be factored. In the case of finite fields, only a finite number of polynomials are possible and only a finite number of factorizations can be written, making the calculation a simple ratio. This fails, of course, for ℤ , but the point of our method is to resurrect the utility of finiteness by imposing a size limitation on coefficients [8].

Table 1 presents a comparison of values from the monic formula for conditional probability given by Proposition 2 with a computer generated census of factorable monic quadratics. There is reasonably close agreement, even for small n. The computer algorithm works by simply checking to see if the quadratic formula yields a rational number. Recall if a polynomial in ℤ [ x ] factors over ℚ , then it factors over ℤ .

Table 2 recaps a similar comparison for the general quadratics in Proposition 3. For the sake of simplicity we have ignored double counting certain factored expressions arising from symmetries (for example if a = c ). This overstates the calculated probability of factorization, especially for small n, so we may regard P ( n ) in this case as an upper bound for the true probability. In any case, our formula establishes P ( ∞ ) = 0 .

Below in Figure 3 a graph of the calculated P ( n ) versus n is shown as the continuous curve. The separate data points correspond to Table 1. The expected feature that l i m n → ∞ P ( n ) = 0 is also evident.

To close on a philosophical note, although factorization of random quadratics over ℤ has been shown to be a progressively futile exercise, practicing pattern recognition with doable examples for small n is a worthwhile exercise that no doubt pays dividends elsewhere in mathematics.

The authors declare no conflicts of interest regarding the publication of this paper.

Beatty, T. and von Linden, G. (2020) On Conditional Probabilities of Factoring Quadratics. Advances in Pure Mathematics, 10, 114-124. https://doi.org/10.4236/apm.2020.103008