Generating function

In mathematics, a generating function is a way of encoding an infinite sequence of numbers (an) by treating them as the coefficients of a power series. This formal power series is the generating function. Unlike an ordinary series, this formal series is allowed to diverge, meaning that the generating function is not always a true function and the "variable" is actually an indeterminate. Generating functions were first introduced by Abraham de Moivre in 1730, in order to solve the general linear recurrence problem.[1] One can generalize to formal series in more than one indeterminate, to encode information about arrays of numbers indexed by several natural numbers.

There are various types of generating functions, including ordinary generating functions, exponential generating functions, Lambert series, Bell series, and Dirichlet series; definitions and examples are given below. Every sequence in principle has a generating function of each type (except that Lambert and Dirichlet series require indices to start at 1 rather than 0), but the ease with which they can be handled may differ considerably. The particular generating function, if any, that is most useful in a given context will depend upon the nature of the sequence and the details of the problem being addressed.

Generating functions are often expressed in closed form (rather than as a series), by some expression involving operations defined for formal series. These expressions in terms of the indeterminate x may involve arithmetic operations, differentiation with respect to x and composition with (i.e., substitution into) other generating functions; since these operations are also defined for functions, the result looks like a function of x. Indeed, the closed form expression can often be interpreted as a function that can be evaluated at (sufficiently small) concrete values of x, and which has the formal series as its series expansion; this explains the designation "generating functions". However such interpretation is not required to be possible, because formal series are not required to give a convergent series when a nonzero numeric value is substituted for x. Also, not all expressions that are meaningful as functions of x are meaningful as expressions designating formal series; for example, negative and fractional powers of x are examples of functions that do not have a corresponding formal power series.

Generating functions are not functions in the formal sense of a mapping from a domain to a codomain. Generating functions are sometimes called generating series,[2] in that a series of terms can be said to be the generator of its sequence of term coefficients.

Definitions

A generating function is a device somewhat similar to a bag. Instead of carrying many little objects detachedly, which could be embarrassing, we put them all in a bag, and then we have only one object to carry, the bag.
George Polya, Mathematics and plausible reasoning (1954)
A generating function is a clothesline on which we hang up a sequence of numbers for display.
Herbert Wilf, Generatingfunctionology (1994)

Ordinary generating function (OGF)

The ordinary generating function of a sequence an is

When the term generating function is used without qualification, it is usually taken to mean an ordinary generating function.

If an is the probability mass function of a discrete random variable, then its ordinary generating function is called a probability-generating function.

The ordinary generating function can be generalized to arrays with multiple indices. For example, the ordinary generating function of a two-dimensional array am, n (where n and m are natural numbers) is

Exponential generating function (EGF)

The exponential generating function of a sequence an is

Exponential generating functions are generally more convenient than ordinary generating functions for combinatorial enumeration problems that involve labelled objects.[3]

Poisson generating function

The Poisson generating function of a sequence an is

Lambert series

The Lambert series of a sequence an is

The Lambert series coefficients in the power series expansions for integers are related by the divisor sum . The main article provides several more classical, or at least well-known examples related to special arithmetic functions in number theory. Note that in a Lambert series the index n starts at 1, not at 0, as the first term would otherwise be undefined.

Bell series

The Bell series of a sequence an is an expression in terms of both an indeterminate x and a prime p and is given by[4]

Dirichlet series generating functions (DGFs)

Formal Dirichlet series are often classified as generating functions, although they are not strictly formal power series. The Dirichlet series generating function of a sequence an is[5]

The Dirichlet series generating function is especially useful when an is a multiplicative function, in which case it has an Euler product expression[6] in terms of the function's Bell series

If an is a Dirichlet character then its Dirichlet series generating function is called a Dirichlet L-series. We also have a relation between the pair of coefficients in the Lambert series expansions above and their DGFs. Namely, we can prove that if and only if where is the Riemann zeta function.[7]

Polynomial sequence generating functions

The idea of generating functions can be extended to sequences of other objects. Thus, for example, polynomial sequences of binomial type are generated by

where pn(x) is a sequence of polynomials and f(t) is a function of a certain form. Sheffer sequences are generated in a similar way. See the main article generalized Appell polynomials for more information.

Ordinary generating functions

Examples of generating functions for simple sequences

Polynomials are a special case of ordinary generating functions, corresponding to finite sequences, or equivalently sequences that vanish after a certain point. These are important in that many finite sequences can usefully be interpreted as generating functions, such as the Poincaré polynomial and others.

A key generating function is that of the constant sequence 1, 1, 1, 1, 1, 1, 1, 1, 1, ..., whose ordinary generating function is the geometric series

The left-hand side is the Maclaurin series expansion of the right-hand side. Alternatively, the equality can be justified by multiplying the power series on the left by 1 − x, and checking that the result is the constant power series 1 (in other words, that all coefficients except the one of x0 are equal to 0). Moreover, there can be no other power series with this property. The left-hand side therefore designates the multiplicative inverse of 1 − x in the ring of power series.

Expressions for the ordinary generating function of other sequences are easily derived from this one. For instance, the substitution x → ax gives the generating function for the geometric sequence 1, a, a2, a3, ... for any constant a:

(The equality also follows directly from the fact that the left-hand side is the Maclaurin series expansion of the right-hand side.) In particular,

One can also introduce regular "gaps" in the sequence by replacing x by some power of x, so for instance for the sequence 1, 0, 1, 0, 1, 0, 1, 0, .... one gets the generating function

By squaring the initial generating function, or by finding the derivative of both sides with respect to x and making a change of running variable n → n + 1, one sees that the coefficients form the sequence 1, 2, 3, 4, 5, ..., so one has

and the third power has as coefficients the triangular numbers 1, 3, 6, 10, 15, 21, ... whose term n is the binomial coefficient , so that

More generally, for any non-negative integer k and non-zero real value a, it is true that

Note that, since

one can find the ordinary generating function for the sequence 0, 1, 4, 9, 16, ... of square numbers by linear combination of binomial-coefficient generating sequences:

We may also expand alternately to generate this same sequence of squares as a sum of derivatives of the geometric series in the following form:

By induction, we can similarly show for positive integers that [8][9]

where denote the Stirling numbers of the second kind and where the generating function , so that we can form the analogous generating functions over the integral -th powers generalizing the result in the square case above. In particular, since we can write , we can apply a well-known finite sum identity involving the Stirling numbers to obtain that[10]

Rational functions

The ordinary generating function of a sequence can be expressed as a rational function (the ratio of two finite-degree polynomials) if and only if the sequence is a linear recursive sequence with constant coefficients; this generalizes the examples above. Conversely, every sequence generated by a fraction of polynomials satisfies a linear recurrence with constant coefficients; these coefficients are identical to the coefficients of the fraction denominator polynomial (so they can be directly read off). This observation shows it is easy to solve for generating functions of sequences defined by a linear finite difference equation with constant coefficients, and then hence, for explicit closed-form formulas for the coefficients of these generating functions. The prototypical example here is to derive Binet's formula for the Fibonacci numbers via generating function techniques.

We also notice that the class of rational generating functions precisely corresponds to the generating functions that enumerate quasi-polynomial sequences of the form [11]

where the reciprocal roots, , are fixed scalars and where is a polynomial in for all .

In general, Hadamard products of rational functions produce rational generating functions. Similarly, if is a bivariate rational generating function, then its corresponding diagonal generating function, , is algebraic. For example, if we let [12]

then this generating function's diagonal coefficient generating function is given by the well-known OGF formula

This result is computed in many ways, including Cauchy's integral formula or contour integration, taking complex residues, or by direct manipulations of formal power series in two variables.

Operations on generating functions

Multiplication yields convolution

Multiplication of ordinary generating functions yields a discrete convolution (the Cauchy product) of the sequences. For example, the sequence of cumulative sums (compare to the slightly more general Euler–Maclaurin formula)

of a sequence with ordinary generating function G(anx) has the generating function

because 1/(1 − x) is the ordinary generating function for the sequence (1, 1, ...). See also the section on convolutions in the applications section of this article below for further examples of problem solving with convolutions of generating functions and interpretations.

Shifting sequence indices

For integers , we have the following two analogous identities for the modified generating functions enumerating the shifted sequence variants of and , respectively:

Differentiation and integration of generating functions

We have the following respective power series expansions for the first derivative of a generating function and its integral:

The differentiation–multiplication operation of the second identity can be repeated times to multiply the sequence by , but that requires alternating between differentiation and multiplication. If instead doing differentiations in sequence, the effect is to multiply by the th falling factorial:

Using the Stirling numbers of the second kind, that can be turned into another formula for multiplying by as follows (see the main article on generating function transformations):

A negative-order reversal of this sequence powers formula corresponding to the operation of repeated integration is defined by the zeta series transformation and its generalizations defined as a derivative-based transformation of generating functions, or alternately termwise by an performing an integral transformation on the sequence generating function. Related operations of performing fractional integration on a sequence generating function are discussed here.

Enumerating arithmetic progressions of sequences

In this section we give formulas for generating functions enumerating the sequence given an ordinary generating function where , , and (see the main article on transformations). For , this is simply the familiar decomposition of a function into even and odd parts (i.e., even and odd powers):

More generally, suppose that and that denotes the th primitive root of unity. Then, as an application of the discrete Fourier transform, we have the formula[13]

For integers , another useful formula providing somewhat reversed floored arithmetic progressions — effectively repeating each coefficient times — are generated by the identity[14]

P-recursive sequences and holonomic generating functions

Definitions

A formal power series (or function) is said to be holonomic if it satisfies a linear differential equation of the form [15]

where the coefficients are in the field of rational functions, . Equivalently, is holonomic if the vector space over spanned by the set of all of its derivatives is finite dimensional.

Since we can clear denominators if need be in the previous equation, we may assume that the functions, are polynomials in . Thus we can see an equivalent condition that a generating function is holonomic if its coefficients satisfy a P-recurrence of the form

for all large enough and where the are fixed finite-degree polynomials in . In other words, the properties that a sequence be P-recursive and have a holonomic generating function are equivalent. Holonomic functions are closed under the Hadamard product operation on generating functions.

Examples

The functions , , , , , the dilogarithm function , the generalized hypergeometric functions and the functions defined by the power series and the non-convergent are all holonomic. Examples of P-recursive sequences with holonomic generating functions include and , where sequences such as and are not P-recursive due to the nature of singularities in their corresponding generating functions. Similarly, functions with infinitely-many singularities such as , , and are not holonomic functions.

Software for working with P-recursive sequences and holonomic generating functions

Tools for processing and working with P-recursive sequences in Mathematica include the software packages provided for non-commercial use on the RISC Combinatorics Group algorithmic combinatorics software site. Despite being mostly closed-source, particularly powerful tools in this software suite are provided by the Guess package for guessing P-recurrences for arbitrary input sequences (useful for experimental mathematics and exploration) and the Sigma package which is able to find P-recurrences for many sums and solve for closed-form solutions to P-recurrences involving generalized harmonic numbers.[16] Other packages listed on this particular RISC site are targeted at working with holonomic generating functions specifically. (Depending on how in depth this article gets on the topic, there are many, many other examples of useful software tools that can be listed here or on this page in another section.)

Relation to discrete-time Fourier transform

When the series converges absolutely,

is the discrete-time Fourier transform of the sequence a0a1, ....

Asymptotic growth of a sequence

In calculus, often the growth rate of the coefficients of a power series can be used to deduce a radius of convergence for the power series. The reverse can also hold; often the radius of convergence for a generating function can be used to deduce the asymptotic growth of the underlying sequence.

For instance, if an ordinary generating function G(anx) that has a finite radius of convergence of r can be written as

where each of A(x) and B(x) is a function that is analytic to a radius of convergence greater than r (or is entire), and where B(r) ≠ 0 then

using the Gamma function, a binomial coefficient, or a multiset coefficient.

Often this approach can be iterated to generate several terms in an asymptotic series for an. In particular,

The asymptotic growth of the coefficients of this generating function can then be sought via the finding of A, B, α, β, and r to describe the generating function, as above.

Similar asymptotic analysis is possible for exponential generating functions. With an exponential generating function, it is an/n! that grows according to these asymptotic formulae.

Asymptotic growth of the sequence of squares

As derived above, the ordinary generating function for the sequence of squares is

With r = 1, α = 0, β = 3, A(x) = 0, and B(x) = x(x+1), we can verify that the squares grow as expected, like the squares:

Asymptotic growth of the Catalan numbers

The ordinary generating function for the Catalan numbers is

With r = 1/4, α = 1, β = −1/2, A(x) = 1/2, and B(x) = −1/2, we can conclude that, for the Catalan numbers,

Bivariate and multivariate generating functions

One can define generating functions in several variables for arrays with several indices. These are called multivariate generating functions or, sometimes, super generating functions. For two variables, these are often called bivariate generating functions.

For instance, since is the ordinary generating function for binomial coefficients for a fixed n, one may ask for a bivariate generating function that generates the binomial coefficients for all k and n. To do this, consider as itself a series, in n, and find the generating function in y that has these as coefficients. Since the generating function for is

the generating function for the binomial coefficients is:

Representation by continued fractions (Jacobi-type J-fractions)

Definitions

Expansions of (formal) Jacobi-type and Stieltjes-type continued fractions (J-fractions and S-fractions, respectively) whose rational convergents represent -order accurate power series are another way to express the typically divergent ordinary generating functions for many special one and two-variate sequences. The particular form of the Jacobi-type continued fractions (J-fractions) are expanded as in the following equation and have the next corresponding power series expansions with respect to for some specific, application-dependent component sequences, and , where denotes the formal variable in the second power series expansion given below:[17]

The coefficients of , denoted in shorthand by , in the previous equations correspond to matrix solutions of the equations

where , for , if , and where for all integers , we have an addition formula relation given by

Properties of the hth convergent functions

For (though in practice when ), we can define the rational convergents to the infinite J-fraction, , expanded by

,

component-wise through the sequences, and , defined recursively by

Moreover, the rationality of the convergent function, for all implies additional finite difference equations and congruence properties satisfied by the sequence of , and for if then we have the congruence

for non-symbolic, determinate choices of the parameter sequences, and , when , i.e., when these sequences do not implicitly depend on an auxiliary parameter such as , , or as in the examples contained in the table below.

Examples

The next table provides examples of closed-form formulas for the component sequences found computationally (and subsequently proved correct in the cited references [18]) in several special cases of the prescribed sequences, , generated by the general expansions of the J-fractions defined in the first subsection. Here we define and the parameters , and to be indeterminates with respect to these expansions, where the prescribed sequences enumerated by the expansions of these J-fractions are defined in terms of the q-Pochhammer symbol, Pochhammer symbol, and the binomial coefficients.

 
 

Note that the radii of convergence of these series corresponding to the definition of the Jacobi-type J-fractions given above are in general different from that of the corresponding power series expansions defining the ordinary generating functions of these sequences.

Examples

Generating functions for the sequence of square numbers an = n2 are:

Ordinary generating function

Exponential generating function

Lambert series

As an example of a Lambert series identity not given in the main article, we can show that for we have that [19]

where we have the special case identity for the generating function of the divisor function, , given by

Bell series

Dirichlet series generating function

using the Riemann zeta function.

The sequence ak generated by a Dirichlet series generating function (DGF) corresponding to:

where is the Riemann zeta function, has the ordinary generating function:

Multivariate generating functions

Multivariate generating functions arise in practice when calculating the number of contingency tables of non-negative integers with specified row and column totals. Suppose the table has r rows and c columns; the row sums are and the column sums are . Then, according to I. J. Good,[20] the number of such tables is the coefficient of

in

In the bivariate case, non-polynomial double sum examples of so-termed "double" or "super" generating functions of the form include the following two-variable generating functions for the binomial coefficients, the Stirling numbers, and the Eulerian numbers:[21]

Applications

Various techniques: Evaluating sums and tackling other problems with generating functions

Example 1: A formula for sums of harmonic numbers

Generating functions give us several methods to manipulate sums and to establish identities between sums.

The simplest case occurs when . We then know that for the corresponding ordinary generating functions.

For example, we can manipulate , where are the harmonic numbers. Let be the ordinary generating function of the harmonic numbers. Then

and thus

Using , convolution with the numerator yields

which can also be written as

Example 2: Modified binomial coefficient sums and the binomial transform

As another example of using generating functions to relate sequences and manipulate sums, for an arbitrary sequence we define the two sequences of sums

for all , and seek to express the second sums in terms of the first. We suggest an approach by generating functions.

First, we use the binomial transform to write the generating function for the first sum as

Since the generating function for the sequence is given by , we may write the generating function for the second sum defined above in the form

In particular, we may write this modified sum generating function in the form of

for , , , and where .

Finally, it follows that we may express the second sums through the first sums in the following form:

Example 3: Generating functions for mutually recursive sequences

In this example, we re-formulate a generating function example given in Section 7.3 of Concrete Mathematics (see also Section 7.1 of the same reference for pretty pictures of generating function series). In particular, suppose that we seek the total number of ways (denoted ) to tile a rectangle with unmarked domino pieces. Let the auxiliary sequence, , be defined as the number of ways to cover a rectangle-minus-corner section of the full rectangle. We seek to use these definitions to give a closed form formula for without breaking down this definition further to handle the cases of vertical versus horizontal dominoes. Notice that the ordinary generating functions for our two sequences correspond to the series

If we consider the possible configurations that can be given starting from the left edge of the rectangle, we are able to express the following mutually dependent, or mutually recursive, recurrence relations for our two sequences when defined as above where , , , and :

Since we have that for all integers , the index-shifted generating functions satisfy (incidentally, we also have a corresponding formula when given by ), we can use the initial conditions specified above and the previous two recurrence relations to see that we have the next two equations relating the generating functions for these sequences given by

which then implies by solving the system of equations (and this is the particular trick to our method here) that

Thus by performing algebraic simplifications to the sequence resulting from the second partial fractions expansions of the generating function in the previous equation, we find that and that

for all integers . We also note that the same shifted generating function technique applied to the second-order recurrence for the Fibonacci numbers is the prototypical example of using generating functions to solve recurrence relations in one variable already covered, or at least hinted at, in the subsection on rational functions given above.

Convolution (Cauchy products)

A discrete convolution of the terms in two formal power series turns a product of generating functions into a generating function enumerating a convolved sum of the original sequence terms (see Cauchy product).

1.Consider A(z) and B(z) are ordinary generating functions.
2.Consider A(z) and B(z) are exponential generating functions.
3.Consider the triply convolved sequence resulting from the product of three ordinary generating functions
4.Consider the -fold convolution of a sequence with itself for some positive integer (see the example below for an application)

Multiplication of generating functions, or convolution of their underlying sequences, can correspond to a notion of independent events in certain counting and probability scenarios. For example, if we adopt the notational convention that the probability generating function, or pgf, of a random variable is denoted by , then we can show that for any two random variables [22]

if and are independent. Similarly, the number of ways to pay cents in coin denominations of values in the set (i.e., in pennies, nickels, dimes, quarters, and half dollars, respectively) is generated by the product

and moreover, if we allow the cents to be paid in coins of any positive integer denomination, we arrive at the generating for the number of such combinations of change being generated by the partition function generating function expanded by the infinite q-Pochhammer symbol product of .

Example: The generating function for the Catalan numbers

An example where convolutions of generating functions are useful allows us to solve for a specific closed-form function representing the ordinary generating function for the Catalan numbers, . In particular, this sequence has the combinatorial interpretation as being the number of ways to insert parentheses into the product so that the order of multiplication is completely specified. For example, which corresponds to the two expressions and . It follows that the sequence satisfies a recurrence relation given by

and so has a corresponding convolved generating function, , satisfying

Since , we then arrive at a formula for this generating function given by

Note that the first equation implicitly defining above implies that

which then leads to another "simple" (as in of form) continued fraction expansion of this generating function.

Example: Spanning trees of fans and convolutions of convolutions

A fan of order is defined to be a graph on the vertices with edges connected according to the following rules: Vertex is connected by a single edge to each of the other vertices, and vertex is connected by a single edge to the next vertex for all .[23] There is one fan of order one, three fans of order two, eight fans of order three, and so on. A spanning tree is a subgraph of a graph which contains all of the original vertices and which contains enough edges to make this subgraph connected, but not so many edges that there is a cycle in the subgraph. We ask how many spanning trees of a fan of order are possible for each .

As an observation, we may approach the question by counting the number of ways to join adjacent sets of vertices. For example, when , we have that , which is a sum over the -fold convolutions of the sequence for . More generally, we may write a formula for this sequence as

from which we see that the ordinary generating function for this sequence is given by the next sum of convolutions as

from which we are able to extract an exact formula for the sequence by taking the partial fraction expansion of the last generating function.

Introducing a free parameter (snake oil method)

Sometimes the sum is complicated, and it is not always easy to evaluate. The "Free Parameter" method is another method (called "snake oil" by H. Wilf) to evaluate these sums.

Both methods discussed so far have as limit in the summation. When n does not appear explicitly in the summation, we may consider as a “free” parameter and treat as a coefficient of , change the order of the summations on and , and try to compute the inner sum.

For example, if we want to compute

we can treat as a "free" parameter, and set

Interchanging summation (“snake oil”) gives

Now the inner sum is . Thus

Then we obtain

Generating functions prove congruences

We say that two generating functions (power series) are congruent modulo , written if their coefficients are congruent modulo for all , i.e., for all relevant cases of the integers (note that we need not assume that is an integer here—it may very well be polynomial-valued in some indeterminate , for example). If the "simpler" right-hand-side generating function, , is a rational function of , then the form of this sequences suggests that the sequence is eventually periodic modulo fixed particular cases of integer-valued . For example, we can prove that the Euler numbers, , satisfy the following congruence modulo :[24]

One of the most useful, if not downright powerful, methods of obtaining congruences for sequences enumerated by special generating functions modulo any integers (i.e., not only prime powers ) is given in the section on continued fraction representations of (even non-convergent) ordinary generating functions by J-fractions above. We cite one particular result related to generating series expanded through a representation by continued fraction from Lando's Lectures on Generating Functions as follows:

Theorem: (Congruences for Series Generated by Expansions of Continued Fractions) Suppose that the generating function is represented by an infinite continued fraction of the form
and that denotes the convergent to this continued fraction expansion defined such that for all . Then 1) the function is rational for all where we assume that one of divisibility criteria of is met, i.e., for some ; and 2) If the integer divides the product , then we have that .

Generating functions also have other uses in proving congruences for their coefficients. We cite the next two specific examples deriving special case congruences for the Stirling numbers of the first kind and for the partition function (mathematics) which show the versatility of generating functions in tackling problems involving integer sequences.

The Stirling numbers modulo small integers

The main article on the Stirling numbers generated by the finite products

provides an overview of the congruences for these numbers derived strictly from properties of their generating function as in Section 4.6 of Wilf's stock reference Generatingfunctionology. We repeat the basic argument and notice that when reduces modulo , these finite product generating functions each satisfy

which implies that the parity of these Stirling numbers matches that of the binomial coefficient

and consequently shows that is even whenever .

Similarly, we can reduce the right-hand-side products defining the Stirling number generating functions modulo to obtain slightly more complicated expressions providing that

Congruences for the partition function

In this example, we pull in some of the machinery of infinite products whose power series expansions generate the expansions of many special functions and enumerate partition functions. In particular, we recall that the partition function is generated by the reciprocal infinite q-Pochhammer symbol product (or z-Pochhammer product as the case may be) given by

This partition function satisfies many known congruence properties, which notably include the following results though there are still many open questions about the forms of related integer congruences for the function:[25]

We show how to use generating functions and manipulations of congruences for formal power series to give a highly elementary proof of the first of these congruences listed above.

First, we observe that the binomial coefficient generating function, , satisfies that each of its coefficients are divisible by with the exception of those which correspond to the powers of , all of which otherwise have a remainder of modulo . Thus we may write

which in particular shows us that

Hence, we easily see that divides each coefficient of in the infinite product expansions of

Finally, since we may write the generating function for the partition function as

we may equate the coefficients of in the previous equations to prove our desired congruence result, namely that, for all .

Transformations of generating functions

There are a number of transformations of generating functions that provide other applications (see the main article). A transformation of a sequence's ordinary generating function (OGF) provides a method of converting the generating function for one sequence into a generating function enumerating another. These transformations typically involve integral formulas involving a sequence OGF (see integral transformations) or weighted sums over the higher-order derivatives of these functions (see derivative transformations).

Generating function transformations can come into play when we seek to express a generating function for the sums

in the form of involving the original sequence generating function. For example, if the sums , then the generating function for the modified sum expressions is given by [26] (see also the binomial transform and the Stirling transform).

There are also integral formulas for converting between a sequence's OGF, , and its exponential generating function, or EGF, , and vice versa given by

provided that these integrals converge for appropriate values of .

Other applications

Generating functions are used to:

  • Find a closed formula for a sequence given in a recurrence relation. For example, consider Fibonacci numbers.
  • Find recurrence relations for sequences—the form of a generating function may suggest a recurrence formula.
  • Find relationships between sequences—if the generating functions of two sequences have a similar form, then the sequences themselves may be related.
  • Explore the asymptotic behaviour of sequences.
  • Prove identities involving sequences.
  • Solve enumeration problems in combinatorics and encoding their solutions. Rook polynomials are an example of an application in combinatorics.
  • Evaluate infinite sums.

Other generating functions

Examples

Examples of polynomial sequences generated by more complex generating functions include:

Other sequences generated by more complex generating functions:

Convolution polynomials

Knuth's article titled "Convolution Polynomials"[27] defines a generalized class of convolution polynomial sequences by their special generating functions of the form

for some analytic function with a power series expansion such that . We say that a family of polynomials, , forms a convolution family if and if the following convolution condition holds for all and for all :

We see that for non-identically zero convolution families, this definition is equivalent to requiring that the sequence have an ordinary generating function of the first form given above.

A sequence of convolution polynomials defined in the notation above has the following properties:

  • The sequence is of binomial type
  • Special values of the sequence include and , and
  • For arbitrary (fixed) , these polynomials satisfy convolution formulas of the form

For a fixed non-zero parameter , we have modified generating functions for these convolution polynomial sequences given by

where is implicitly defined by a functional equation of the form . Moreover, we can use matrix methods (as in the reference) to prove that given two convolution polynomial sequences, and , with respective corresponding generating functions, and , then for arbitrary we have the identity

Examples of convolution polynomial sequences include the binomial power series, , so-termed tree polynomials, the Bell numbers, , the Laguerre polynomials, and the Stirling convolution polynomials.

Tables of special generating functions

An initial listing of special mathematical series is found here. A number of useful and special sequence generating functions are found in Section 5.4 and 7.4 of Concrete Mathematics and in Section 2.5 of Wilf's Generatingfunctionology. Other special generating functions of note include the entries in the next table, which is by no means complete.[28]

Formal power series Generating-function formula Notes
is a first-order harmonic number
is a Bernoulli number
is a Fibonacci number and
denotes the rising factorial, or Pochhammer symbol and some integer
is the polylogarithm function and is a generalized harmonic number for
is a Stirling number of the second kind and where the individual terms in the expansion satisfy
The two-variable case is given by

History

George Polya writes in Mathematics and plausible reasoning:

The name "generating function" is due to Laplace. Yet, without giving it a name, Euler used the device of generating functions long before Laplace [..]. He applied this mathematical tool to several problems in Combinatory Analysis and the Theory of Numbers.

See also

Notes

  1. ^ Donald E. Knuth, The Art of Computer Programming, Volume 1 Fundamental Algorithms (Third Edition) Addison-Wesley. ISBN 0-201-89683-4. Section 1.2.9: "Generating Functions".
  2. ^ This alternative term can already be found in E.N. Gilbert (1956), "Enumeration of Labeled graphs", Canadian Journal of Mathematics 3, p. 405–411, but its use is rare before the year 2000; since then it appears to be increasing.
  3. ^ Flajolet & Sedgewick (2009) p.95
  4. ^ Apostol, Tom M. (1976), Introduction to analytic number theory, Undergraduate Texts in Mathematics, New York-Heidelberg: Springer-Verlag, ISBN 978-0-387-90163-3, MR 0434929, Zbl 0335.10001 pp.42–43
  5. ^ Wilf (1994) p.56
  6. ^ Wilf (1994) p.59
  7. ^ Hardy and Wright (2008). An Introduction to the Theory of Numbers (Sixth ed.). New York: Oxford University Press. p. 339.
  8. ^ Spivey, Michael Z. (2007). "Combinatorial Sums and Finite Differences". Discrete Math. 307 (24): 3130–3146. doi:10.1016/j.disc.2007.03.052. MR 2370116.
  9. ^ Mathar, R. J. (2012). "Yet another table of integrals". arXiv:1207.5845. v4 eq. (0.4)
  10. ^ See Table 265 in Section 6.1 of Concrete Mathematics for finite sum identities involving the Stirling number triangles.
  11. ^ See section 2.4 in Lando's book Lectures on Generating Functions (2002).
  12. ^ Example from Section 6.3 of R. P. Stanley's Enumerative Combinatorics (Volume 2).
  13. ^ See Section 1.2.9 in Knuth's The Art of Computer Programming (Vol. 1).
  14. ^ Solution to exercise 7.36 on page 569 in Graham, Knuth and Patshnik.
  15. ^ Flajolet and Sedgewick (2010). Analytic Combinatorics. New York: Cambridge University Press. ISBN 978-0-521-89806-5. (Section B.4)
  16. ^ Schneider, C. (2007). "Symbolic Summation Assists Combinatorics". Sem.Lothar.Combin. 56: 1–36.
  17. ^ See P. Flajolet's article Combinatorial aspects of continued fractions (1980) and also refer to H. S. Wall's Analytic theory of continued fractions (1948) for more complete information on the properties of J-fractions.
  18. ^ See the following articles:
  19. ^ "Lambert series identity". Math Overflow. 2017.
  20. ^ Good, I. J. (1986). "On applications of symmetric Dirichlet distributions and their mixtures to contingency tables". Annals of Statistics. 4 (6): 1159–1189. doi:10.1214/aos/1176343649.
  21. ^ See the usage of these terms in Section 7.4 of Concrete Mathematics on special sequence generating functions.
  22. ^ Section 8.3 in Concrete Mathematics.
  23. ^ See Example 6 in Section 7.3 of Concrete Mathematics for another method and the complete setup of this problem using generating functions. This more "convoluted" approach is given in Section 7.5 of the same reference.
  24. ^ See Section 5 of Lando's Lectures on Generating Functions.
  25. ^ See Section 19.12 of Hardy and Wright's classic book An introduction to the theory of numbers.
  26. ^ Solution to exercise 5.71 on page 535 in Concrete Mathematics by Graham, Knuth and Patashnik.
  27. ^ Knuth, D. E. (1992). "Convolution Polynomials" (PDF). Mathematica J. 2: 67–78.
  28. ^ See also the 1031 Generating Functions found in the article referenced here.

References

External links

Bell number

In combinatorial mathematics, the Bell numbers count the possible partitions of a set. These numbers have been studied by mathematicians since the 19th century, and their roots go back to medieval Japan, but they are named after Eric Temple Bell, who wrote about them in the 1930s.

Starting with B0 = B1 = 1, the first few Bell numbers are:

1, 1, 2, 5, 15, 52, 203, 877, 4140, 21147, 115975, 678570, 4213597, 27644437, 190899322, 1382958545, 10480142147, 82864869804, 682076806159, 5832742205057, ... (sequence A000110 in the OEIS).The nth of these numbers, Bn, counts the number of different ways to partition a set that has exactly n elements, or equivalently, the number of equivalence relations on it.

Outside of mathematics, the same number also counts the number of different rhyme schemes for n-line poems.As well as appearing in counting problems, these numbers have a different interpretation, as moments of probability distributions. In particular, Bn is the nth moment of a Poisson distribution with mean 1.

Binomial transform

In combinatorics, the binomial transform is a sequence transformation (i.e., a transform of a sequence) that computes its forward differences. It is closely related to the Euler transform, which is the result of applying the binomial transform to the sequence associated with its ordinary generating function.

Canonical transformation

In Hamiltonian mechanics, a canonical transformation is a change of canonical coordinates (q, p, t) → (Q, P, t) that preserves the form of Hamilton's equations. This is sometimes known as form invariance. It need not preserve the form of the Hamiltonian itself. Canonical transformations are useful in their own right, and also form the basis for the Hamilton–Jacobi equations (a useful method for calculating conserved quantities) and Liouville's theorem (itself the basis for classical statistical mechanics).

Since Lagrangian mechanics is based on generalized coordinates, transformations of the coordinates qQ do not affect the form of Lagrange's equations and, hence, do not affect the form of Hamilton's equations if we simultaneously change the momentum by a Legendre transformation into

Therefore, coordinate transformations (also called point transformations) are a type of canonical transformation. However, the class of canonical transformations is much broader, since the old generalized coordinates, momenta and even time may be combined to form the new generalized coordinates and momenta. Canonical transformations that do not include the time explicitly are called restricted canonical transformations (many textbooks consider only this type).

For clarity, we restrict the presentation here to calculus and classical mechanics. Readers familiar with more advanced mathematics such as cotangent bundles, exterior derivatives and symplectic manifolds should read the related symplectomorphism article. (Canonical transformations are a special case of a symplectomorphism.) However, a brief introduction to the modern mathematical description is included at the end of this article.

Characteristic function (probability theory)

In probability theory and statistics, the characteristic function of any real-valued random variable completely defines its probability distribution. If a random variable admits a probability density function, then the characteristic function is the Fourier transform of the probability density function. Thus it provides the basis of an alternative route to analytical results compared with working directly with probability density functions or cumulative distribution functions. There are particularly simple results for the characteristic functions of distributions defined by the weighted sums of random variables.

In addition to univariate distributions, characteristic functions can be defined for vector or matrix-valued random variables, and can also be extended to more generic cases.

The characteristic function always exists when treated as a function of a real-valued argument, unlike the moment-generating function. There are relations between the behavior of the characteristic function of a distribution and properties of the distribution, such as the existence of moments and the existence of a density function.

Cumulant

In probability theory and statistics, the cumulants κn of a probability distribution are a set of quantities that provide an alternative to the moments of the distribution. The moments determine the cumulants in the sense that any two probability distributions whose moments are identical will have identical cumulants as well, and similarly the cumulants determine the moments.

The first cumulant is the mean, the second cumulant is the variance, and the third cumulant is the same as the third central moment. But fourth and higher-order cumulants are not equal to central moments. In some cases theoretical treatments of problems in terms of cumulants are simpler than those using moments. In particular, when two or more random variables are statistically independent, the nth-order cumulant of their sum is equal to the sum of their nth-order cumulants. As well, the third and higher-order cumulants of a normal distribution are zero, and it is the only distribution with this property.

Just as for moments, where joint moments are used for collections of random variables, it is possible to define joint cumulants.

Enumerative combinatorics

Enumerative combinatorics is an area of combinatorics that deals with the number of ways that certain patterns can be formed. Two examples of this type of problem are counting combinations and counting permutations. More generally, given an infinite collection of finite sets Si indexed by the natural numbers, enumerative combinatorics seeks to describe a counting function which counts the number of objects in Sn for each n. Although counting the number of elements in a set is a rather broad mathematical problem, many of the problems that arise in applications have a relatively simple combinatorial description. The twelvefold way provides a unified framework for counting permutations, combinations and partitions.

The simplest such functions are closed formulas, which can be expressed as a composition of elementary functions such as factorials, powers, and so on. For instance, as shown below, the number of different possible orderings of a deck of n cards is f(n) = n!. The problem of finding a closed formula is known as algebraic enumeration, and frequently involves deriving a recurrence relation or generating function and using this to arrive at the desired closed form.

Often, a complicated closed formula yields little insight into the behavior of the counting function as the number of counted objects grows. In these cases, a simple asymptotic approximation may be preferable. A function is an asymptotic approximation to if as . In this case, we write

Extended negative binomial distribution

In probability and statistics the extended negative binomial distribution is a discrete probability distribution extending the negative binomial distribution. It is a truncated version of the negative binomial distribution for which estimation methods have been studied.In the context of actuarial science, the distribution appeared in its general form in a paper by K. Hess, A. Liewald and K.D. Schmidt when they characterized all distributions for which the extended Panjer recursion works. For the case m = 1, the distribution was already discussed by Willmot and put into a parametrized family with the logarithmic distribution and the negative binomial distribution by H.U. Gerber.

Factorial moment generating function

In probability theory and statistics, the factorial moment generating function of the probability distribution of a real-valued random variable X is defined as

for all complex numbers t for which this expected value exists. This is the case at least for all t on the unit circle , see characteristic function. If X is a discrete random variable taking values only in the set {0,1, ...} of non-negative integers, then is also called probability-generating function of X and is well-defined at least for all t on the closed unit disk .

The factorial moment generating function generates the factorial moments of the probability distribution. Provided exists in a neighbourhood of t = 1, the nth factorial moment is given by

where the Pochhammer symbol (x)n is the falling factorial

(Many mathematicians, especially in the field of special functions, use the same notation to represent the rising factorial.)

Formula for primes

In number theory, a formula for primes is a formula generating the prime numbers, exactly and without exception. No such formula which is efficiently computable is known. A number of constraints are known, showing what such a "formula" can and cannot be.

Gamma/Gompertz distribution

In probability and statistics, the Gamma/Gompertz distribution is a continuous probability distribution. It has been used as an aggregate-level model of customer lifetime and a model of mortality risks.

Moment-generating function

In probability theory and statistics, the moment-generating function of a real-valued random variable is an alternative specification of its probability distribution. Thus, it provides the basis of an alternative route to analytical results compared with working directly with probability density functions or cumulative distribution functions. There are particularly simple results for the moment-generating functions of distributions defined by the weighted sums of random variables. However, not all random variables have moment-generating functions.

As its name implies, the moment generating function can be used to compute a distribution’s moments: the nth moment about 0 is the nth derivative of the moment-generating function, evaluated at 0.

In addition to real-valued distributions (univariate distributions), moment-generating functions can be defined for vector- or matrix-valued random variables, and can even be extended to more general cases.

The moment-generating function of a real-valued distribution does not always exist, unlike the characteristic function. There are relations between the behavior of the moment-generating function of a distribution and properties of the distribution, such as the existence of moments.

Narayana number

In combinatorics, the Narayana numbers N(n, k), n = 1, 2, 3 ..., 1 ≤ k ≤ n, form a triangular array of natural numbers, called Narayana triangle, that occur in various counting problems. They are named after Canadian mathematician T. V. Narayana (1930–1987).

Natural exponential family

In probability and statistics, a natural exponential family (NEF) is a class of probability distributions that is a special case of an exponential family (EF). Every distribution possessing a moment-generating function is a member of a natural exponential family, and the use of such distributions simplifies the theory and computation of generalized linear models.

Pentagonal pyramidal number

A pentagonal pyramidal number is a figurate number that represents the number of objects in a pyramid with a pentagonal base. The nth pentagonal pyramidal number is equal to the sum of the first n pentagonal numbers.

The first few pentagonal pyramidal numbers are:

1, 6, 18, 40, 75, 126, 196, 288, 405, 550, 726, 936, 1183, 1470, 1800, 2176, 2601, 3078, 3610, 4200, 4851, 5566, 6348, 7200, 8125, 9126 (sequence A002411 in the OEIS).

The formula for the nth pentagonal pyramidal number is

so the nth pentagonal pyramidal number is the average of n2 and n3. The nth pentagonal pyramidal number is also n times the nth triangular number.

The generating function for the pentagonal pyramidal numbers is

Probability-generating function

In probability theory, the probability generating function of a discrete random variable is a power series representation (the generating function) of the probability mass function of the random variable. Probability generating functions are often employed for their succinct description of the sequence of probabilities Pr(X = i) in the probability mass function for a random variable X, and to make available the well-developed theory of power series with non-negative coefficients.

U-quadratic distribution

In probability theory and statistics, the U-quadratic distribution is a continuous probability distribution defined by a unique convex quadratic function with lower limit a and upper limit b.

Uniform distribution (continuous)

In probability theory and statistics, the continuous uniform distribution or rectangular distribution is a family of symmetric probability distributions such that for each member of the family, all intervals of the same length on the distribution's support are equally probable. The support is defined by the two parameters, a and b, which are its minimum and maximum values. The distribution is often abbreviated U(a,b). It is the maximum entropy probability distribution for a random variable X under no constraint other than that it is contained in the distribution's support.

Weibull distribution

In probability theory and statistics, the Weibull distribution is a continuous probability distribution. It is named after Swedish mathematician Waloddi Weibull, who described it in detail in 1951, although it was first identified by Fréchet (1927) and first applied by Rosin & Rammler (1933) to describe a particle size distribution.

Zeta distribution

In probability theory and statistics, the zeta distribution is a discrete probability distribution. If X is a zeta-distributed random variable with parameter s, then the probability that X takes the integer value k is given by the probability mass function

where ζ(s) is the Riemann zeta function (which is undefined for s = 1).

The multiplicities of distinct prime factors of X are independent random variables.

The Riemann zeta function being the sum of all terms for positive integer k, it appears thus as the normalization of the Zipf distribution. The terms "Zipf distribution" and the "zeta distribution" are often used interchangeably. But note that while the Zeta distribution is a probability distribution by itself, it is not associated to the Zipf's law with same exponent. See also Yule–Simon distribution

This page is based on a Wikipedia article written by authors (here).
Text is available under the CC BY-SA 3.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.