The Fourier series is named in honour of Jean-Baptiste Joseph Fourier (1768–1830), who made important contributions to the study of trigonometric series, after preliminary investigations by Leonhard Euler, Jean le Rond d'Alembert, and Daniel Bernoulli.[nb 1] Fourier introduced the series for the purpose of solving the heat equation in a metal plate, publishing his initial results in his 1807 Mémoire sur la propagation de la chaleur dans les corps solides (Treatise on the propagation of heat in solid bodies), and publishing his Théorie analytique de la chaleur (Analytical theory of heat) in 1822. The Mémoire introduced Fourier analysis, specifically Fourier series. Through Fourier's research the fact was established that an arbitrary (continuous) function can be represented by a trigonometric series. The first announcement of this great discovery was made by Fourier in 1807, before the French Academy. Early ideas of decomposing a periodic function into the sum of simple oscillating functions date back to the 3rd century BC, when ancient astronomers proposed an empiric model of planetary motions, based on deferents and epicycles.
The heat equation is a partial differential equation. Prior to Fourier's work, no solution to the heat equation was known in the general case, although particular solutions were known if the heat source behaved in a simple way, in particular, if the heat source was a sine or cosine wave. These simple solutions are now sometimes called eigensolutions. Fourier's idea was to model a complicated heat source as a superposition (or linear combination) of simple sine and cosine waves, and to write the solution as a superposition of the corresponding eigensolutions. This superposition or linear combination is called the Fourier series.
The definition of a Fourier series can get complicated, so it is instructive to begin with a simple case. Let be a periodic function with period , and let us assume that it is absolutely Riemann integrable over . We set
and for each set
The Fourier series for is then defined as
Here, "" just means that this is the Fourier series.
The Fourier series of may or may not converge for all , and may or may not be equal to . However, for many well-behaved functions, the Fourier series does converge, and in fact is equal to .
For the remainder of this section, denotes a real-valued function of the real variable , and is integrable on an interval , for real numbers and . We will attempt to represent in that interval as an infinite sum, or series, of harmonically related sinusoidal functions. Outside the interval, the series is periodic with period (frequency ). It follows that if also has that property, the approximation is valid on the entire real line. We can begin with a finite summation (or partial sum):
The first four partial sums of the Fourier series for a square wave
Function (in red) is a sum of six sine functions of different amplitudes and harmonically related frequencies. Their summation is called a Fourier series. The Fourier transform, (in blue), which depicts amplitude vs frequency, reveals the 6 frequencies (at odd harmonics) and their amplitudes (1/odd number).
(Here, means "equal by definition," sometimes denoted .) is a periodic function with period . The coefficients denote the amplitudes and the the phases of the oscillations. Because of that, this formula is called the amplitude-phase form. Using the identities:
we can also write the function in the equivalent form (called the sine-cosine form):
or the equivalent form (called the exponential form):
The inverse relationships between the coefficients are:
When the coefficients (known as Fourier coefficients) are computed as follows for the sine-cosine-form:
or as follows for the exponential form:
approximates on and the approximation improves as N → ∞. The infinite sum, is called the Fourier series representation of
If is a complex-valued function of a real variable ,both components (real and imaginary part) are real-valued functions that can be represented by a Fourier series. The two sets of coefficients and the partial sum are given by:
This is identical to Eq.3 except and are no longer complex conjugates. The formula for is also unchanged (see Eq.5):
The notation is inadequate for discussing the Fourier coefficients of several different functions. Therefore, it is customarily replaced by a modified form of the function (, in this case), such as or , and functional notation often replaces subscripting:
In engineering, particularly when the variable represents time, the coefficient sequence is called a frequency domain representation. Square brackets are often used to emphasize that the domain of this function is a discrete set of frequencies.
Another commonly used frequency domain representation uses the Fourier series coefficients to modulate a Dirac comb:
In engineering applications, the Fourier series is generally presumed to converge everywhere except at discontinuities, since the functions encountered in engineering are more well behaved than the ones that mathematicians can provide as counter-examples to this presumption. In particular, if is continuous and the derivative of (which may not exist everywhere) is square integrable, then the Fourier series of converges absolutely and uniformly to . If a function is square-integrable on the interval , then the Fourier series converges to the function at almost every point. Convergence of Fourier series also depends on the finite number of maxima and minima in a function which is popularly known as one of the Dirichlet's condition for Fourier series. See Convergence of Fourier series. It is possible to define Fourier coefficients for more general functions or distributions, in such cases convergence in norm or weak convergence is usually of interest.
Another visualisation of an approximation of a square wave by taking the first 1, 2, 3 and 4 terms of its Fourier series. (An interactive animation can be seen here)
A visualisation of an approximation of a sawtooth wave of the same amplitude and frequency for comparison
Example of convergence to a somewhat arbitrary function. Note the development of the "ringing" (Gibbs phenomenon) at the transitions to/from the vertical sections.
The Fourier series expansion of our function in Example 1 looks more complicated than the simple formula , so it is not immediately apparent why one would need the Fourier series. While there are many applications, Fourier's motivation was in solving the heat equation. For example, consider a metal plate in the shape of a square whose side measures meters, with coordinates . If there is no heat source within the plate, and if three of the four sides are held at 0 degrees Celsius, while the fourth side, given by , is maintained at the temperature gradient degrees Celsius, for in , then one can show that the stationary heat distribution (or the heat distribution after a long period of time has elapsed) is given by
Here, sinh is the hyperbolic sine function. This solution of the heat equation is obtained by multiplying each term of Eq.7 by . While our example function seems to have a needlessly complicated Fourier series, the heat distribution is nontrivial. The function cannot be written as a closed-form expression. This method of solving the heat problem was made possible by Fourier's work.
This immediately gives any coefficient ak of the trigonometrical series for φ(y) for any function which has such an expansion. It works because if φ has such an expansion, then (under suitable convergence assumptions) the integral
can be carried out term-by-term. But all terms involving for j ≠ k vanish when integrated from −1 to 1, leaving only the kth term.
In these few lines, which are close to the modern formalism used in Fourier series, Fourier revolutionized both mathematics and physics. Although similar trigonometric series were previously used by Euler, d'Alembert, Daniel Bernoulli and Gauss, Fourier believed that such trigonometric series could represent any arbitrary function. In what sense that is actually true is a somewhat subtle issue and the attempts over many years to clarify this idea have led to important discoveries in the theories of convergence, function spaces, and harmonic analysis.
When Fourier submitted a later competition essay in 1811, the committee (which included Lagrange, Laplace, Malus and Legendre, among others) concluded: ...the manner in which the author arrives at these equations is not exempt of difficulties and...his analysis to integrate them still leaves something to be desired on the score of generality and even rigour.
Since Fourier's time, many different approaches to defining and understanding the concept of Fourier series have been discovered, all of which are consistent with one another, but each of which emphasizes different aspects of the topic. Some of the more powerful and elegant approaches are based on mathematical ideas and tools that were not available at the time Fourier completed his original work. Fourier originally defined the Fourier series for real-valued functions of real arguments, and using the sine and cosine functions as the basis set for the decomposition.
Many other Fourier-related transforms have since been defined, extending the initial idea to other applications. This general area of inquiry is now sometimes called harmonic analysis. A Fourier series, however, can be used only for periodic functions, or for functions on a bounded (compact) interval.
We can also define the Fourier series for functions of two variables and in the square :
Aside from being useful for solving partial differential equations such as the heat equation, one notable application of Fourier series on the square is in image compression. In particular, the jpeg image compression standard uses the two-dimensional discrete cosine transform, which is a Fourier transform using the cosine basis functions.
Fourier series of Bravais-lattice-periodic-functionEdit
The three-dimensional Bravais lattice is defined as the set of vectors of the form:
where are integers and are three linearly independent vectors. Assuming we have some function, , such that it obeys the following condition for any Bravais lattice vector , we could make a Fourier series of it. This kind of function can be, for example, the effective potential that one electron "feels" inside a periodic crystal. It is useful to make a Fourier series of the potential then when applying Bloch's theorem. First, we may write any arbitrary vector in the coordinate-system of the lattice:
Thus we can define a new function,
This new function, , is now a function of three-variables, each of which has periodicity a1, a2, a3 respectively:
If we write a series for g on the interval [0, a1] for x1, we can define the following:
And then we can write:
We can write once again as:
Finally applying the same for the third coordinate, we define:
We write as:
Now, every reciprocal lattice vector can be written as , where are integers and are the reciprocal lattice vectors, we can use the fact that to calculate that for any arbitrary reciprocal lattice vector and arbitrary vector in space , their scalar product is:
And so it is clear that in our expansion, the sum is actually over reciprocal lattice vectors:
we can solve this system of three linear equations for , , and in terms of , and in order to calculate the volume element in the original cartesian coordinate system. Once we have , , and in terms of , and , we can calculate the Jacobian determinant:
which after some calculation and applying some non-trivial cross-product identities can be shown to be equal to:
(it may be advantageous for the sake of simplifying calculations, to work in such a cartesian coordinate system, in which it just so happens that is parallel to the x axis, lies in the x-y plane, and has components of all three axes). The denominator is exactly the volume of the primitive unit cell which is enclosed by the three primitive-vectors , and . In particular, we now know that
We can write now as an integral with the traditional coordinate system over the volume of the primitive cell, instead of with the , and variables:
And is the primitive unit cell, thus, is the volume of the primitive unit cell.
In the language of Hilbert spaces, the set of functions is an orthonormal basis for the space of square-integrable functions on . This space is actually a Hilbert space with an inner product given for any two elements and by
The basic Fourier series result for Hilbert spaces can be written as
Sines and cosines form an orthonormal set, as illustrated above. The integral of sine, cosine and their product is zero (green and red areas are equal, and cancel out) when , or the functions are different, and pi only if and are equal, and the function used is the same.
This corresponds exactly to the complex exponential formulation given above. The version with sines and cosines is also justified with the Hilbert space interpretation. Indeed, the sines and cosines form an orthogonal set:
furthermore, the sines and cosines are orthogonal to the constant function . An orthonormal basis for consisting of real functions is formed by the functions and , with n = 1, 2,... The density of their span is a consequence of the Stone–Weierstrass theorem, but follows also from the properties of classical kernels like the Fejér kernel.
When the real and imaginary parts of a complex function are decomposed into their even and odd parts, there are four components, denoted below by the subscripts RE, RO, IE, and IO. And there is a one-to-one mapping between the four components of a complex time function and the four components of its complex frequency transform:
From this, various relationships are apparent, for example:
The transform of a real-valued function (fRE+ fRO) is the even symmetric function FRE+ i FIO. Conversely, an even-symmetric transform implies a real-valued time-domain.
The transform of an imaginary-valued function (ifIE+ ifIO) is the odd symmetric function FRO+ i FIE, and the converse is true.
The transform of a even-symmetric function (fRE+ ifIO) is the real-valued function FRE+ FRO, and the converse is true.
The transform of a odd-symmetric function (fRO+ ifIE) is the imaginary-valued function i FIE+ i FIO, and the converse is true.
One of the interesting properties of the Fourier transform which we have mentioned, is that it carries convolutions to pointwise products. If that is the property which we seek to preserve, one can produce Fourier series on any compact group. Typical examples include those classical groups that are compact. This generalizes the Fourier transform to all spaces of the form L2(G), where G is a compact group, in such a way that the Fourier transform carries convolutions to pointwise products. The Fourier series exists and converges in similar ways to the [−π,π] case.
An alternative extension to compact groups is the Peter–Weyl theorem, which proves results about representations of compact groups analogous to those about finite groups.
If the domain is not a group, then there is no intrinsically defined convolution. However, if is a compactRiemannian manifold, it has a Laplace–Beltrami operator. The Laplace–Beltrami operator is the differential operator that corresponds to Laplace operator for the Riemannian manifold . Then, by analogy, one can consider heat equations on . Since Fourier arrived at his basis by attempting to solve the heat equation, the natural generalization is to use the eigensolutions of the Laplace–Beltrami operator as a basis. This generalizes Fourier series to spaces of the type , where is a Riemannian manifold. The Fourier series converges in ways similar to the case. A typical example is to take to be the sphere with the usual metric, in which case the Fourier basis consists of spherical harmonics.
The generalization to compact groups discussed above does not generalize to noncompact, nonabelian groups. However, there is a straightforward generalization to Locally Compact Abelian (LCA) groups.
This generalizes the Fourier transform to or , where is an LCA group. If is compact, one also obtains a Fourier series, which converges similarly to the case, but if is noncompact, one obtains instead a Fourier integral. This generalization yields the usual Fourier transform when the underlying locally compact Abelian group is .
Because of the least squares property, and because of the completeness of the Fourier basis, we obtain an elementary convergence result.
Theorem. If belongs to , then converges to in , that is, converges to 0 as .
We have already mentioned that if is continuously differentiable, then is the nth Fourier coefficient of the derivative . It follows, essentially from the Cauchy–Schwarz inequality, that is absolutely summable. The sum of this series is a continuous function, equal to , since the Fourier series converges in the mean to :
This result can be proven easily if is further assumed to be , since in that case tends to zero as . More generally, the Fourier series is absolutely summable, thus converges uniformly to , provided that satisfies a Hölder condition of order . In the absolutely summable case, the inequality proves uniform convergence.
Since Fourier series have such good convergence properties, many are often surprised by some of the negative results. For example, the Fourier series of a continuous T-periodic function need not converge pointwise. The uniform boundedness principle yields a simple non-constructive proof of this fact.
In 1922, Andrey Kolmogorov published an article titled "Une série de Fourier-Lebesgue divergente presque partout" in which he gave an example of a Lebesgue-integrable function whose Fourier series diverges almost everywhere. He later constructed an example of an integrable function whose Fourier series diverges everywhere (Katznelson 1976).
^Since the integral defining the Fourier transform of a periodic function is not convergent, it is necessary to view the periodic function and its transform as distributions. In this sense is a Dirac delta function, which is an example of a distribution.
^These words are not strictly Fourier's. Whilst the cited article does list the author as Fourier, a footnote indicates that the article was actually written by Poisson (that it was not written by Fourier is also clear from the consistent use of the third person to refer to him) and that it is, "for reasons of historical interest", presented as though it were Fourier's original memoire.
^The scale factor is always equal to the period, 2π in this case.
^Proakis, John G.; Manolakis, Dimitri G. (1996), Digital Signal Processing: Principles, Algorithms and Applications (3 ed.), New Jersey: Prentice-Hall International, p. 291, ISBN9780133942897, sAcfAQAAIAAJ
William E. Boyce; Richard C. DiPrima (2005). Elementary Differential Equations and Boundary Value Problems (8th ed.). New Jersey: John Wiley & Sons, Inc. ISBN0-471-43338-1.
Joseph Fourier, translated by Alexander Freeman (2003). The Analytical Theory of Heat. Dover Publications. ISBN0-486-49531-0. 2003 unabridged republication of the 1878 English translation by Alexander Freeman of Fourier's work Théorie Analytique de la Chaleur, originally published in 1822.
Enrique A. Gonzalez-Velasco (1992). "Connections in Mathematical Analysis: The Case of Fourier Series". American Mathematical Monthly. 99 (5): 427–441. doi:10.2307/2325087. JSTOR2325087.
Katznelson, Yitzhak (1976). "An introduction to harmonic analysis" (Second corrected ed.). New York: Dover Publications, Inc. ISBN0-486-63331-4.
Felix Klein, Development of mathematics in the 19th century. Mathsci Press Brookline, Mass, 1979. Translated by M. Ackerman from Vorlesungen über die Entwicklung der Mathematik im 19 Jahrhundert, Springer, Berlin, 1928.