tgt

## Monday, 25 March 2013

### Bessel's Inequality and Parseval's Formula: The Energy Theorem

We have seen some types of approximations, such as Taylor and Fourier approximations. The type of convergence used changes depending on the nature of the approximation. One of the most useful for Fourier approximations is L2-convergence:
Let f (x) be an integrable function on the interval [- ,], such that

f2(x)dx < .

We will say that f (x) is square integrable. Consider the associated Fourier series
f (x a0 + ancos(nx) + bnsin(nx).

Set
fN(x) = a0 + ancos(nx) + bnsin(nx).

Hence
(f (x) - fN(x))2dx = (f2(x) - 2f (x)fN(x) + f2N(x))dx.

Easy calculations give
f2N(x)dx = 2a20 + (a2n + b2n).

We also have
f (x)fN(x)dx = 2a20 + (a2n + b2n).

Therefore
(f (x) - fN(x))2dx = f2(x)dx - 2a20 + (a2n + b2n).

Since (f (x) - fN(x))2dx  0, then
2a20 + (a2n + b2n)  f2(x)dx,

for any N  1. This clearly implies the following result:
Theorem. Bessel's Inequality Let f (x) be a function defined on [- ,] such that f2(x) has a finite integral on [- ,]. If an and bn are the Fourier coefficients of the function f (x), then we have

2a20 + (a2n + b2n)  f2(x)dx.

In particular, the series (a2n + b2n)) is convergent.
Remark. The quantity An =  is called the amplitude of the nth harmonic. The square of the amplitude has a useful interpretation. Indeed, borrowing terminology from the study of periodic waves, we define theenergy E of a 2-periodic function f (x) to be the number

E = f2(x)dx.

So Bessel's Inequality translates into:
2a20 + (a2n + b2n)  E.

You may ask the following question: when does the inequality become an equality?
Note that for Fourier polynomials, the inequality does indeed become an equality. Using this, one can show that the answer to the question is in the affirmative if and only if

(f (x) - fN(x))2dx = 0.

In this case, we have
(2a20 + (a2n + b2n)) = f2(x)dx.

Theorem. Parseval's Formula or the Energy Theorem. Let f (x) be a function defined on [- ,] such that f2(x) has a finite integral on [- ,]. If an and bn are the Fourier coefficients of f (x), then we have

2a20 + (a2n + b2n) = f2(x)dx = E

if and only if
(f (x) - fN(x))2dx = 0.

Remark. One may wonder when does Parseval's Formula hold? This is the case, for example, for piecewise smooth functions. The reason behind is the uniform convergence of the Fourier partial sums to f (x), ie.

f (x) - fN(x)| = 0.

The proof in this case is quite easy. Indeed, since f (x) is continuous then
f (x) = a0 + (ancos(nx) + bnsin(nx)).

Hence
f2(x) = a0f (x) + (ancos(nx)f (x) + bnsin(nx)f (x)).

The uniform convergence of this series enables us to integrate term-by-term to obtain
f2(x)dx = a0f (x)dx + (ancos(nx)f (x) + bnsin(nx)f (x))dx.

By using the definition of the Fourier coefficients, we get the desired conclusion.
Application: Least Square Error.
One application of Parseval's Formula is the measure of the least square error  defined by

= (f (x) - fN(x))2dx.

If the function f (x) satisfies the assumptions of the Energy Theorem, then we have
= (a2n + b2n).

Example. Let f (x) = | x| be defined on [- ,]. Find  and its asymptotic behavior when N gets large.
Answer. Since f (x) is even, we have bn = 0. On the other hand, easy calculations give

a2n = 0,    and    a2n - 1 = - .

Hence
=  =  = .

Using the equality
= ,

we get
= O,      as    N  .

Recall that the sequences {un} and {vn} satisfy

un = O(vn)

if  is a bounded sequence.