Simpson's rule

In numerical analysis, Simpson's rule is a method for numerical integration, the numerical approximation of definite integrals. Specifically, it is the following approximation:

\( \int_{a}^{b} f(x) \, dx \approx \tfrac{b-a}{6}\left[f(a) + 4f\left(\tfrac{a+b}{2}\right)+f(b)\right]. \)

Simpson's rule also corresponds to the three-point Newton-Cotes quadrature rule.

The method is credited to the mathematician Thomas Simpson (1710–1761) of Leicestershire, England. Kepler used similar formulas over 100 years prior. For this reason the method is sometimes called Kepler's rule, or Keplersche Fassregel in German.

Derivation

Simpson's rule can be derived in various ways.
Quadratic interpolation

One derivation replaces the integrand f(x) by the quadratic polynomial (i.e. parabola)P(x) which takes the same values as f(x) at the end points a and b and the midpoint m = (a + b) / 2. One can use Lagrange polynomial interpolation to find an expression for this polynomial,

\( P(x) = f(a) \tfrac{(x-m)(x-b)}{(a-m)(a-b)} + f(m) \tfrac{(x-a)(x-b)}{(m-a)(m-b)} + f(b) \tfrac{(x-a)(x-m)}{(b-a)(b-m)}. \)

An easy (albeit tedious) calculation shows that

\( \int_{a}^{b} P(x) \, dx =\tfrac{b-a}{6}\left[f(a) + 4f\left(\tfrac{a+b}{2}\right)+f(b)\right]. \)[1]

This calculation can be carried out more easily if one first observes that (by scaling) there is no loss of generality in assuming that a=-1 and b=1.

Averaging the midpoint and the trapezoidal rules

Another derivation constructs Simpson's rule from two simpler approximations: the midpoint rule

\( M = (b-a) f \left( \tfrac{a+b}{2} \right) \)

and the trapezoidal rule

\( T = \tfrac12 (b-a) (f(a)+f(b)). \)

The errors in these approximations are

\( -\tfrac1{ 24} (b-a)^3 f''(a) + O((b-a)^4) \quad\text{and}\quad \tfrac1{12} (b-a)^3 f''(a) + O((b-a)^4), \)

respectively, where \( O((b-a)^4) \)denotes a term asymptotically proportional to \( (b-a)^4 \). The two \( O((b-a)^4)\) terms are not equal; see Big O notation for more details. It follows from the above formulas for the errors of the midpoint and trapezoidal rule that the leading error term vanishes if we take the weighted average

\( \tfrac{2M+T}{3}. \)

This weighted average is exactly Simpson's rule.

Using another approximation (for example, the trapezoidal rule with twice as many points), it is possible to take a suitable weighted average and eliminate another error term. This is Romberg's method.

Undetermined coefficients

The third derivation starts from the ansatz

\( \tfrac{1}{b-a} \int_{a}^{b} f(x) \, dx \approx \alpha f(a) + \beta f\left(\tfrac{a+b}{2}\right) + \gamma f(b). \)

The coefficients α, β and γ can be fixed by requiring that this approximation be exact for all quadratic polynomials. This yields Simpson's rule.

Error

The error in approximating an integral by Simpson's rule is

\( \tfrac{1}{90} \left(\tfrac{b-a}{2}\right)^5 \left|f^{(4)}(\xi)\right|, \)

where \( \xi \) is some number between a and b.[2]

The error is asymptotically proportional to \( (b-a)^5. \). However, the above derivations suggest an error proportional to \( (b-a)^4. \). Simpson's rule gains an extra order because the points at which the integrand is evaluated are distributed symmetrically in the interval [a, b].

Since the error term is proportional to the fourth derivative of f at \( \xi. \), this shows that Simpson's rule provides exact results for any polynomial f of degree three or less, since the fourth derivative of such a polynomial is zero at all points.

Composite Simpson's rule

If the interval of integration [a, b] is in some sense "small", then Simpson's rule will provide an adequate approximation to the exact integral. By small, what we really mean is that the function being integrated is relatively smooth over the interval [a, b]. For such a function, a smooth quadratic interpolant like the one used in Simpson's rule will give good results.

However, it is often the case that the function we are trying to integrate is not smooth over the interval. Typically, this means that either the function is highly oscillatory, or it lacks derivatives at certain points. In these cases, Simpson's rule may give very poor results. One common way of handling this problem is by breaking up the interval [a, b] into a number of small subintervals. Simpson's rule is then applied to each subinterval, with the results being summed to produce an approximation for the integral over the entire interval. This sort of approach is termed the composite Simpson's rule.

Suppose that the interval [a, b] is split up in n subintervals, with n an even number. Then, the composite Simpson's rule is given by

\( \int_a^b f(x) \, dx\approx\tfrac{h}{3}\bigg[f(x_0)+2\sum_{j=1}^{n/2-1}f(x_{2j})+ 4\sum_{j=1}^{n/2}f(x_{2j-1})+f(x_n) \bigg],. \)

where \( x_j=a+jh . \) for j=0, 1, ..., n-1, n with h=(b-a)/n; in particular, \( x_0=a. \) and \( x_n=b. \). The above formula can also be written as

\( \int_a^b f(x) \, dx\approx \tfrac{h}{3}\bigg[f(x_0)+4f(x_1)+2f(x_2)+4f(x_3)+2f(x_4)+\cdots+4f(x_{n-1})+f(x_n)\bigg] =\tfrac{h}{3}\sum_{j=1}^{n/2}\bigg[f(x_{2j-2})+4f(x_{2j-1})+f(x_{2j})\bigg].. \)

The error committed by the composite Simpson's rule is bounded (in absolute value) by

\( \tfrac{h^4}{180}(b-a) \max_{\xi\in[a,b]} |f^{(4)}(\xi)|,. \)

where h is the "step length", given by h=(b-a)/n.[3]

This formulation splits the interval [a,b] in subintervals of equal length. In practice, it is often advantageous to use subintervals of different lengths, and concentrate the efforts on the places where the integrand is less well-behaved. This leads to the adaptive Simpson's method.
Alternative extended Simpson's rule

This is another formulation of a composite Simpson's rule: instead of applying Simpson's rule to disjoint segments of the integral to be approximated, Simpson's rule is applied to overlapping segments, yielding:[4]

\( \int_a^b f(x) \, dx\approx \tfrac{h}{48}\bigg[17f(x_0)+59f(x_1)+43f(x_2)+49f(x_3)+48 \sum_{i=4}^{n-4} f(x_i)+49f(x_{n-3})+43f(x_{n-2})+59f(x_{n-1})+17f(x_n)\bigg]. . \)

The formula above is obtained by combining the original composite Simpson's rule with the one consisting in using Simpson's 3/8 rule in the extreme subintervals and the standard 3-point rule in the remaining subintervals. The result is then obtained by taking the mean of the two formulas.
Simpson's 3/8 rule

Simpson's 3/8 rule is another method for numerical integration proposed by Thomas Simpson. It is based upon a cubic interpolation rather than a quadratic interpolation. Simpson's 3/8 rule is as follows:

\( \int_{a}^{b} f(x) \, dx \approx \tfrac{3h}{8}\left[f(a) + 3f\left(\tfrac{2a+b}{3}\right) + 3f\left(\tfrac{a+2b}{3}\right) + f(b)\right] = \tfrac{(b-a)}{8}\left[f(a) + 3f\left(\tfrac{2a+b}{3}\right) + 3f\left(\tfrac{a+2b}{3}\right) + f(b)\right]\, ,. \)

where b - a = 3h. The error of this method is:

\( \left|\tfrac{(b-a)^5}{6480} f^{(4)}(\xi)\right|, . \)

where \( \xi is some number between a and b. Thus, the 3/8 rule is about twice as accurate as the standard method, but it uses one more function value. A composite 3/8 rule also exists, similarly as above.[5]

A further generalization of this concept for interpolation with arbitrary degree polynomials are the Newton–Cotes formulas.
Simpson's 3/8 rule (for n intervals)

Defining,

\( h=(b-a)/n, \quad \quad x_i = a + ih,. \)

we have

\( \int_{a}^{b} f(x) \, dx \approx \tfrac{3h}{8}\left[f(x_0) + 3f(x_1) + 3f(x_2) + 2f(x_3) + 3f(x_4) + 3f(x_5) + 2f(x_6) + ... + f(x_n)\right] .. \)

Note, we can only use this if n is a multiple of three.

A simplified version of Simpson's rules are used in naval architecture. The 3/8th rule is also called Simpson's Second Rule.
Sample implementation

An implementation of the composite Simpson's rule in Python 3 (Python 2.7 compatible):

#!/usr/bin/env python3
from __future__ import division # Python 2 compatibility

def simpson(f, a, b, n):
"""Approximates the definite integral of f from a to b by the
composite Simpson's rule, using n subintervals (with n even)"""

if n % 2:
raise ValueError("n must be even (received n=%d)" % n)

h = (b - a) / n
s = f(a) + f(b)

for i in range(1, n, 2):
s += 4 * f(a + i * h)
for i in range(2, n-1, 2):
s += 2 * f(a + i * h)

return s * h / 3

# Demonstrate that the method is exact for polynomials up to 3rd order
print(simpson(lambda x:x**3, 0.0, 10.0, 2)) # 2500.0
print(simpson(lambda x:x**3, 0.0, 10.0, 100000)) # 2500.0

print(simpson(lambda x:x**4, 0.0, 10.0, 2)) # 20833.3333333
print(simpson(lambda x:x**4, 0.0, 10.0, 100000)) # 20000.0

See also

Gaussian quadrature
Rectangle method
Trapezoidal rule
Boole's rule

Notes

Atkinson, p. 256; Süli and Mayers, §7.2
Atkinson, equation (5.1.15); Süli and Mayers, Theorem 7.2
Atkinson, pp. 257+258; Süli and Mayers, §7.5
Press (1989), p. 122

Matthews (2004)

References

Atkinson, Kendall E. (1989). An Introduction to Numerical Analysis (2nd ed.). John Wiley & Sons. ISBN 0-471-50023-2.
Burden, Richard L. and Faires, J. Douglas (2000). Numerical Analysis (7th ed.). Brooks/Cole. ISBN 0-534-38216-9.
McCall Pate (1918). The naval artificer's manual: (The naval artificer's handbook revised) text, questions and general information for deck. United States. Bureau of Reconstruction and Repair. p. 198.
Matthews, John H. (2004). "Simpson's 3/8 Rule for Numerical Integration". Numerical Analysis - Numerical Methods Project. California State University, Fullerton. Retrieved 11 November 2008.
Press, William H., Brian P. Flannery, William T. Vetterling, and Saul A. Teukolsky (1989). Numerical Recipes in Pascal: The Art of Scientific Computing. Cambridge University Press. ISBN 0-521-37516-9.
Süli, Endre and Mayers, David (2003). An Introduction to Numerical Analysis. Cambridge University Press. ISBN 0-521-00794-1.
Kaw, Autar; Kalu, Egwu (2008). "Numerical Methods with Applications" (1st ed.). [1]. .
Weisstein, Eric W. (2010). "Newton-Cotes Formulas". MathWorld--A Wolfram Web Resource. MathWorld. Retrieved 2 August 2010.

External links

Hazewinkel, Michiel, ed. (2001), "Simpson formula", Encyclopedia of Mathematics, Springer, ISBN 978-1-55608-010-4
Weisstein, Eric W., "Simpson's Rule", MathWorld.
Simpson's Rule for Numerical Integration
Application of Simpson's Rule — Earthwork Excavation (Note: The formula described in this page is correct but there are errors in the calculation which should give a result of 569m3 and not 623m3 as stated)
Simpson's 1/3rd rule of integration — Notes, PPT, Mathcad, Matlab, Mathematica, Maple at Numerical Methods for STEM undergraduate
A detailed description of a computer implementation is described by Dorai Sitaram in Teach Yourself Scheme in Fixnum Days, Appendix C
C Language Program to Implement Simpson's Rule

This article incorporates material from Code for Simpson's rule on PlanetMath, which is licensed under the Creative Commons Attribution/Share-Alike License.

Mathematics Encyclopedia