Beta Phase: Square45 is currently in beta testing. Expect some features or content to be incomplete or missing.
45

Integration Theory (Lebesgue)

Field: Real Analysis

A theory of integration that generalizes the Riemann integral to a wider class of functions.

Sequence of Expressions

The integral of a positive real function f between boundaries a and b can be interpreted as the area under the graph of f, between a and b. This notion of area fits some functions, mainly piecewise continuous functions, including elementary functions, for example polynomials. However, the graphs of other functions, for example the Dirichlet function, do not fit well with the notion of area. Graphs like that of the latter, raise the question: for which class of functions does "area under the curve" make sense? The answer to this question has great theoretical importance. As part of a general movement toward rigor in mathematics in the nineteenth century, mathematicians attempted to put integral calculus on a firm foundation. The Riemann integral—proposed by Bernhard Riemann (1826–1866)—is a broadly successful attempt to provide such a foundation. Riemann's definition starts with the construction of a sequence of easily calculated areas that converge to the integral of a given function. This definition is successful in the sense that it gives the expected answer for many already-solved problems, and gives useful results for many other problems. However, Riemann integration does not interact well with taking limits of sequences of functions, making such limiting processes difficult to analyze. This is important, for instance, in the study of Fourier series, Fourier transforms, and other topics. The Lebesgue integral describes better how and when it is possible to take limits under the integral sign (via the monotone convergence theorem and dominated convergence theorem). While the Riemann integral considers the area under a curve as made out of vertical rectangles, the Lebesgue definition considers horizontal slabs that are not necessarily just rectangles, and so it is more flexible. For this reason, the Lebesgue definition makes it possible to calculate integrals for a broader class of functions. For example, the Dirichlet function, which is 1 where its argument is rational and 0 otherwise, has a Lebesgue integral, but does not have a Riemann integral. Furthermore, the Lebesgue integral of this function is zero, which agrees with the intuition that when picking a real number uniformly at random from the unit interval, the probability of picking a rational number should be zero. Lebesgue summarized his approach to integration in a letter to Paul Montel: I have to pay a certain sum, which I have collected in my pocket. I take the bills and coins out of my pocket and give them to the creditor in the order I find them until I have reached the total sum. This is the Riemann integral. But I can proceed differently. After I have taken all the money out of my pocket I order the bills and coins according to identical values and then I pay the several heaps one after the other to the creditor. This is my integral. — Source: (Siegmund-Schultze 2008) The insight is that one should be able to rearrange the values of a function freely, while preserving the value of the integral. This process of rearrangement can convert a very pathological function into one that is "nice" from the point of view of integration, and thus let such pathological functions be integrated. A measurable function is shown, together with the set {x : f(x) > t} (on the x-axis). The Lebesgue integral is obtained by slicing along the y-axis, using the 1-dimensional Lebesgue measure to measure the "width" of the slices. Folland (1999) summarizes the difference between the Riemann and Lebesgue approaches thus: "to compute the Riemann integral of f, one partitions the domain [a, b] into subintervals", while in the Lebesgue integral, "one is in effect partitioning the range of f". For the Riemann integral, the domain is partitioned into intervals, and bars are constructed to meet the height of the graph. The areas of these bars are added together, and this approximates the integral, in effect by summing areas of the form f(x)dx where f(x) is the height of a rectangle and dx is its width. For the Lebesgue integral, the range is partitioned into intervals, and so the region under the graph is partitioned into horizontal "slabs" (which may not be connected sets). The area of a small horizontal "slab" under the graph of f, of height dy, is equal to the measure of the slab's width times dy: μ({x∣f(x)>y}) dy.\mu \left(\{x\mid f(x)>y\}\right)\,dy. The Lebesgue integral may then be defined by adding up the areas of these horizontal slabs. From this perspective, a key difference with the Riemann integral is that the "slabs" are no longer rectangular (cartesian products of two intervals), but instead are cartesian products of a measurable set with an interval. Riemannian (top) vs. Lebesgue (bottom) integration of smoothed COVID-19 daily case data from Serbia (Summer-Fall 2021) An equivalent way to introduce the Lebesgue integral is to use so-called simple functions, which generalize the step functions of Riemann integration. Consider, for example, determining the cumulative COVID-19 case count from a graph of smoothed cases each day (right). The Riemann–Darboux approach Partition the domain (time period) into intervals (eight, in the example) and construct bars with heights that meet the graph. The cumulative count is found by summing, over all bars, the product of interval width (time in days) and the bar height (cases per day).The Lebesgue approach Choose a finite number of target values (eight, in the example) in the range of the function. By constructing bars with heights equal to these values, but below the function, they imply a partitioning of the domain into the same number of subsets (subsets, indicated by color in the example, need not be connected). This is a "simple function", as described below. The cumulative count is found by summing, over all subsets of the domain, the product of the measure on that subset (total time in days) and the bar height (cases per day). One can think of the Lebesgue integral either in terms of slabs or simple functions. Intuitively, the area under a simple function can be partitioned into slabs based on the (finite) collection of values in the range of a simple function (a real interval). Conversely, the (finite) collection of slabs in the undergraph of the function can be rearranged after a finite repartitioning to be the undergraph of a simple function. The slabs viewpoint makes it easy to define the Lebesgue integral, in terms of basic calculus. Suppose that f is a (Lebesgue measurable) function, taking non-negative values (possibly including +∞). Define the distribution function of f as the "width of a slab", i.e., F(y)=μ{x∣f(x)>y}.F(y)=\mu \{x|f(x)>y\}. Then F(y) is monotone decreasing and non-negative, and therefore has an (improper) Riemann integral over (0, ∞), allowing that the integral can be +∞. The Lebesgue integral can then be defined by ∫f dμ=∫0∞F(y) dy\int f\,d\mu =\int _{0}^{\infty }F(y)\,dy where the integral on the right is an ordinary improper Riemann integral, of a non-negative function (interpreted appropriately as +∞ if F(y) = +∞ on a neighborhood of 0). Most textbooks, however, emphasize the simple functions viewpoint, because it is then more straightforward to prove the basic theorems about the Lebesgue integral. Measure theory was initially created to provide a useful abstraction of the notion of length of subsets of the real line—and, more generally, area and volume of subsets of Euclidean spaces. In particular, it provided a systematic answer to the question of which subsets of R have a length. As later set theory developments showed (see non-measurable set), it is actually impossible to assign a length to all subsets of R in a way that preserves some natural additivity and translation invariance properties. This suggests that picking out a suitable class of measurable subsets is an essential prerequisite. The Riemann integral uses the notion of length explicitly. Indeed, the element of calculation for the Riemann integral is the rectangle [a, b] × [c, d], whose area is calculated to be (b − a)(d − c). The quantity b − a is the length of the base of the rectangle and d − c is the height of the rectangle. Riemann could only use planar rectangles to approximate the area under the curve, because there was no adequate theory for measuring more general sets. In the development of the theory in most modern textbooks (after 1950), the approach to measure and integration is axiomatic. This means that a measure is any function μ defined on a certain class X of subsets of a set E, which satisfies a certain list of properties. These properties can be shown to hold in many different cases. We start with a measure space(E, X, μ) where E is a set, X is a σ-algebra of subsets of E, and μ is a (non-negative) measure on E defined on the sets of X. For example, E can be Euclidean n-spaceR^{n} or some Lebesgue measurable subset of it, X is the σ-algebra of all Lebesgue measurable subsets of E, and μ is the Lebesgue measure. In the mathematical theory of probability, we confine our study to a probability measure μ, which satisfies μ(E) = 1. Lebesgue's theory defines integrals for a class of functions called measurable functions. A real-valued function f on E is measurable if the pre-image of every interval of the form (t, ∞) is in X: {x ∣ f(x)>t}∈X∀t∈R.\{x\,\mid \,f(x)>t\}\in X\quad \forall t\in \mathbb {R} . We can show that this is equivalent to requiring that the pre-image of any Borel subset of R be in X. The set of measurable functions is closed under algebraic operations, but more importantly it is closed under various kinds of point-wise sequential limits: sup⁡k∈Nfk,lim inf⁡k∈Nfk,lim sup⁡k∈Nfk\sup _{k\in \mathbb {N} }f_{k},\quad \liminf _{k\in \mathbb {N} }f_{k},\quad \limsup _{k\in \mathbb {N} }f_{k} are measurable if the original sequence (f_{k}), where k ∈ N, consists of measurable functions. There are several approaches for defining an integral for measurable real-valued functions f defined on E, and several notations are used to denote such an integral. ∫Ef dμ=∫Ef(x) dμ(x)=∫Ef(x) μ(dx).\int _{E}f\,d\mu =\int _{E}f(x)\,d\mu (x)=\int _{E}f(x)\,\mu (dx). Following the identification in Distribution theory of measures with distributions of order 0, or with Radon measures, one can also use a dual pair notation and write the integral with respect to μ in the form ⟨μ,f⟩.\langle \mu ,f\rangle .
Definition

Definition

The theory of the Lebesgue integral requires a theory of measurable sets and measures on these sets, as well as a theory of measurable functions and integrals on these functions. Approximating a function by a simple function. One approach to constructing the Lebesgue integral is to make use of so-called simple functions: finite, real linear combinations of indicator functions. Simple functions that lie directly underneath a given function f can be constructed by partitioning the range of f into a finite number of layers. The intersection of the graph of f with a layer identifies a set of intervals in the domain of f, which, taken together, is defined to be the preimage of the lower bound of that layer, under the simple function. In this way, the partitioning of the range of f implies a partitioning of its domain. The integral of a simple function is found by summing, over these (not necessarily connected) subsets of the domain, the product of the measure of the subset and its image under the simple function (the lower bound of the corresponding layer); intuitively, this product is the sum of the areas of all bars of the same height. The integral of a non-negative general measurable function is then defined as an appropriate supremum of approximations by simple functions, and the integral of a (not necessarily positive) measurable function is the difference of two integrals of non-negative measurable functions. To assign a value to the integral of the indicator function1_{S} of a measurable set S consistent with the given measureμ, the only reasonable choice is to set: ∫1S dμ=μ(S).\int 1_{S}\,d\mu =\mu (S). Notice that the result may be equal to +∞, unless μ is a finite measure. A finite linear combination of indicator functions ∑kak1Sk\sum _{k}a_{k}1_{S_{k}} where the coefficients a_{k} are real numbers and S_{k} are disjoint measurable sets, is called a measurable simple function. We extend the integral by linearity to non-negative measurable simple functions. When the coefficients a_{k} are positive, we set ∫(∑kak1Sk) dμ=∑kak∫1Sk dμ=∑kak μ(Sk)\int \left(\sum _{k}a_{k}1_{S_{k}}\right)\,d\mu =\sum _{k}a_{k}\int 1_{S_{k}}\,d\mu =\sum _{k}a_{k}\,\mu (S_{k}) whether this sum is finite or +∞. A simple function can be written in different ways as a linear combination of indicator functions, but the integral will be the same by the additivity of measures. Some care is needed when defining the integral of a real-valued simple function, to avoid the undefined expression ∞ − ∞: one assumes that the representation f=∑kak1Skf=\sum _{k}a_{k}1_{S_{k}} is such that μ(S_{k}) < ∞ whenever a_{k} ≠ 0. Then the above formula for the integral of f makes sense, and the result does not depend upon the particular representation of f satisfying the assumptions. (It is important that the representation be a finite linear combination, i.e. that k only take on a finite number of values.) If B is a measurable subset of E and s is a measurable simple function one defines ∫Bs dμ=∫1B s dμ=∑kak μ(Sk∩B).\int _{B}s\,\mathrm {d} \mu =\int 1_{B}\,s\,\mathrm {d} \mu =\sum _{k}a_{k}\,\mu (S_{k}\cap B). Let f be a non-negative measurable function on E, which we allow to attain the value +∞, in other words, f takes non-negative values in the extended real number line. We define ∫Ef dμ=sup⁡{ ∫Es dμ:0≤s≤f, s simple }.\int _{E}f\,d\mu =\sup \left\{\,\int _{E}s\,d\mu :0\leq s\leq f,\ s\ {\text{simple}}\,\right\}. We need to show this integral coincides with the preceding one, defined on the set of simple functions, when E is a segment [a, b]. There is also the question of whether this corresponds in any way to a Riemann notion of integration. It is possible to prove that the answer to both questions is yes. We have defined the integral of f for any non-negative extended real-valued measurable function on E. For some functions, this integral ∫Ef dμ{\textstyle \int _{E}f\,d\mu } is infinite. It is often useful to have a particular sequence of simple functions that approximates the Lebesgue integral well (analogously to a Riemann sum). For a non-negative measurable function f, let s_{n}(x) be the simple function whose value is k/2^{n} whenever k/2^{n} ≤ f(x) < (k + 1)/2^{n}, for k a non-negative integer less than, say, 4^{n}. Then it can be proven directly that ∫f dμ=lim⁡n→∞∫sn dμ\int f\,d\mu =\lim _{n\to \infty }\int s_{n}\,d\mu and that the limit on the right hand side exists as an extended real number. This bridges the connection between the approach to the Lebesgue integral using simple functions, and the motivation for the Lebesgue integral using a partition of the range. To handle signed functions, we need a few more definitions. If f is a measurable function of the set E to the reals (including ±∞), then we can write f=f+−f−,f=f^{+}-f^{-}, where f+(x)={f(x)−if f(x)>0,0otherwise,f−(x)={−f(x)if f(x)<0,0otherwise.{\begin{aligned}f^{+}(x)&={\begin{cases}f(x){\hphantom {-}}&{\text{if }}f(x)>0,\\0&{\text{otherwise}},\end{cases}}\\f^{-}(x)&={\begin{cases}-f(x)&{\text{if }}f(x)<0,\\0&{\text{otherwise}}.\end{cases}}\end{aligned}} Note that both f^{+} and f^{−} are non-negative measurable functions. Also note that ∣f∣=f++f−.|f|=f^{+}+f^{-}. We say that the Lebesgue integral of the measurable function fexists, or is defined if at least one of ∫f+ dμ{\textstyle \int f^{+}\,d\mu } and ∫f− dμ{\textstyle \int f^{-}\,d\mu } is finite: min⁡(∫f+ dμ,∫f− dμ)<∞.\min \left(\int f^{+}\,d\mu ,\int f^{-}\,d\mu \right)<\infty . In this case we define ∫f dμ=∫f+ dμ−∫f− dμ.\int f\,d\mu =\int f^{+}\,d\mu -\int f^{-}\,d\mu . If ∫∣f∣ dμ<∞,\int |f|\,\mathrm {d} \mu <\infty , we say that f is Lebesgue integrable. That is, f belongs to the space L^{1}. It turns out that this definition gives the desirable properties of the integral. Assuming that f is measurable and non-negative, the function f∗(t) =def μ({x∈E∣f(x)>t}).f^{*}(t)\ {\stackrel {\text{def}}{=}}\ \mu \left(\{x\in E\mid f(x)>t\}\right). is monotonically non-increasing. The Lebesgue integral may then be defined as the improper Riemann integral of f^{∗}: ∫Ef dμ =def ∫0∞f∗(t) dt.\int _{E}f\,d\mu \ {\stackrel {\text{def}}{=}}\ \int _{0}^{\infty }f^{*}(t)\,dt. This integral is improper at the upper limit of ∞, and possibly also at zero. It exists, with the allowance that it may be infinite. As above, the integral of a Lebesgue integrable (not necessarily non-negative) function is defined by subtracting the integral of its positive and negative parts. Complex-valued functions can be similarly integrated, by considering the real part and the imaginary part separately. If h = f + ig for real-valued integrable functions f, g, then the integral of h is defined by ∫h dμ=∫f dμ+i∫g dμ.\int h\,d\mu =\int f\,d\mu +i\int g\,d\mu . The function is Lebesgue integrable if and only if its absolute value is Lebesgue integrable (see Absolutely integrable function). - ^This approach can be found in most treatments of measure and integration, such as Royden (1988). - ^Lemma 1 of page 76 of the second edition of Royden, Real Analysis. - ^ However, L^{1} is not "the space of Lebesgue integrable functions" but rather the space of equivalence classes of functions. - ^Lieb & Loss 2001 - ^If f^{∗} is infinite at an interior point of the domain, then the integral must be taken to be infinity. Otherwise f^{∗} is finite everywhere on (0, +∞), and hence bounded on every finite interval [a, b], where a > 0. Therefore the improper Riemann integral (whether finite or infinite) is well defined. - ^Equivalently, one could have defined f∗(t) = μ({x∈E∣f(x)≥t}),f^{*}(t)\ =\ \mu \left(\{x\in E\mid f(x)\geq t\}\right), since μ({x∈E∣f(x)≥t})=μ({x∈E∣f(x)>t})\mu \left(\{x\in E\mid f(x)\geq t\}\right)=\mu \left(\{x\in E\mid f(x)>t\}\right) for almost all ⁠ tt ⁠. - ^Rudin 1966
Let (Ω,F,μ)(\Omega, \mathcal{F}, \mu) be a complete measure space. Consider a sequence of measurable functions fn:Ω→[0,∞]f_n: \Omega \to [0, \infty] such that fn→ff_n \to f pointwise almost everywhere (a.e.).\n\n1. **Monotone Convergence Theorem (MCT):** If the sequence (fn)(f_n) is non-decreasing, i.e., 0≤f1≤f2≤…0 \le f_1 \le f_2 \le \dots a.e., then the limit function f=lim⁡n→∞fnf = \lim_{n\to\infty} f_n is measurable, and its integral is given by:\nlim⁡n→∞∫Ωfn dμ=∫Ωlim⁡n→∞fn dμ=∫Ωf dμ\lim_{n\to\infty} \int_{\Omega} f_n \, d\mu = \int_{\Omega} \lim_{n\to\infty} f_n \, d\mu = \int_{\Omega} f \, d\mu\n\n2. **Fatou's Lemma:** For any sequence of non-negative measurable functions (fn)(f_n), the following inequality holds:\n∫Ωlim inf⁡n→∞fn dμ≤lim inf⁡n→∞∫Ωfn dμ\int_{\Omega} \liminf_{n\to\infty} f_n \, d\mu \le \liminf_{n\to\infty} \int_{\Omega} f_n \, d\mu\n\n3. **Dominated Convergence Theorem (DCT):** If there exists a non-negative integrable function g∈L1(μ)g \in L^1(\mu) (the dominating function) such that ∣fn∣≤g|f_n| \le g a.e. for all nn, and fn→ff_n \to f pointwise a.e., then ff is integrable, and the limit and integral commute:\nlim⁡n→∞∫Ωfn dμ=∫Ωlim⁡n→∞fn dμ=∫Ωf dμ\lim_{n\to\infty} \int_{\Omega} f_n \, d\mu = \int_{\Omega} \lim_{n\to\infty} f_n \, d\mu = \int_{\Omega} f \, d\mu
It is possible to develop the integral with respect to the Lebesgue measure without relying on the full machinery of measure theory. One such approach is provided by the Daniell integral. There is also an alternative approach to developing the theory of integration via methods of functional analysis. The Riemann integral exists for any continuous function f of compactsupport defined on R^{n} (or a fixed open subset). Integrals of more general functions can be built starting from these integrals. Let C_{c} be the space of all real-valued compactly supported continuous functions of R. Define a norm on C_{c} by ∥f∥=∫∣f(x)∣ dx.\left\|f\right\|=\int |f(x)|\,dx. Then C_{c} is a normed vector space (and in particular, it is a metric space.) All metric spaces have Hausdorff completions, so let L^{1} be its completion. This space is isomorphic to the space of Lebesgue integrable functions modulo the subspace of functions with integral zero. Furthermore, the Riemann integral ∫ is a uniformly continuous functional with respect to the norm on C_{c}, which is dense in L^{1}. Hence ∫ has a unique extension to all of L^{1}. This integral is precisely the Lebesgue integral. More generally, when the measure space on which the functions are defined is also a locally compacttopological space (as is the case with the real numbers R), measures compatible with the topology in a suitable sense (Radon measures, of which the Lebesgue measure is an example) an integral with respect to them can be defined in the same manner, starting from the integrals of continuous functions with compact support. More precisely, the compactly supported functions form a vector space that carries a natural topology, and a (Radon) measure is defined as a continuous linear functional on this space. The value of a measure at a compactly supported function is then also by definition the integral of the function. One then proceeds to expand the measure (the integral) to more general functions by continuity, and defines the measure of a set as the integral of its indicator function. This is the approach taken by Nicolas Bourbaki and a certain number of other authors. For details see Radon measures. - ^Bourbaki 2004.
Let (X,M,μ)(X, \mathcal{M}, \mu) be a complete measure space. For a measurable function f:X→Rf: X \to \mathbb{R}, we define the positive and negative parts of ff as f+=max⁡(f,0)f^+ = \max(f, 0) and f−=max⁡(−f,0)f^- = \max(-f, 0). The integral of ff with respect to the measure μ\mu, denoted ∫fdμ\int f d\mu, is defined by the following steps:\n\n1. **Simple Functions:** For a non-negative simple function ϕ=∑i=1naiχAi\phi = \sum_{i=1}^{n} a_i \chi_{A_i}, where ai≥0a_i \ge 0 are constants and Ai∈MA_i \in \mathcal{M}, the integral is defined as: \int \phi d\mu = \sum_{i=1}^{n} a_i \mu(A_i).\n2. **Non-negative Measurable Functions:** For any non-negative measurable function f: X \to [0, \infty],theLebesgueintegralisdefinedasthesupremumoverallsimplefunctions, the Lebesgue integral is defined as the supremum over all simple functions \phisuchthat such that 0 \le \phi \le f: \int f d\mu = \sup \left\{ \int \phi d\mu \mid \phi \text{ is simple and } 0 \le \phi \le f \right\}.\n3. **General Measurable Functions:** For a general measurable function f,theintegralisdefinedas:∫fdμ=∫f+dμ−∫f−dμ, the integral is defined as: \int f d\mu = \int f^+ d\mu - \int f^- d\mu. \n\nThis definition ensures that the integral is countably additive and satisfies the Monotone Convergence Theorem (MCT) and the Dominated Convergence Theorem (DCT).
Intermediate
Differentiation and integration are inverse operations.\nddx∫axf(t) dt=f(x)\frac{d}{dx} \int_a^x f(t) \, dt = f(x)