The Method of Characteristics & Conservation Laws

Author(s): 
Scott A. Sarra

In this article and its accompanying applet, I introduce the method of characteristics for solving first order partial differential equations (PDEs). First, the method of characteristics is used to solve first order linear PDEs. Next, I apply the method to a first order nonlinear problem, an example of a conservation law, and I discuss why the method may break down for nonlinear problems. I examine difficulties that appear in the nonlinear case, and I introduce the mathematical resolutions of these problems. Concepts dealing with the solutions of nonlinear hyperbolic conservation laws are introduced and explored graphically. However, detailed explanations of such concepts may take up entire textbooks, and the concepts are not explored in detail or with rigor in this short paper. I include References to more detailed material.

Intended Audience

This material is appropriate for undergraduate students in a partial differential equations class, as well as for undergraduate (or graduate) students in mathematics or other sciences who desire a brief and graphical introduction to the solutions of nonlinear hyperbolic conservation laws or to the method of characteristics for first order hyperbolic partial differential equations.

© 2002, Scott A. Sarra
Published February 2003

The Method of Characteristics & Conservation Laws - Abstract

Author(s): 
Scott A. Sarra

In this article and its accompanying applet, I introduce the method of characteristics for solving first order partial differential equations (PDEs). First, the method of characteristics is used to solve first order linear PDEs. Next, I apply the method to a first order nonlinear problem, an example of a conservation law, and I discuss why the method may break down for nonlinear problems. I examine difficulties that appear in the nonlinear case, and I introduce the mathematical resolutions of these problems. Concepts dealing with the solutions of nonlinear hyperbolic conservation laws are introduced and explored graphically. However, detailed explanations of such concepts may take up entire textbooks, and the concepts are not explored in detail or with rigor in this short paper. I include References to more detailed material.

Intended Audience

This material is appropriate for undergraduate students in a partial differential equations class, as well as for undergraduate (or graduate) students in mathematics or other sciences who desire a brief and graphical introduction to the solutions of nonlinear hyperbolic conservation laws or to the method of characteristics for first order hyperbolic partial differential equations.

© 2002, Scott A. Sarra
Published February 2003

The Method of Characteristics & Conservation Laws - The Method of Characteristics

Author(s): 
Scott A. Sarra

The method of characteristics is a method that can be used to solve the initial value problem (IVP) for general first order PDEs. Consider the first order linear PDE

first order pde   (1)

in two variables along with the initial condition {initial condition}. The goal of the method of characteristics, when applied to this equation, is to change coordinates from (x, t) to a new coordinate system in which the PDE becomes an ordinary differential equation (ODE) along certain curves in the x-t plane. Such curves, characteristic curves, along which the solution of the PDE reduces to an ODE, are called the characteristic curves or just the characteristics. The new variable s will vary, and the new variable will be constant along the characteristics. The variable will change along the initial curve in the x-t plane (along the line t = 0). How do we find the characteristic curves? Notice that if we choose

characteristic ODE   (2a)

and

characteristic ODE   (2b)

then we have

,

and along the characteristic curves, the PDE becomes the ODE

ode(3)

Equations (2a) and (2b) will be referred to as the characteristic equations.

General Strategy

Here is the general strategy for applying the method of characteristics to a PDE of the form (1).

  • Step 1. Solve the two characteristic equations, (2a) and (2b). Find the constants of integration by setting (these will be points along the t = 0 axis in the x-t plane) and t(0)=0. We now have the transformation from to , and .
  • Step 2. Solve the ODE (3) with initial condition , where are the initial points on the characteristic curves along the t = 0 axis in the x-t plane.
  • Step 3. We now have a solution . Solve for s and in terms of x and t (using the results of Step 1), and substitute these values in to get the solution to the original PDE as .

The Method of Characteristics & Conservation Laws - Special Case: \(b(x, t) = 1\) and \(c(x, t) = 0\)

Author(s): 
Scott A. Sarra

We will examine the method of characteristics for three different PDEs:

For all three examples, the initial conditions are specified as . The examples take a slightly simpler form than the general equation (1). All three examples have b(x,t) = 1 and c(x,t) = 0. In this case characteristic equation (2b) becomes {short description of image},.and the solution is t = s+ k. Using the initial condition t(0) = 0, we determine that the constant is k = 0, so s = t. In this special case with b(x,t) = 1, we only have one characteristic equation to solve. Before proceeding to the examples, we restate the general strategy in terms of this special case.

  • Step1. Solve the characteristic equation (2a),with the initial condition .
  • Step 2. Solve the ODE (3), which in this case simplifies to , with initial condition .
  • Step 3. We now have a solution . Solve for in terms of x and t, using the results of Step 1, and substitute for in to get the solution to the original PDE as .

Constant Coefficient Advection Equation

The advection equation is the PDE

,   (4)

where a is a real constant, the wave speed or velocity of propagation. This is the rate at which the solution will propagate along the characteristics. The velocity is constant, so all points on the solution profile will move at the same speed a.

Now we apply the method of characteristics outlined in the 3 steps above.

  • Step 1. The characteristic equation (2a) to solve is with the initial condition . The solution gives the characteristic curves, where is the point at which each curve intersects the x-axis in the x-t plane.
  • Step 2. Solve equation (3), , with initial condition . The solution is .
  • Step 3. The characteristic curves are determined by , so , and the solution of the PDE is .

To verify that does indeed remain constant along the characteristics, we differentiate along one of these curves to find the rate of change of u along the characteristic:

So we find that the rate of change is zero, verifying that u is constant along the curve.

By writing the characteristic curves as , we see that, in the x-t plane, the characteristics are parallel lines with slope 1/a, so the slope of the characteristics depends only on the constant a.

Experiment in the applet with different values of the wave speed a, which can be changed through the dialog box displayed when the parameters button is pressed. Set to observe the solution profile moving in the opposite direction, and observe the negative slope of the characteristics.

Variable Coefficient Advection Equation

The variable coefficient advection equation is

.    (5)

For this example, we take , so the wave speed depends on the spatial coordinate x. That is, the speed of a point on the solution profile will depend on the horizontal coordinate x of the point.

  • Step 1. The characteristic equation (2a) is with the initial condition . Thus the characteristic curves are .
  • Step 2. The solution of equation (3), with initial condition , is .
  • Step 3. The characteristic curves are determined by , so , and the solution of the PDE in the original variables is .

View the variable coefficient advection equation simulation in the applet. Notice that the characteristics are not straight lines. Also observe that the characteristics do not intersect.

 

The Method of Characteristics & Conservation Laws - Conservation Laws

Author(s): 
Scott A. Sarra

A very important class of partial differential equations is that of conservation laws. As their name indicates, they include those equations that model the conservation laws of physics: mass, momentum, energy, etc. A scalar conservation law in one space dimension has the form

,    (6)

where F(u) is a flux function. In general, conservation laws are nonlinear. For a derivation of the conservation law (6), the interested reader may consult [2, p. 31] or [3, p. 75]. We will use the method of characteristics to examine a one dimensional scalar conservation law, inviscid Burgers' equation, which takes the form of a nonlinear first order PDE. Inviscid Burgers' equation will have .

Inviscid Burgers' Equation

The inviscid Burgers' equation is or, equivalently, . The wave speed depends on the solution, . That is, the speed of a point on the solution profile will depend on the vertical coordinate u of the point. Inviscid Burgers' equation is not of the form of the linear first order PDE (1), as it is nonlinear, so our earlier analysis do not apply directly. However, from our experience with the constant coefficient (4) and variable coefficient (5) advection equations, we are led to set the characteristic equation to be . If x(t) is a solution of this equation, then u(x(t),t) is the restriction of u to this curve. Also, along this curve,

Thus, this solution u(x(t),t) will not change with time along the curve, so it is a characteristic curve. If we know the initial condition , we can find the characteristic curve by substituting this value into the characteristic equation . The right hand side of the equation is constant, indicating that the characteristic curves will be straight lines, as in the constant coefficient advection equation case. Specifically, the characteristic curve is . The solution of the initial value problem can be written as . The solution is given implicitly and, in all but the simplest cases, it is impossible to determine the solution explicitly. The characteristics are straight lines, but the lines do not all have the same slope, so it is possible for the characteristics to intersect. If we write the characteristics as , we see that in the x-t plane they are lines with slope . The slopes of the characteristics depend on the point and on the initial data.

Unlike the first two examples, it is possible for the characteristics to intersect. If the initial data is smooth, then the method of characteristics can be used to determine the solution for small enough t such that the characteristics do not intersect. For larger t, after characteristics have intersected, the PDE will fail to have a classical solution -- that is, a single-valued solution or a function -- as the information obtained by following the characteristics will produce a multivalued solution or, possibly, no solution at all. To overcome this lack of existence of a classical solution, we must introduce a broader notion of a solution, a weak solution. Roughly speaking, a weak solution may contain discontinuities, may not be differentiable, and will require less smoothness to be considered a solution than a classical solution. Working with the weak solution of a PDE usually requires that the PDE be reformulated in an integral form. If a classical solution to the problem exists, it will also satisfy the definition of a weak solution.

If the characteristics on both sides of a discontinuity of a piecewise continuous weak solution impinge on the discontinuity curve in the direction of increasing t, the weak solution is called a shock. For inviscid Burgers' equation, the time at which the characteristics cross and a shock forms, the "breaking" time, can be determined exactly as [1, p. 25]. The formula can be used if the equation has smooth initial data (so that it is differentiable). From the formula for , we can see that the solution will break and a shock will form if is negative at some point. The discontinuous weak solution, in this case a shock wave, will travel at a speed given by the Rankine-Hugoniot condition (see [1, p. 31] and [2, p. 46]). For inviscid Burgers' equation, the shock speed s is given by , where is the value of u on the left side of a discontinuity and is the value of u on the right side of the discontinuity. In addition to characteristics crossing and a shock forming, there is another way the method of characteristics can break down and a discontinuity can form: The characteristics on both sides of the discontinuity can emanate from it, rather than go into it. In this case the discontinuity is called a rarefaction wave. (See the applet simulation and rarefaction example below.)

If we expand our class of solutions to include weak solutions, we no longer have uniqueness of the solution of the initial value problem, and we need an additional criterion for selecting the physically correct weak solution. This selection criterion is called an entropy condition. A different method for picking out the physically correct weak solution, but one that picks of the same weak solution as the entropy condition, is a vanishing viscosity approach.

For inviscid Burgers' equation, vanishing viscosity amounts to finding solutions to Burgers' equation, , in the limit as . A graphical technique for constructing weak solutions for problems with shocks is the equal area rule ([4, p. 42] and [1, p. 34]). Application of the equal area rule starts with the multivalued solution constructed by using the method of characteristics and then eliminates the multivalued parts by inserting shocks in a way that eliminates the multivalued solution but keeps the area under the curve the same. The equal area rule is a result of conservation. The integral of the discontinuous weak solution must be the same as the integral of the multivalued solution.

equal area image

In the figure above, the red area is subtracted from the multivalued solution and the blue area is added. The sum of the blue and unshaded areas then makes up the weak solution. In the applet, observe in the shock problems for inviscid Burgers' equation how the plotted weak solutions appear to be applying this equal area rule to the multivalued solutions produced by the method of characteristics.

Numerical Methods for Conservation Laws

For inviscid Burgers' equation with piecewise constant initial data, we can find a formula for the weak solution. For more complicated initial data, this will most likely not be the case. Asymptotic formulas (accurate in the limit as -- see [4]) for the weak solutions to problems may exist but are of little use computationally. Thus, numerical methods that are capable of producing good approximations to the exact entropy-satisfying weak solution are important. In general, numerical methods for nonlinear hyperbolic conservation laws are more complicated and difficult to develop than numerical methods for elliptic and parabolic PDEs. For the inviscid Burgers' problem with sine wave, N-wave, and single hump initial data, the applet uses a numerical method called Roe's method to approximate the exact entropy-satisfying weak solution. This is a second order non-oscillatory finite difference method that employs the used of a flux limiter (the Superbee limiter) to suppress numerical oscillations. In the applet simulations that calculate the weak solutions by the numerical method, the ratio must be kept below a certain threshold, or the method will become unstable and the numerical approximations will blow up. The interested reader should consult references [1] and [3] for details.

Inviscid Burgers' equation example problems

The following initial conditions for inviscid Burgers' equation are coded in the applet. The first two problems are Riemann problems, i.e., they have piecewise constant initial data with one discontinuity.

Riemann problem - shock

This problem has an initial condition . The characteristics intersect, and a shock forms immediately for > 0. The exact entropy-satisfying weak solution is , where the shock speed is given by . The exact weak solution is plotted in the applet. This problem is discussed in detail in references [1 p. 28], and [3, p. 82].

Riemann problem - rarefaction

The initial condition produces characteristics (see the image below and the applet) such that there is no characteristic information available in some regions of the x-t plane.

rarefaction

A entropy-violating weak solution is , where s is the same as in the Riemann shock problem above. This solution corresponds to filling in the missing characteristic information as shown in red below.

entropy violating

For this problem, it can be shown that infinitely many weak solution exists [1, p. 30].

A entropy-satisfying weak solution is . This solution corresponds to filling in the missing characteristic information as shown in red in the image below.

entropy satisfying

This problem is discussed in detail in [1 p. 28] and [3, p. 82].

Sine

The initial condition is . Notice that has a minimum value of . Thus, the breaking time will be , approximately t = 0.16. This problem is discussed in detail in [3, p. 77]. The weak solution is computed by using Roe's method.

N-wave

The initial condition is . The solution consists of both a left and right moving shock. The weak solution is computed by using Roe's method. This problem is discussed in detail in [4, p. 48] and in [1, p. 32]

Single hump

The initial condition is . The solutions consist of one right-moving shock. The weak solution is computed by using Roe's method. This problem is discussed in detail in [4, p. 46].

The Method of Characteristics & Conservation Laws - The Shock Applet

Author(s): 
Scott A. Sarra

Use of the applet requires the Java 1.4 browser plug-in. If this plug-in is not already installed on your computer, the web page should direct you to the site where you can freely download and install it. If the script does not direct you to the plug-in, follow this link.

The applet provides two views. The window on the left shows the initial condition advancing in time, while the window on the right shows the data advancing along the characteristics in the x-t plane.

Select one of the three example from the equations menu:

  • the advection equation,
  • the variable coefficient advection equation, or
  • inviscid Burgers' equation.

The inviscid Burgers' equation option has five submenus corresponding to five different initial conditions. Press the go button to start the animation, the stop button to stop the animation, and the reset button to return to the initial conditions. For inviscid Burgers' equation, the applet can plot the weak solution (as a solid black curve) to the problem. This option may be turned on by checking it on the options menu.

Pressing the parameters button pops up a dialog that allows five parameters to be changed by the user:

  • dX -- Controls the spacing between characteristics on the x axis.
  • dT-- Step size for time advancement. Set dT smaller to slow down the animation or to observe advancement in smaller increments along the characteristics.
  • final t -- The time at which the animation stops.
  • speed -- Animation speed. The number represents delay in milliseconds. Speed = 0 represents no delay, the fastest animation rate.
  • a - The constant advection speed in the advection equation example.

The Method of Characteristics & Conservation Laws - Resources

Author(s): 
Scott A. Sarra

References

  1. R. LeVeque, Numerical Methods for Conservation Laws. Birkhauser, 1992.
  2. J. Cooper, Introduction to Partial Differential Equations with MATLAB. Birkhauser, 1998.
  3. J. Thomas, Numerical Partial Differential Equations: Conservation Laws and Elliptic Equations, Springer, 1999.
  4. G. B. Whitham, Linear and Nonlinear Waves, Wiley, 1974.
  5. S. J. Farlow, Partial Differential Equations for Scientists and Engineers, Dover Publications, 1982.
  6. Gilbert Strang, Introduction to Applied Mathematics, Wellesley-Cambridge Press, 1986.
  7. Fritz John, Partial Differential Equations, 4th edition. Springer, 1982.

Links

  1. Conservation Law Preprint Server -- Current research papers
  2. Clawpack -- A software package designed to compute numerical solutions to hyperbolic partial differential equations (conservation laws)