How to Understand Calculus: A Beginner's Guide to Limits and Differentiation

Calculus is a study of rates of change of functions and accumulation of infinitesimally small quantities. It can be broadly divided into two branches:

• Differential Calculus. This concerns rates of changes of quantities and slopes of curves or surfaces in 2D or multidimensional space.
• Integral Calculus. This involves summing infinitesimally small quantities.

In this first part of a two part tutorial you will learn about:

• Limits of a function
• How the derivative of a function is derived
• Rules of differentiation
• Derivatives of common functions
• What the derivative of a function means
• Working out derivatives from first principles
• 2nd and higher order derivatives
• Applications of differential calculus
• Worked examples

Calculus was invented by the English mathematician, physicist and astronomer Isaac Newton and German mathematician Gottfried Wilhelm Leibniz independently of each other in the 17th century.

Calculus is used widely in mathematics, science, in the various fields of engineering and economics.

To understand calculus, we first need to grasp the concept of limits of a function.

Imagine we have a continuous line function with the equation f(x) = x + 1 as in the graph below.

The value of f(x) is simply the value of the x coordinate plus 1.

The function is continuous which means that f(x) has a value that corresponds to all values of x, not just the integers ....-2, -1, 0, 1, 2, 3.... and so on, but all the intervening real numbers. I.e. decimals numbers like 7.23452, and irrational numbers like π, and √3.

So if x = 0, f(x) = 1

if x = 2, f(x) = 3

if x = 2.3, f(x) = 3.3

if x = 3.1, f(x) = 4.1 and so on.

Let's concentrate on the value x =3, f(x) = 4.

As x gets closer and closer to 3, f(x) gets closer and closer to 4.

So we could make x = 2.999999 and f(x) would be 3.999999.

We can make f(x) as close to 4 as we want. In fact we can choose any arbitrarily small difference between f(x) and 4 and there will be a correspondingly small difference between x and 3. But there will always be a smaller distance between x and 3 that produces a value of f(x) closer to 4.

Referring to the graph again, the limit of f(x) at x = 3 is the value f(x) approaches as x gets closer to 3. Not the value of f(x) at x=3, but the value it approaches. As we'll see later, the value of a function f(x) may not exist at a certain value of x, or it may be undefined.

The (ε, δ) Cauchy definition of a limit:

The formal definition of a limit was specified by the mathematicians Augustin-Louis Cauchy and Karl Weierstrass

Let f(x) be a function defined on a subset D of the real numbers R.

c is a point of the set D. ( The value of f(x) at x = c may not necessarily exist)

L is a real number.

Then:

lim f(x) = L
x → c

exists if:

• Firstly for every arbritarily small distance ε > 0 there exists a value δ such that, for all x belonging to D and 0 > | x - c | < δ, then | f(x) - L | < ε
• and secondly the limit approaching from the left and right of the x coordinate of interest must be equal.

In plain English, this says that the limit of f(x) as x approaches c is L, if for every ε greater than 0, there exists a value δ, such that values of x within a range of c ± δ (excluding c itself, c + δ and c - δ) produces a value of f(x) within L± ε.

....in other words we can make f(x) as close to L as we want by making x sufficiently close to c.

This definition is known as a deleted limit because the limit omits the point x = c.

A function is continuous at a point x = c on the real line if it is defined at c and the limit equals the value of f(x) at x = c. I.e:

lim f(x) = L = f(c)
x → c

A continuous function f(x) is a function that is continuous at every point over a specified interval.

Examples of continuous functions:

• Temperature in a room versus time.
• The speed of a car as it changes over time.

A function that is not continuous, is said to be discontinuous. Examples of discontinuous functions are:

• Your bank balance. It changes instantly as you lodge or withdraw money.
• A digital signal, it's either 1 or 0 and never in between these values.

Imagine we record the distance a car travels over a period of one hour. Next we plot all the points and join the dots, drawing a graph of the results (as shown below). On the horizontal axis, we have the time in minutes and on the vertical axis we have the distance in miles. Time is the independent variable and distance is the dependent variable. In other words, the distance travelled by the car depends on the time which has passed.

If the car travels at a constant velocity, the graph will be a line, and we can easily work out its velocity by calculating the slope or gradient of the graph. To do this in the simple case where the line passes through the origin, we divide the abscissa (horizontal distance from a point on the line to the origin) by the ordinate (vertical distance from a point on the line to the origin).

So if it travels 25 miles in 30 minutes,

Velocity = 25 miles/30 minutes = 25 miles / 0.5 hour = 50 mph

Similarly if we take the point at which it has travelled 50 miles, the time is 60 minutes, so:

Velocity is 50 miles/60 minutes = 50 miles / 1 hour = 50 mph

Note: In physics we normally speak of the "velocity" of a body. Technically, the definition of velocity is speed in a given direction, so it is a vector quantity. Speed is the magnitude of the velocity vector.

Ok, so this is all fine if the vehicle is travelling at a steady velocity. We just divide distance by time taken to get velocity. But this is the average velocity over the 50 mile journey. Imagine if the vehicle was speeding up and slowing down as in the graph below. Dividing distance by time still gives the average velocity over the journey, but not the instantaneous velocity which changes continuously. In the new graph, the vehicle accelerates mid way through the journey and travels a much greater distance in a short period of time before slowing down again. Over this period, its velocity is much higher.

In the graph below, if we denote the small distance travelled by Δs and the time taken as Δt, again we can calculate velocity over this distance by working out the slope of this section of the graph.

So average velocity over interval Δs = slope of graph = Δs/Δt

However the problem is that this still only gives us an average. It's more accurate than working out velocity over the full hour, but it's still not the instantaneous velocity. The car travels faster at the start of the interval Δs (we know this because distance changes more rapidly and the graph is steeper). Then the velocity starts to decrease midway and reduces all the way to the end of the interval Δs.

What we're aiming to do is find a way of determining the instantaneous velocity.
We can do this by making Δs and Δt smaller and smaller so we can work out the instantaneous velocity at any point on the graph.

See where this is heading? We're going to use the concept of limits we learned about before.

Differential calculus is one of the two branches of calculus which also includes integral calculus. It is a study of the rate at which quantities change.

In the example above we saw how we could attempt to determine a more accurate measurement of velocity by working out the slope of a graph over a shorter interval. We can do this using limits.

Slope of a graph

In the graph below we have a generalised function y = f (x).

x is a point on the horizontal axis and Δx is a small change in x.

The value of the function at x is f (x)

As x changes to x + Δx , f (x) changes by Δy to f (x + Δx)

You may remember from coordinate geometry if we know two points on a graph: (x₁, y₁) and (x₂, y₂), the slope of a line joining the two points is:

(y₂ - y₁) / ( x₂ - x₁)

So the slope of this line is ( f (x + Δx) - f (x) ) / (x + Δx - x) = Δy / Δx

The slope Δy / Δx is approximately the slope of a tangent to the graph for small Δx.

The red line that intersects the graph at two points in the diagram above is called a secant.

If we now make Δx and Δy smaller and smaller, the red line eventually becomes a tangent to the curve. The slope of the tangent is the instantaneous rate of change of f (x) at the point x.

Derivative of a function

If we take the limit of the value of the slope as Δx tends to zero, the result is called the derivative of y = f (x).

lim _{Δx → 0} (Δy / Δx) = lim _{Δx → 0} ( f (x + Δx) - f (x) ) / (x + Δx - x) = dy/dx

The derivative of y = f (x) with respect to (wrt) x is written as dy/dx or f '(x) or just f ' and is also a function of x. I.e. it varies as x changes.

If the independent variable is time, the derivative is sometimes denoted by the variable with a dot superimposed on top.

E.g. if a variable x represents position and x is a function of time. I.e. x(t)

Derivative of x wrt t is dx/dt = ẋ (ẋ or dx/dt is speed, the rate of change of position)

We can also denote the derivative of f (x) wrt x as d/dx(f (x))

To find the derivative of a function, we differentiate it wrt to the independent variable. There are several identities and rules to make this easier, but first let's try to work out an example from first principles.

Example: Evaluate the derivative of x²

So f (x) = x²

f (x + Δx) = (x + Δx)²

d/dx( f (x)) = lim _{Δx → 0} ( f (x + Δx) - f (x) ) / ((x + Δx) - x)

= lim _{Δx → 0} ( (x + Δx)² - x² ) / Δx)

Expand out (x + Δx)²

= lim_{Δx → 0} ( (x² + 2xΔx + Δx²- x² ) / Δx)

The two x² cancel out so:

= lim_{Δx → 0} ( (2xΔx + Δx² ) / Δx)

Dividing by Δx gives:

= lim_{Δx → 0} (2x + Δx )

= 2x

Rather than working out the derivatives of functions from first principles, we normally use a set of rules to make things easier.

In the table below, f and g are two functions.

f ' is the derivative of f

g ' is the derivative of g

Example 1:

What is the derivative of 20?

Derivative of a constant is 0, so d/dx(20) = 0

Example 2:

What is the derivative of 6x³

Using the multiplication by a constant rule, d/dx(6x³) = 6 ( d/dx(x³) )

From the power rule, d/dx(x³) = 3x²

So d/dx(6x³) = 6 ( d/dx(x³) ) = 6 (3x²) = 18x²

Example 3:

Evaluate the derivative of 5sin (x) + 6x⁵

We use the sum rule to find the derivatives of 5sin (x) and 6x⁵ and then add the result together.

So d/dx (5sin (x)) = 5d/dx(sin (x)) = 5cos (x)

d/dx(6x⁵) = 6d/dx(x⁵) = 6(5x⁴) = 30x⁴

Adding the results together

d/dx (5sin (x) + 6x⁵) = 5cos (x) + 30x⁴

Example 4:

What is the derivative of x³sin (x) ?

Use the product rule, so:

d/dx(x³sin (x)) = x³d/dx(sin(x)) + sin(x)d/dx(x³)

d/dx (sin(x)) = cos(x)

d/dx(x³) = 3x² (from the power rule)

so d/dx(x³sin (x)) = x³d/dx(sin(x)) + sin(x)d/dx(x³) = x³cos(x) + 3x²sin(x)

Example 5:

Evaluate the derivative of tan (x)

tan (x) = sin (x) / cos (x)

We can use the quotient rule to work this out:

d/dx (f(x)/g(x)) = (f '(x)g(x) - g '(x)f (x))/ g(x)²

so d/dx(sin (x) / cos (x)) = (d/dx(sin (x))cos (x) - d/dx(cos (x))sin (x)) / cos² (x)

d/dx(sin (x)) = cos (x)

d/dx(cos (x)) = - sin x

Substituting

(d/dx(sin (x))cos (x) - d/dx(cos (x))sin (x)) / cos²(x)

= (cos (x)cos (x) - (-sin (x))sin (x)) / cos²(x)

= (cos²(x) + sin²(x)) / cos²(x)

= 1 + tan²(x) = sec²(x)

Example 6:

What is the derivative of ln(5x³) ?

We use the chain rule to work this out.

For two functions f(g) and g(x)

df/dx = (df/dg)(dg/dx)

Let g(x) = 5x³

and f(g) = ln(g)

df/dg = 1/g

dg/dx = 5(3x²) = 15x²

df/dx = (df/dg)(dg/dx)

= (1/g)(15x²)

Substituting for g:

= 1/(5x³)((15x²) = 3/x

We could also have evaluated the derivative by first using the rules of logarithms to simplify the expression.

So ln(5x³) = ln(5) + ln(x³) = ln(5) + 3ln(x) ............(product rule and power rule)

d/dx (ln(5) + 3ln(x)) = d/dx (ln(5)) + d/dx(3ln(x)) = 0 + 3d/dx(ln(x))

= 0 + 3(1/x) = 3/x

The animation below shows the function sin(Ө) and it's derivative cos(Ө). At Ө = 0, the value of the derivative is cos(Ө) = cos(0) = 1. As Ө increases, the value of cos(Ө) decreases, i.e the slope of the tangent to sin(Ө) becomes smaller. Eventually at Ө = π/2, the slope is zero. This is an important point because as we'll see later, we can use this fact to find the maxima and minima of functions.
As Ө exceeds π/2, the value of the derivative becomes negative.

How come?

Remember the definition of the derivative?

Δx is positive, but the change Δy is negative since f (x +Δx) - f (x) is negative because f (x +Δx) < f (x)......(the function is decreasing in value)

In the limit as Δx and Δy tend to zero, the derivative is also less than zero.

What happens if we take the derivative of a derivative?

Consider the function y = f (x)

The derivative of y is f '(x) or dy/dx

The derivative of dy/dx is known as the second derivative or second order derivative and is denoted by d²y/dx² or f '' (x) ......(f with a double dash). We can have third and higher order derivatives so for instance the third order derivative of y is d³y/dx³

Examples:

(1) If y = sin (x), what is d²y/dx² ?

dy/dx = cos (x)

d²y/dx^{2 =} d/dx (cos (x)) = -sin (x)

(2) What is the second derivative of ln (x)?

y = ln (x)

So dy/dx = 1/x = x^(-1)

d²y/dx² = d/dx (x^(-1)) = - x^(-2) = -1/x²

Since dy/dx is the rate of change of a function, roughly speaking we can think of d²y/dx² as being the rate at which dy/dx itself is changing.

Returning to the car example:

s(t) is a function describing how distance travelled changes with time.
ds/dt is the rate of change of position, called speed or velocity.
d²s/dt² is the rate of change of velocity, which is called acceleration.

If v is the velocity of the vehicle:

v = ds/dt

d²s/dt² = d/dt(ds/dt) = d/dt(v) = dv/dt

So the second derivative of distance which is acceleration is equal to the first derivative of velocity.

We can go up to the third derivative of s, so:

d³s/dt³ is the rate of change of acceleration, known as "jerk".

We can use the derivative to find the maxima and minima of a function (the points at which the function has maximum and minimum values. These points are called turning points because the derivative changes sign from positive to negative or vice versa. For a function f (x), we do this by:

• differentiating f (x) wrt x
• equating f ' (x) to 0
• and finding the roots of the equation, i.e. the values of x that make f '(x) = 0

Example 1:

Find the maxima or minima of the quadratic function f (x) = 3x² + 2x +7 (the graph of a quadratic function is called a parabola. See image below)

1. f (x) = 3x² + 2x +7
   
   
2. f '(x) = 3(2x¹) + 2(1x⁰) + 0 = 6x + 2
   
   
3. Set f '(x) = 0
   
   6x + 2 = 0
   
   
4. Solve 6x + 2 = 0
   
   Rearranging:
   
   6x = -2
   
   giving x = - ¹/₃
   
   and f(x) = 3x² + 2x +7 = 3(-1/3)² + 2(-1/3) + 7 = 6 ²/₃

A quadratic function has a maximum when the coefficient of x < 0 and a minimum when the coefficient > 0. In this case since the coefficient of x was 2, we have worked out the minimum and it occurs at the point (- ¹/₃, 6 ²/₃).

Example 2:

In the diagram above, a looped piece of string of length p is stretched into the shape of a rectangle. The sides of the rectangle are of length a and b. Depending on how the string is arranged, a and b can be varied and different areas of rectangle can be enclosed by the string. What is the maximum area that can be enclosed and what will be the relationship between a and b in this scenario?

p is the length of the string

The perimeter p = 2a + 2b (the sum of the 4 side lengths)

Call the area y

and y = ab

We need to find an equation for y in terms of one of the sides a or b, so we need to eliminate either of these variables.

Let's try to find b in terms of a:

So p = 2a + 2b

Rearranging:

2b = p - 2a

and:

b = (p - 2a)/2

y = ab

Substituting for b gives:

y = ab = a(p - 2a)/2 = ap/2 - a²

Work out the derivative dy/da and set it to 0:

dy/da = p/2 - 2a

Set to 0:

p/2 - 2a = 0

Rearranging:

2a = p/2

so a = p/4

We can use the perimeter equation to work out b, but it's obvious that if a = p/4 the opposite side is p/4, so the two sides together make up half the length of the string which means both of the other sides together are half the length. In other words maximum area occurs when all sides are equal. I.e when the enclosed area is a square.

So area y = (p/4)(p/4) = p²/16

Example 3 (Max Power Transfer Theorem or Jacobi's Law):

The image above shows the simplified electrical schematic of a power supply. All power supplies have an internal resistance (R_INT) which limits how much current they can supply to a load (R_L). Calculate in terms of R_INT the value of R_L at which maximum power transfer occurs.

The current I through the circuit is given by Ohm's Law:

So I = V/(R_INT+ R_L)

Power = Current squared x resistance

So power dissipated in the load R_L is given by the expression:

P = I²R_L

Substituting for I:

= (V/(R_INT+ R_L))²R_L

= V²R_L/(R_INT+ R_L)²

Expanding the denominator:

= V²R_L/(R²_INT + 2R_INTR_{L +} R²_L)

and dividing above and below by R_L gives:

P = V² / (R²_INT / R_L + 2R_INT + R_L)

Rather than finding when this is a maximum, it's easier to find when the denominator is a minimum and this gives us the point at which maximum power transfer occurs, i.e. P is a maximum.

So the denominator is R²_INT / R_L + 2R_INT + R_L

Differentiate it wrt R_L giving:

d/dR_L (R²_INT / R_L + 2R_INT + R_{L) =} -R²_INT / R²_L + 0 + 1

Set it to 0:

-R²_INT / R²_L + 0 + 1 = 0

Rearranging:

R²_INT / R²_L = 1

and solving gives R_L = R_INT.

So max power transfer occurs when R_L = R_INT.

This is called the max power transfer theorem.

This second part of this two part part tutorial covers integral calculus and applications of integration.

How to Understand Calculus: A Beginner's Guide to Integration