# Category: analysis

# Exercises: Set theoretic construction of real numbers

Exercises:

- If p is a prime number, show that is irrational.
- Show that
- Show that if , then the number is an irrational number.
- Show that if and are two Cauchy sequences, then so are and .
- If A and B are non empty subsets of that is bounded below. Then, if and only if (i) for all and (ii) for any , .

Reference: A Second Course in Analysis by M Ram Murty, Hindustan Book Agency.

Regards,

Nalin Pithwa

# Set theoretic construction of real numbers

Continued from previous blog. Same reference: A Second course in analysis by M Ram Murty, Hindustan Book Agency.

Section 1.3

The rational number is insufficient to “measure” all the lengths that arise in the “real world.” This was discovered by the ancient school of Pythagoras which viewed the world through a strange mix of mathematics and mysticism. The aphorism “all is number” seems to have been the underlying mantra of the Pythagoreans. In our modern digital world, this mantra imposes the universality more than in any earlier age.

Pythagoras seems to have been a contemporaryof the Buddha in India, of Confucius and Lao-Tzu in China. He seems to have travelled widely in Egypt, Babylon and India. The Pythagoreans believed in reincarnation and this was wedded to their strict adherence to vegetarianism for by eating meat they might be eating a friend!They are credited to the discovery of both the words philosophy and mathematics. The word “philosophy” literally means the love of wisdom and the word “mathematics” means “that which is learned.” Philosophy then, for the Pythagoreans was seen as a byproduct of mathematics.

The celebrated theorem of Pythagoras dealing with the length of the hypotenuse of a right angled triangle was known to earlier cultures stretching far back in time to Babylon, China and India. It is possible that Pythagoras learned of this theorem during his extensive peregrinations. But the Pythagoreans could see the mysticism inherent in the theorem, for the rule applied to all right angled triangles and there was an element of universality in it and in mathematics in general.

But when the Pythagoreans declared “all is number” they were referring to whole numbers and it is accurate to say that the concept of number had not been clearly articulated at that time. With the underlying idea that whole numbers govern the universe, their theory of ratio and proportion was in for a rude shock. Legend has it that the Pythagorean who discovered that is an irrational number was drowned !

The irrationality of represents a major episode in the history of mathematics and we owe this to the unfortunate Pythagorean who lost his life by discovering it. The proof is by contradiction and invokes the rudimentary arithmetical idea of a prime number, a concept first enunciated in Euclid’s Elements. A natural number is called a prime number if it has no proper divisors. Thus, the sequence of prime numbers begins as (The number one is not included in the list of prime numberss. It it called a unit, a concept which generalizes to rings.) Two natural numbers a and b are said to be coprime if they have no common prime factor. When we write a fraction a/b in “lowest termss”, we are writing it such that a and b are coprime. We sometimes write to indicate that a and b are coprime. This is not to be confused with the concept of an ordered pair introduced earlier.

The irrationality of is established by using the method of contradiction. It is instructive to see all the details. If is a rational number, then we can write

such that

Upon squaring both sides, we see

which implies that a is even since the left hand side of the equation is patently an even number. Writing , we now get

and so b is even. But this contradicts the coprimality of a and b.

This was the theorem that led to the demise of the heroic Pythagorean for it violated the aphorism “all is number” because the ancients viewed numbers as only whole numbers. They also allowed for rational numbers since they can be represented as ratio and proportion of whole quantities. This innocuous theorem opens the door for the discovery of real numbers. For it signals the lack of the “least upper bound property” in the realm of rational numbers.

The student should keep in mind that so far, we have only constructed the universe of rational numbers and thus any further definitions must be given only in terms of rational numbers. A set A of rational numbers is said to be bounded if there is a rational number M such that for all . An upper bound for A is any rational number u such that for all . A lower bound for A is a rational number l such that for all . A rational number v is called a least upper bound for A if for every upper bound u of A. A rational number m is called a greatest lower bound for A if for every lower bound l of A. Thus, a set A is bounded if and only if it has both an upper bound and a lower bound.

Several questions now arise: given a set A of rational numbers, does it always have a least upper bound? Does it have a greatest lower bound? If so, are they unique?

The theorem discovered by the Pythagoreans can be explained as follows. Nascent in this example are many of the fundamental properties we would expect of the real numbers. Essential to the understanding is the familiar fact that the sequence of rational numbers gets smaller and smaller and tends to zero.

If we consider the set

then A has no least upper bound. Indeed if u is a least upper bound, for any . By definition, u is a rational number and so cannot first equal . If , then we can choose a natural number N such that

so that

contradicting that u is an upper bound for the set A. If , then we can similarly find N such that

,

which again contradicts that u is the least upper bound for A. Thus, A does not have a least upper bound in the realm of rational numbers.

Digress: We digress a bit here from Dr. M Ram Murty’s above text and reproduce a nice “little proof”‘ from Rudin’s Analysis text illustrating that the rational number line has gaps or holes in it..

****

As we know there exists no rational solution to . We now examine this situation a little more closely. Let A be the set of all positive rationals p such that and let B consist of all positive rationals p such that . We shall show that A contains no largest rational number and B contains no smallest rational number.

More explicitly, for every we can find a rational q in A such that , and for every p in B, we can find a rational q in B such that .

To do this, we associate with each rational number the number q such that:

…call this I.

Thus, ….call this II.

If p is in A, then , (1) above shows that , and II shows that . Thus, q is in A.

If p is in B, then , (I) shows that , and II shows that . Thus, q is in B.

Conclusion: the purpose of the above discussion is to show that the rational number system has gaps, in spite of the fact that in between any two rational numbers, there is another: if , and if , then . The real number system fills these gaps. This is the principle reason for the fundamental role which it plays in analysis.

***

Two ways of constructing the real numbers were proposed independently by Richard Dedekind (1831-1916) and Augustin Cauchy (1789-1857). Each method has its virtues. The method of Dedekind, using what are called Dedekind cuts is closer to the axiomatic foundations we have been discussing and is suggested by the example discussing above. The method of Cauchy using what are now called Cauchy sequences has a wider applicability. In our example above, an essential role is played by the ordering of the rational numbers. The method of Dedekind cuts uses this idea in a fundamental way. It coincides with our intuitive and visual idea of the real numbers as being “points on the number line stretching from minus infinity to plus infinity.”

A Dedekind cut in Q is a partition of Q into two sets A and B with the following properties:

- A and B are both non-empty.
- A is “closed downwards”, that is, if and , then ;
- B is “closed upwards”, that is, if and , then .
- A contains no greatest element, that is, there is no such that for all .

The set R of real numbers is then defined as the set of all Dedekind cuts.

For example, the irrational number is defined by the Dedekind cut:

, and , and .

For example, the number zero is represented by with A being the set of all non-zero negative rational numbers and B being the set of all non-zero positive rational numbers. As the Dedekind cut is uniquely defined by A, with B being the complement of A in the set of rationals, we may as well associate A to each real number, or even think of A as the real number. One would then have to define how one would work with this definition from the perspective of addition, multiplication and so on. This is not difficult to do. For instance, we have

, and .

Addition is simple enough:

Multiplication is defined (rather cumbersomely) by setting to be

if

, if , and

, if ,

, if

The absolute value function is then

, if ; , if ; , if .

One can prove that all the usual operations with numbers satisfy the expected properties of commutativity, associativity, and distributivity.

By contrast, the method of Cauchy sequences begins with a definition of convergence. In some ways, it is motivated by our discussion of earlier. If A is the Dedekind cut representing , then the least upper bound of A “is” . Thus, the number can be thought of as a limit of a sequence of rational numbers. But there can be many such sequences and so one needs a more formal approach. The underlying observation is that a limit of a sequence of rational numbers need not be rational.

This is perhaps best illustrated by Euler’s series for e. Students of calculus are familiar with

and the right hand side can be thought of as a limit of a sequence of rational numbers

The irrationality of e is easily proved by the method of contradiction. Suppose that for two coprime natural numbers a and b. Then,

…call this 1.1

and the second term on the right hand side is strictly less than the geometric series

which is less than or equal to 1. But the left hand side of 1.1 is a positive integer, the first term on the right hand side of 1.1 is a positive integer and the second term is not an integer, which is a contradiction.

What this example shows is that the “limit” of the sequence of partial sums (each of which is a rational number) is the irrational number e.

The reader is familiar with the usual notion of convergence. We say a sequence of real numbers converges to L if given there exists N such that

for all

One may want to view real numbers as “limits of sequences of rational numbers.”But in our formal construction of numbers, several difficulties arise with this definition. The first is that as we have so far only constructed the rational numbers, we need to take the ‘s to be all rational numbers. Secondly, the limit L need not be a rational number as the example with e shows. This motivates the formal definition of a Cauchy sequence of rational numbers.

A sequence in is called a Cauchy sequence if given , there is an N such that

for all

Now it is easy to see that any convergent sequence is a Cauchy sequence. For reference, we record this below:

Theorem 1.2: Any convergent sequence is a Cauchy sequence.

Proof of 1.2: Suppose that converges to L. Then, choosing N such that

for all

we have for all , by the triangle inequality

.

QED.

Later, we will show that every Cauchy sequence converges. Thus, a sequence is Cauchy if and only if it is convergent and the two notions are equivalent. But the advantage of the notion of a Cauchy sequence is that the limit value L is not mentioned in the definition.

The construction of real numbers is now brought about by defining an equivalence relation on the set of all Cauchy sequences of rational numbers. Since we have constructed rational numbers, we are now allowed to construct the set of all Cauchy sequences of rational numbers. On this set, we say two Cauchy sequences and are equivalent if for any , there exists a natural number N such that

for all .

This is easily seen to define an equivalence relation on the set of all Cauchy sequences of rational numbers. The set of real numbers is then defined as the set of all equivalence classes. We will denote the equivalence class of the sequence by .

We leave as an exercise to verify that if and are two Cauchy sequences, then so are and . Thus, the usual operations of addition and multiplication are easily defined as:

One needs to verify that these are well-defined by checking that the definition does not depend on the choice of representative of the equivalence class.

The order relation of the real numbers can also be defined. Thus, viewing real numbers as equivalence classes or Cauchy sequences of rational numbers, we define if there is an N such that for all . We also write if either or . Again, these order relations have the expected properties.

Finally, the absolute value function can also be defined. We set

$latex|[\{ q_{n}\}]| = [\{ |q_{n}|\}]$

and the reader can easily verify that indeed the right hand side is a Cauchy sequence if is Cauchy.

The absolute value has the usual properties, the most notable being the triangle inequality

Having given this formal definition of the real numbers using Cauchy sequences, it is convenient to drop the sequence notation and just represent the real numbers as single letters. Thus, if a, b are real numbers, the triangle inequality is the familiar:

It is now convenient to visualize the set of real numbers in the usual way as points of the line stretching from to .

By the very construction, the set of real numbers has the property of completeness in that every Cauchy sequence converges. The reader will also observe that the construction depended only on the property of the absolute value viewed as a metric to measure the distance between two rational numbers. This signals a wider applicability of the method of Cauchy sequences valid more generally in metric spaces which we discuss later.

With the construction of the real numbers, we have restored the least upper bound property and can now define that a sequence of numbers (rational or real) converges to a number if given any , there is an N such that

for all .

A non-empty subset A of is said to be bounded below if there is a number such that for all . Any such number s is called a lower bound for A. Analogously, A is said to be bounded above if there is an upper bound for A. The set A is said to be bounded if it is both bounded below and bounded above and unbounded if it is not bounded.

The construction of the real numbers using the Dedekind cuts shows that every non-empty subset of that is bounded above has a least upper bound denoted by . The least upper bound is also called the supremum. Every non-empty subset which is bounded below has a greatest lower bound denoted by . The greatest lower bound is also called the infimum. It is clear that if A and B are non-empty subsets of such that , then (see exercises). The following theorem gives a convenient characterization of the supremum.

Theorem 1.3 Let A be a non-empty subset of that is bounded above. Then if and only if

(i) for all , and

(ii) for any , .

Proof :

Let . Then s is an upper bound for A so that (i) holds. Now if (ii) were false, there would be an such that . But then would also be an upper bound for A, a contradiction. Conversely, suppose thatt (i) and (ii) hold. Then (i) implies s is an upper bound for A. If s were not the least upper bound for A, there would bea such that for all. Taking in (ii) we get that . But so that which is a contradiction since for all .

QED.

Theorem 1.3 can also be stated as follows. If A is a non-empty subset of that is bounded above and, then either or for all . A similar theorem can be written for the infimum of a set.

Cheers,

Nalin Pithwa

# Constructing numbers from sets

Continued from previous blog: A fast review of set theory; same reference: A Second Course in Analysis by M Ram Murty, Hindustan Book Agency.

Mathematicians and philosophers of the nineteenth century pondered deeply into the nature of a number. The question of “what is a number?” is not a simple one. But since mathematicians decided to give foundations of mathematics using the axiomatic method and sets as the basic building blocks, we are led to define numbers using sets. We follow Richard Dedekind (1831-1916) and Giuseppe Peano (1858-1932) in the following construction. It was as late as 1888 and 1889 when this construction was described in two papers written independently by Dedekind and Peano.

We construct a sequence of sets to represent the natural numbers. As noted earlier, zero is represented by the empty set. We have already described the construction of the natural numbers using the empty set. For each natural number n, the successor of n is denoted by (and sometimes as ) and defined as

Thus, each natural number is a set with n elements, namely,

We designate the set of natural numbers by the symbol . (It is a matter of personal convenience whether to include zero as a natural number or not. In this discussion, zero is a natural number. In other settings, it may not be. There is no universal convention regarding this and the student is expected to understand depending on the context. Some authors use the term “whole numbers” to indicate that zero is included in the discussion.)

The arithmetic operations on are now defined recursively. Addition is defined as a function from to :

where is defined recursively by and . A similar definition is given for multiplication x by defining and

We also define as simply mn which is the familiar symbology.

An equivalence relation on a set S is a subset R of satisfying:

- (reflexive axiom) .
- (symmetry axiom) .
- (transitive axiom) and implies .

The notion of an equivalence relation is an abstaction of our concept of equality, or at least what we implicitly expect of the notion of equality. It is more suggestive to write the equivalence relationn, not as a subset of as indicated above, but rather more symbolically as that our axioms become:

- (reflexive) , .
- (symmetry) if and only if .
- (transitive) and implies .

Equivalence relations play a fundamental role in all of mathematics. They allow us to understand aspects of sets by grouping them using certain properties.

To construct negative integers, we define an equivalence relation on . We write

.

Intuitively, we think of as so that it becomes evident that our definition is now in terms of concepts that have been defined earlier. This is very similar to how the ancients worked with negative numberss that appeared in an equation. They usually moved them to the other side so that the equation became an equation of non-negative numbers. However, with our set theoretic definition, we have reached a more fundamental and higher level of abstraction. Thus, with our equivalence relation above on the natural numbers, we define the set of integers as the set of equivalence classes of such ordered pairs. It is now easy to see that the following lemma holds:

Lemma 1.1 If is an ordered pair of non-negative integers, then exactly one of the following statements holds:

(a) is equivalent to for a unique non-negative integer m;

(b) is equivalent to for a unique non-negative integer m;

(c) is equivalent to .

Sometimes, we denote by the equivalence class of . With this lemma in place, we now denote by m the set of pairs of non-negative integers equivalent to ; by -m the set of pairs equivalent to and by 0 the set of pairs equivalent to . We denote these equivalence classes by .This gives us set theoretic construction of the set of integers.

We can define the operations of addition and multiplication by setting:

This latter definition is best understood if we recall that the symbol represents j-k so that the left hand side of the above equation is

One needs to check that these definitions are “well-defined” in the sense that they are independent of the representatives chosen for the equivalence class. This can be done as exercises.

In this way, we have now extended the notion of addition and multiplication from the set of natural numbers to the set of integers. Subtraction of integers can be defined by

where -1 represents the equivalence class . All of these definitions correspond to our usual notion of addition, subtraction and multiplication. Their virtue lies in their pure set-theoretic formulation.

We can also order the set of integers in the usual way. Thus,

and

.

This corresponds to our usual notion of “less than” and “less than or equal to”.

Finally, we can define the absolute value on the set of integers by setting

, if

, if

, if

We can now construct the rational numbers from the set of integers. We do this by defining an equivalence relation on the set by stating that two pairs and are equivalent if and only if . Intuitively, we think of as representing the “fraction” and examining what we would mean by by reducing it to notions already defined. The set of rational numbers is then defined as the set of such equivalence classes.

The expected operations of addition and multiplication are now evident:

Again, these definitions are easily verified to be well-defined. Finally, we can now define “division”.If with , we define:

These operations satisfy the familiar laws of associativity, commutativity and distributivity. Subtraction of rational numbers then can be written as :

The ordering of rational numbers can also be written as:

.

These definitions agree with out usual notions of ordering of the rational numbers.

Finally, the definition of absolute value can be extended as:

if

if

.

Again, our familiar properties of the absolute value of rational numbers hold. With this foundational construction in place, we can conveniently represent the equivalence class of as simply the fraction j/k and continue to work with these numbers as we were hopefully taught from childhood.

In the next sections/blogs we construct the real numbers from this axiomatic framework.

Exercises:

Hint (generic): keep the meaning of the symbols in mind and meaning of equivalence relations and equivalence classes. Also note that our basic object is a class and a set is a member of a class.

- let be two elements of . Show that the addition:

is well-defined. That is, prove that for any and , we have that is equivalent to .

2. For , prove the distributive law: .

3. Show that the relations < and on have the following properties:

(a) for all

(b) for all

(c) if and only if

(d) for all

(e) if and only if .

(f) for all .

(g) for all

(h) for if and only if

(i) for all

(j) where if and only if .

Cheers,

Nalin Pithwa.

# An example: continuous map which is not homeomorphic

Reference: Topology by Hocking and Young. Dover Publications.

Let us present an example of a continuous mapping (one-to-one) which is not a homeomorphism:

Let S be the set of all non-negative real numbers with their usual metric topology, and let T be the unit circle in its metric topology. Consider $f: S \rightarrow T$. For each x in S, let $f(x) = (1, \frac{2\pi x^{2}}{(1+x^{2})})$, a point in polar coordinates on T.

It is easily shown that f is continuous and one-to-one.

But the set of all x in S such that $x<1$ is open in S while its image is not open in T. Hence, f is not interior. (meaning that: A transformation $f: S \rightarrow T$ of the space S into the space T is said to be interior if f is continuous and and if the image of every open subset of S is open in T) , and is not a homeomorphism (because of the following theorem: A necessary and sufficient condition that the one-to-one continuous map $f: S \rightarrow T$ of the space S onto the space S be a homeomorphism is that f be interior).

Regards,

Nalin Pithwa.

# Some basic facts about connectedness and compactness

Reference: Hocking and Young’s Topology, Dover Publishers. Chapter 1: Topological Spaces and Functions.

Definition : Separated Space: A topological space is separated if it is the union of two disjoint, non empty, open sets.

Definition: Connected Space: A topological space is connected if it is not separated.

PS: Both separatedness and connectedness are invariant under homeomorphisms.

Lemma 1: A space is separated if and only if it is the union of two disjoint, non empty closed sets.

Lemma 2: A space S is connected if and only if the only sets in S which are both open and closed are S and the empty set.

Theorem 1: The real line is connected.

Theorem 2: A subset X of a space S is connected if and only if there do not exist two non empty subsets A and B of X such that , and such that is empty.

Note the above is Prof. Rudin’s definition of connectedness.

Theorem 3: Suppose that C is a connected subset of a space S and that os a collection of connected subsets of S, each of which intersects C. Then, is connected.

Corollary of above: For each n, is connected.

Theorem 4:

Every continuous image of a connected space is connected.

Lemma 3: For , the complement of the origin in is connected.

Theorem 5: For each , is connected.

Theorem 6: If both and are continuous, then the composition gf is also continuous.

Lemma 4: A subset X of a space S is compact if and only if every covering of X by open sets in S contains a finite covering of X.

Theorem 7: A closed interval in is compact.

Theorem 8: Compactness is equivalent to the finite intersection property.

Theorem 9: A compact space is countably compact.

Theorem 10: Compactness and countable compactness are both invariant under continuous transformations.

Theorem 11: A closed subset of a compact space is compact.

Cheers,

Nalin Pithwa.

# Some basic facts about continuity

Reference: (1) Topology by Hocking and Young especially chapter 1 (2) Analysis — Walter Rudin.

Definition 1: A transformation is continuous provided that if p is a limit point of a subset X of S, then is a limit point or a point of .

Definition 2: We may also state the continuity requirement on f as follows: if p is a limit point of , then is a point of .

Theorem 1: If S is a set with the discrete topology and any transformation of S into a topologized set T, then f is continuous.

Theorem 2: A real-valued function defined on an interval is continuous provided that if and , then there is a number such that if , x in , then . (NB: this is same as definition 1 above).

Theorem 3: Let be a transformation of the space S into the space T. A necessary and sufficient condition that f be continuous is that if O is any open subset of T, then its inverse image is open in S.

Theorem 4:

A necessary and sufficient condition that the transformation of the space S into the space T be continuous is that if x is a point of S, and V is an open subset of T containing , then there is an open set, U in S containing x and such that lies in V.

Theorem 5:

A one-to-one transformation of a space S onto a space T is a homeomorphism, if and only if both f and are continuous.

Theorem 6:

Let be a transformation of the metric space M with metric d into the metric space N with metric . A necessary and sufficient condition that f be continuous is that if is any positive number and x is a point of M, then there is a number such that if , then .

Theorem 7:

A necessary and sufficient condition that the one-to-one mapping (that is, a continuous transformation) of the space S onto the space T be a homeomorphism is that f is interior. (NB: A transformation of the space S into the space T is said to be interior if f is continuous and if the image of every open set subset of S is open in T).

Regards,

Nalin Pithwa.

# Tutorial Problems I: Topology: Hocking and Young

Reference: Topoology by Hocking and Young, Dover Publications, Inc., NY. Available in Amazon India.

Exercises 1-1:

Show that if S is a set with the discrete topology and is any transformation of S into a topologized set T, then f is continuous.

Solution 1-1:

Definition A: The set S has a topology (or is topologized) provided that, for every point p in S and every subset X of S, the question : “is p a limit point of X?” can be answered.

Definition B: A topology is said to be a discrete topology when we assume that for no point p in S, and every subset X of S: the answer to the question: “is p a limit point of X?” is NO.

Definition C: A transformation is continuous provided that if p is a limit point of a subset X of S, then f(p) is a limit point or a point of f(X).

So, the claim is vacuously true. QED.

Exercises 1-2:

A real-valued function defined on an interval [a,b] is continuous provided that if and , then there is a number such that if $|x-x_{0}|<\delta$, where , then . Show that this is equivalent to our definition, using definition 1-1.

Solution 1-2:

Definition 1-1: The real number p is a limit point of a set X of real numbers provided that for every positive number , there is an element x of the set X such that $0<|p-x|<\epsilon$.

Definition C: A transformation is continuous provided that if p is a limit point of a subset X of S, then f(p) is a limit point or a point of f(X).

Part 1: Let us assume that given function f is continuous as per definition given just above.

Then, as p is a limit point of X: it means: For any , there exists a real number p such that there is an element such that ..

So, also, by definition C, f(p) is a limit point or a point of f(X); this means the following: if f(p) is a point of f(X), there exists some such that $f(x_{0} \in f(X)$, and so quite clearly in this case so that , as is positive.

On the other hand, if f(p) is a limit point of f(X), as per the above definition of continuity, then also for any , there exists a point such that . So, in this case also the claim is true.

We have proved Part 1. QED.

Now, part II: We assume the definition of continuity given in the problem statement is true. From here, we got to prove definition C as the basic definition given by the authors.

But this is quite obvious as in this case .

We have proved Part II. QED.

Thus, the two definitions are equivalent.

Cheers,

Nalin Pithwa

# Metric space question and solution

Reference: I had blogged this example earlier, but I myself could not fill in the missing gaps at that time. I am trying again with the help of MathWorld Wolfram and of course, the classic, Introductory Real Analysis by Kolmogorov and Fomin, from which it is picked up for my study.

Consider the set of all continuous functions defined on the closed interval . Let the distance function (or metric) be defined by the formula:

——– relation I

The resulting metric space will be denoted by .

The first two properties of a metric space are clearly satisfied by the above function. We need to check for the triangle inequality:

Now I satisfies the triangle inequality because of the following Schwarz’s inequality:

—— relation II

In order to get to the above relation II, we need to prove the following:

Prove: .

From the above, we can deduce Schwarz’s inequality (relation II here in this blog article).

(My own attempts failed to crack it so I had to look at the internet for help. Fortunately, MathWorld Wolfram has given a crisp clear proof…but some parts of the proof are still out of my reach…nevertheless, I am reproducing the proof here for the sake of completeness of my notes…for whatever understanding I can derive at this stage from the proof…):

**CITE THIS AS:**

Weisstein, Eric W. “Schwarz’s Inequality.” From *MathWorld*–A Wolfram Web Resource. https://mathworld.wolfram.com/SchwarzsInequality.html

Schwarz’s Inequality:

Let be any two real integrable functions in , then Schwarz’s inequality is given by :

Written out explicity,

with equality if and only if with a constant. Schwarz’s inequality is sometimes also called the Cauchy-Schwarz inequality or Buniakowsky’s inequality.

To derive the inequality, let be a complex function and a complex constant such that

for some f and g

Since

, where is the complex conjugate.

with equality when

Writing this, in compact notation:

….relation A

Now, define ….relation B

and …relation C

Multiply A by and then plug in B and C to obtain:

which simplifies to

So

. Bessel’s inequality follows from Schwarz’s inequality. QED.

Regards,

Nalin Pithwa

# VI. Countable sets: My notes.

Reference:

- Introduction to Topology and Modern Analysis by G. F. Simmons, Tata McGraw Hill Publications, India.
- Introductory Real Analysis — Kolmogorov and Fomin, Dover Publications, N.Y.(to some extent, I have blogged this topic based on this text earlier. Still, it deserves a mention/revision again).
- Topology : James Munkres.

The subject of this section and the next — ** infinite cardinal numbers **— lies at the very foundation of modern mathematics. It is a vital instrument in the day to day work of many mathematicians, and we shall make extensive use of it ourselves (in our beginning studying of math ! :-)). This theory, which was created by the German mathematician Georg Cantor, also has great aethetic appeal, for it begins with ideas of extreme simplicity and develops through natural stages into an elaborate and beautiful structure of thought. In the course of our discussion, we shall answer questions which no one before Cantor’s time thought to ask, and we shall ask a question which no one can answer to this day…(perhaps !:-))

Without further ado, we can say that * cardinal numbers are those used in counting, such as the positive integers (or natural numbers) 1, 2, 3, …familiar to us all. *But, there is much more to the story than this.

The act of counting is undoubtedly one of the oldest of human activities. Men probably learned to count in a crude way at about the same time as they began to develop articulate speech. The earliest men who lived in communities and domesticated animals must have found it necessary to record the number of goats in the village herd by means of a pile of stones or some similar device. If the herd was counted in each night by removing one stone from the pile for each goat accounted for, then stones left over would have indicated strays, and herdsmen would have gone out to search for them. Names for numbers and symbols for them like our 1, 2, 3, …would have been superfluous. *The simple yet profound idea of a one-to-one correspondence between the stones and the goats would have fully met the needs of the situation.*

In a manner of speaking, we ourselves use the infinite set

of all positive integers as “pile of stones.” We carry this set around with us as part of our intellectual equipment. Whenever we want to count a set, say, a stack of dollar bills, we start through the set N and tally off one bill against each positive integer as we come to it. The last number we reach, corresponding to the last bill, is what we call the number of bills in the stack. If this last number happens to be 10, then “10” is our symbol for the number of bills in the stack, as it also is for the number of our fingers, and for the number of our toes, and for the number of elements which can be put into one-to-one correspondence with the finite set . Our procedure is slightly more sophisticated than that of the primitive savage man. We have the symbols 1, 2, 3, …for the numbers which arise in counting; we can record them for future use, and communicate them to other people, and manipulate them by the operations of arithmetic. But the underlying idea, that of the one-to-one correspondence, remains the same for us as it probably was for him.

The positive integers are adequate for our purpose of counting any non-empty finite set, and since outside of mathematics all sets appear to of this kind, they suffice for all non-mathematical counting. But in the world of mathematics, we are obliged to consider many infinite sets, such as the set of positive integers itself, the set of all integers, the set of all rational numbers, the set of all real numbers, the set of all points in a plane, and so on. It is often important to be able to count such sets, and it was Cantor’s idea to do this, and to develop a theory of infinite cardinal numbers, by means of one-to-one correspondence.

In comparing the sizes of two sets, the basic concept is that of numerical equivalence as defined in the previous section. We recall that two non-empty sets are numerically equivalent if there exists a one-to-one mapping of a set onto the other, or — and this amounts to the same thing — if there can be found a one-to-one correspondence between them. To say that two non-empty finite sets are numerically equivalent is of course to say that they have the same number of elements in the ordinary sense. If we count one of them, we simply establish a one-to-one correspondence between its elements and a set of positive integers of the form and we then say that n is the number of elements possessed by both, or the cardinal number of both. ** The positive integers are the finite cardinal numbers.** We encounter many surprises as we follow Cantor and consider numerical equivalences for infinite sets.

The set of all positive integers is obviously “larger” than the set of all even positive integers, for it contains this set as a proper subset. It appears on the surface that N has “more” elements. But it is very important to avoid jumping to conclusions when dealing with infinite sets, and we must remember that our criterion in these matters is whether there exists a one-to-one correspondence between the sets (not whether one set is a proper subset or not of the other) . As a matter of fact, consider the “pairing”

serves to establish a one-to-one correspondence between these sets, in which each positive integer in the upper row is matched with the even positive integer (its double) directly below it, and these two sets must therefore be regarded as having the same number of elements. This is a very remarkable circumstance, for it seems to contradict our intuition and yet is based only on solid common sense. We shall see below, in Problems 6 and 7-4, that every infinite set is numerically equivalent to a proper subset of itself. Since this property is clearly not possessed by any finite set, some writers even use it as the definition of an infinite set.

In much the same way as above, we can show that N is numerically equivalent to the set of all even integers:

Here, our device is start with zero and follow each even positive integer as we come to it by its negative. Similarly, N is numerically equivalent to the set of all integers:

It is of considerable interest historical interest to note that Galileo had observed in the early seventeenth century that there are precisely as many perfect squares (1,4,9,16,25, etc.) among the positive integers as there are positive integers altogether. This is clear from the “pairing”:

It struck him as very strange that this should be true, considering how sparsely strewn the squares are among all the positive integers. But, the time appears not to have been ripe for the exploration of this phenomenon, or perhaps he had other things on his mind; in any case, he did not follow up his idea.

These examples should make it clear that all that is really necessary in showing that an infinite set X is numerically equivalent to N is that we be able to list the elements of X, with a first, a second, a third, and so on, in such a way that it is completed exhausted by this counting off of its elements. It is for this reason that any infinite set which is numerically equivalent to N is said to be * countably infinite.* (Prof. Walter Rudin also, in his classic on mathematical analysis, considers a countable set to be either finite or countably infinite. ) We say that a set is countable it is non-empty and finite (in which case it can obviously be counted) or if it is countably infinite.

One of Cantor’s earliest discoveries in his study of infinite sets was that the set of all positive rational numbers (which is very large : it contains N and a great many other numbers besides) is actually countable. We cannot list the positive rational numbers in order of size, as we can the positive integers, beginning with the smallest, then the next smallest, and so on, for there is no smallest, and between any two there are infinitely many others. We must find some other way of counting them, and following Cantor, we arrange them not not in order of size, but according to the size of the sum of numerator and denominator. We begin with all positive rationals whose numerator and denominator sum add up to 2: there is only one . Next, we list (with increasing numerators) all those for which this sum is 3: . Next, all those for which the sum is 4: . Next, all those for which this sum is 5: . Next, all those for which this sum is 6: . And, so on. If we now list all these together from the beginning, omitting those already listed when we come to them, we get a sequence like:

which contains each positive rational number once and only once. (There is a nice schematic representation of this : Cantor’s diagonalization process; please google it). In this figure, the first row contains all positive rationals with numerator 1, the second all with numerator 2, and so on. Our listing amounts to traversing this array of numbers in a zig-zag manner (again, please google), where of course, all those numbers already encountered are left out.

It is high time that we christened the infinite cardinal number we have been discussing, and for this purpose, we use the first letter of the Hebrew alphabet, . We say that is the number of elements in any countably infinite set. Our complete list of cardinal numbers so far is

.

We expand this list in the next section.

Suppose now that m and n are two cardinal numbers (finite or infinite). The statement that m is less than n (written m < n) is defined to mean the following: if X and Y are sets with m and n elements, then (i) there exists a one-to-one mapping of X into Y, and (ii) there does not exist a mapping of X onto Y. Using this concept, it is easy to relate our cardinal numbers to one another by means of:

.

With respect to the finite cardinal numbers, this ordering corresponds to their usual ordering as real numbers.

Regards,

Nalin Pithwa