
随机过程在数学、科学和工程中有着越来越广泛的应用。本书包括随机过程一些基本而又重要的内容:条件期望,Markov链,Poisson过程和Brown运动;同时也包括Ito积分和随机微分方程等应用范围越来越广的内容。本书的习题是其基本内容的延伸,而且有十分完整的解答,非常适合高年级本科生和研究生自学使用或用作教学参考书。
Preface
This book has been designed for a final year undergraduate course in stochastic
processes. It will also be suitable for mathematics undergraduates and others
with interest in probability and stochastic processes, who wish to study on their
Own.
The main prerequisite is probability theory: probability measures, random
variables, expectation, independence, conditional probability, and the laws of
large numbers' The only other prerequisite is calculus. This covers limits, series,
the notion of continuity, differentiation and the Riemann integral. Familiarity
d ) differentiation and the Riemann integral. Familiarity
with the Lebesgue integral would be a bonus. A certain level of fundamental
mathematical experience, such as elementary set theory, is assumed implicitly'
.
Throughout the book the exposition is interlaced with numerous exercises,
which form an integral part of the course' Complete solutions are provided at
the end of each chapter. Also, each exercise is accompanied by a hint to guide
the reader in an informal manner. This feature will be particularly useful for
self-study and may be of helD in tutorials. It also Dresents a challenffe for the
J J De of help in tutorials. It also presents a challenge for the
lecturer to involve the students as active participants in the course.
A brief introduction to probability is presented in the first chapter. This is
mainly to fix terminology and notation, and to provide a survey of the results
which will be required later on. However, conditional expectation is treated in
detail in the second chapter, including exercises designed to develop the
necessary skills and intuition. The reader is strongly encouraged to work through
J .Kills and intuition. The reader is strongly encouraged to work through
them prior to embarking on the rest of this course. This is because conditional
expectation is a key tool for stochastic processes, which often presents some
difficulty to the beginner.
Chapter 3 is about martingales in discrete time. We study the basic
properties, but also some more advanced ones like stopping times and the Optional
Stopping Theorem. In Chapter 4 we continue with martingales by presenting
.
xI
.. o r
xll Preface
Doob's inequalities and convergence results. Chapter 5 is devoted to
timehomogenous Markov chains with emphasis on their ergodic properties. Some
..
important results are presented without proof, but with a lot of applications.
However, Markov chains with a finite state space are treated in full detail'
Chapter 6 deals with stochastic processes in continuous time. Much emphasis
.'...
is put on two important examples, the Poisson and Wiener processes. Various
properties of these are presented, including the behaviour of sample paths and
the Doob maximal inequality. The last chapter is devoted to the It6 stochastic
integral. This is carefully introduced and explained. We prove a stochastic
ver.P' - 11.11, - Ic a~~llll.' - 11
sion of the chain rule known as the It6 formula, and conclude with examples
and the theory of stochastic differential equations'
It is a pleasure to thank Andrew Carroll for his careful reading of the final
draft of this book. His many comments and suggestions have been invaluable
to us' We are also indebted to our students who took the Stochastic Analysis
course at the University of Hull. Their feedback was instrumental in our choice
of the topics covered and in adjusting the level of exercises to make them
challenging yet accessible enough to final year undergraduates.
As this book is going into its 3rd printing, we would like to thank our
students and readers for their support and feedback. In particular, we wish
to express our gratitude to laonnis Emmanouil of the University of Athens
and to Brett T. Reynolds and Chris N. Reynolds of the University of Wales
in Swansea for their extensive and meticulous lists of remarks and valuable
suggestions, which helped us to improve the current version of Basic Stochastic
Processes.
We would greatly apprecis,tB further feedback from our readers, who are
...
invited to visit the Web Page http: //www. hull. ac. uk/php/mastz/bsp. html
for more information and to check the latest corrections in the book.
Zdzislaw BrzeZniak and Tomasz Zastawniak
Kingston upon Hull, June 2000
Contents
1. Review of Probability ...................................... 1
1.1 Events and Probability.................................... 1
1.2 Random Variables........................................ 3
1.3 Conditional Probability and Independence................... 8
1.4 Solutions................................................ 10
2. Conditional Expectation.................................... 17
2.1- -Conditioning on an Event .................................-1-7
2.2 Conditioning on a Discrete Random Variable................. 19
2.3 Conditioning on an Arbitrary Random Variable .............. 22
2 4 Conditioning on a a-Field 27
2.15 General Properties........................................ 29
2.t5 Various Exercises on Conditional Expectation................ 31
2.7 Solutions................................................ 33
3 Martingales in Discrete Time 45
~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ Q ~ ~ ~ ~ ~ ~ S S ~ S ~ ~ ~ ~ ~ ~
3.1 SequencesofRandomVariables............................ 45
3.2 Filtrations............................................... 4t5
3.3 Martingales.............................................. 48
A
3.4 Games or- Uhance......................................... ,51
3.15 StoppingTimes.......................................... 154
3.t5 Optional Stopping Theorem ............................... 158
-3.-7 Solutions ................................................-t5~1
4 Martingale Inequalities and Convergence 67
~ t ~ ~ ~ ~ e ~ ~ ~ ~ ~ ~ ~ ~ O ~ ~ S S
4.1 Doob's Martingale Inequalities ............................. 68
~ o I
Xlll
xiv Contents
I I
4.2 Doob's Martingale Convergence Theorem.................... 71
4.3 Uniform Integrability and L1 Convergence of Martingales...... 73
4.4 ~5olutions................................................ ~u
5. Markov Chains ............................................. 85
5.1 First Examples and Definitions.. ...... .. .. .. . . .. .. .. . . .. .. . 86
~-5.2 Classification of- States ....................................-l~O-1
5.3 Long-Time Behaviour of Markov Chains: General Case........ 108
5.4 Long-Time Behaviour of Markov Chains with Finite State
Space................................................... 114
5.5 Solutions ................................................ 119
6. Stochastic Processes in Continuous Time ................... 130
t5.1 General Notions.......................................... 139
6.2 Poisson Process .......................................... 140
6.2.1 Exponential Distribution and Lack of Memory ......... 140
6.2.2 Construction of the Poisson Process .................. 142
6.2.3 Poisson Process Starts from Scratch at Time t ......... 145
6.2.4 Various Exercises on the Poisson Process .............. 148
6.3 Brownian Motion......................................... 150
6.3.1 Definition and Basic Properties ...................... 151
6.3.2 Increments of Brownian Motion ...................... 153
6.3.3 Sample Paths...................................... 156
6.3.4 Doob's Maximal L2 Inequality for Brownian Motion .... 159
6.3.5 Various Exercises on Brownian Motion................ 160
6.4 Solutions................................................ 161
7. It5 Stochastic Calculus ..................................... 179
7 1 It6 Stochastic Integral' Definition 180
~ ~ ~ II ~ ~ ~ $ ~ ~ ~ ~ O ~ ~ ~ II) ~ e ~ ~ ~ ~ $ ~ e O ~ ~
7.2 Examples................................................ 189
7.3 Properties of the Stochastic Integral ........................ 190
7.4 Stochastic Differential and It6 Formula...................... 193
7.5 Stochastic Differential Equations ........................... 202
7.6 Solutions ................................................ 200
Index........................................................... 223