Wlodek Bryc, Topics in Statistics 15-MATH-576-001 Acad Year 1999/2000
Large Deviations techniques for performance analysis
Class home page: http://math.uc.edu/~brycw/classes/576/
Tentative plan
- Probabilities under the normal curve.
- Binomial distribution
A coin tossing experiment
(APG Dublin)
- Approximating functions: Limits, asymptotic expansions, rought
asymptotics
- Computing large factorials (Stirling's Formula)
- Rate functions: Normal, Binomial (Entropy), Cramer's theorem
-
Moment
generating functions.
Averages of independent observations:
- Examples for Cramer's variational formula.
- Application: Testing the hypothesis about the proportion H0: p=p0 versus
Ha: p=p1
- Application: simple investment model
- Application: risk management
-
Info:
Exact computations, numerical methods, and Simulations (Monte
Carlo)
- Application:
Simulating unlikely events
- Gartner's Theorem for sample averages. Examples: LD for Poisson,
normal,
Gamma
distributions.
- Application: long queues
- Info: Pentium processor, and long division
- Application: Testing simple hypothesis
H0: f=f0 versus
Ha: f=f1 (Stein's Lemma)
- Application: multiplexing
- Finite alphabets (empirical measures, entropy, examples)
- Finite alphabets (Sanov's Theorem)
- Application: Conditional limit theorems, Gibbs distributions
- Application: Shanon's Theorems: equipartition, rate distortion
- Random curves. Probabilities of paths
- Application: ruin probabilities, insurance premiums
- Application: the changepoint problem (Bucklew Ch IV E.)
- Overview: differential equations with small noise
- Overview: exit problems and their uses
- Overview: long segments in a string
- Overview: Rollback in parallel algorithms
- Info: Refined approximation - Bahadur-Rao Theorem
- Info: Refined approximation - Berry-Essen expansion
Theory
Stirling's Formula, binomial probabilities
Empirical measures, entropy
Combinatorial techniques
Large deviations for averages, moment generating functions
Varadhan's integrals
Large deviations for trajectories (?)
Finite State Markov chains (?)
Exact asymptotics [Bahadur-Rao theorem] (?)
Saddle point approximations (?)
Applications
An Application to Risk-Theory
Gibbs distributions
Financial models: value of a risky investment
Comparative analysis of DNA sequences
Analysis of computer search algorithms
Lenghts of long queues
Parallell buffering
Multiplexing
Conditional limits and simulations
Hypothesis testing: Chernoff bounds
Coding: Rate distortion theory, equipartition