INFORMATION THEORY

ECE 730

Review of basic probability. Advanced probability concepts. Random vectors; linear filtering of random processes; stationarity; power spectral densities; estimation; convergence; Markov chains; Poisson process; Wiener process. Knowledge of basic probability analysis [such asE C E 331,STAT/​MATH  431, orSTAT 311] strongly encouraged.

COMPSCI/ECE 561

Probabilistic tools for machine learning and analysis of real-world datasets. Introductory topics include classification, regression, probability theory, decision theory and quantifying information with entropy, relative entropy and mutual information. Additional topics include naive Bayes, probabilistic graphical models, discriminant analysis, logistic regression, expectation maximization, source coding and variational inference.

ECE 437

Statistical analysis of information transmission systems. Probability of error, design of receivers for digital transmission through additive white Gaussian noise channels and bandlimited channels. Spread spectrum communication systems. Channel capacity, source and error control coding.

ECE 436

Amplitude, frequency, pulse, and pulse-code modulation. Narrow-band noise representation and signal-to-noise ratios for various modulation schemes. Pulse shaping, timing recovery, carrier synchronization, and equalization. Sampling, quantization and coding.

ECE 203

Introduction to the signals, information, and computational techniques in electrical engineering.