RANDOMIZED LINEAR ALGEBRA AND APPLICATIONS

MATH 718

Course Description

Random solvers have been playing increasingly crucial roles in the modern computational tasks. The recent breakthroughs in applied and computational linear algebra that incorporate techniques of randomization have proven to be of great importance in modern applied math, computational sciences and data science, such as inverse problems, machine learning and scientific computing. The guiding principle is that one may greatly reduce computational and storage expenses at the cost of a small probability of failure. Systematic study of these modern methods of randomized linear algebra solvers will be provided, presenting mathematical backgrounds, algorithms, and concrete applications. Core theoretical topics include randomized Kaczmarz and its generalization to stochastic gradient descent, randomized singular value decomposition, random sketching, matrix completion, and compressive sensing, and corresponding applications.

Prerequisties

Graduate/professional standing or declared in Mathematics VISP (graduate or dissertator)

Satisfies

This course does not satisfy any prerequisites.

Credits

Not Reported

Offered

Not Reported

Grade Point Average

3.83

No change from Historical

Completion Rate

100%

No change from Historical

A Rate

65.22%

No change from Historical

Class Size

No change from Historical

Instructors (2025 Fall)

Sorted by ratings from Rate My Professors

Similar Courses

STOCHASTIC COMPUTATIONAL METHODS

MATH 717

Introduction to computational methods that use stochastic algorithms and/or methods that are applied to random or stochastic mathematical problems. The main emphasis will be placed on learning practical tools, while some aspects of theoretical foundations will also be covered (e.g., basic error analysis for numerical solution of stochastic differential equations (SDEs), and basic convergence of Monte Carlo methods). Topics include Monte Carlo methods, Bayesian inference and Bayesian sampling, simulation of Markov chains, numerical analysis for SDEs, data assimilation / state estimation, stochastic optimization methods and random sketching. Applications to science, engineering, finance, data science, and other practical problems also included.

LINEAR RANDOMIZED ALGORITHMS FOR DATA SCIENCE

STAT 772

Introduce new algorithms that leverage randomization to address the scale, speed, and sensitivity needs of modern data science. Develop the mathematical foundations of such randomized algorithms. Criticize these algorithms through the lens of computational resource utilization. Implement these algorithms to address linear problems in data science.

MATRIX METHODS IN MACHINE LEARNING

COMPSCI/ECE/ME 532

Linear algebraic foundations of machine learning featuring real-world applications of matrix methods from classification and clustering to denoising and data analysis. Mathematical topics include: linear equations, regression, regularization, the singular value decomposition, and iterative algorithms. Machine learning topics include: the lasso, support vector machines, kernel methods, clustering, dictionary learning, neural networks, and deep learning. Previous exposure to numerical computing (e.g. Matlab, Python, Julia, R) required.

ADVANCED ALGORITHMS

COMPSCI 787

Advanced paradigms for the design and analysis of efficient algorithms, including the use of randomness, linear programming, and semi-definite programming. Applications to data structures, approximating NP-hard optimization problems, learning, on-line and distributed problems. Students are strongly encouraged to have introductory knowledge of algorithms (e.g.,COMP SCI 577)

LINEAR ALGEBRA AND OPTIMIZATION

MATH 345

Introduction to linear algebra, differential calculus in several variables, and basic optimization theory with applications to data science and related topics. Vectors, analytic geometry, matrices, linear functions, linear independence, orthogonality, inverses, partial derivatives and gradients, Taylor approximation, gradient descent, Lagrange multipliers, clustering, regression, classification. Implementation in Python.