Least Squares Problems. Let \(A \in \mathbb {R}^{m \times n}\) with \(m > n\) have rank \(n\) and \(b \in \mathbb {R}^m\). The Least Squares problem is to find \(x \in \mathbb {R}^n\) which makes \(\|Ax - b\|_2\) as small as possible.
- Show that \(x\) solves this Least Squares problem if and only if \(A^T Ax = A^T b\).
- What is meant by the QR factorization of matrix \(A\)?
- Show how to use the QR factorization of \(A\) to solve the Least Squares problem.