Course information:

       

        Title:                            Computational Methods of Linear Algebra

        Term:                           Spring 2017

        Credit hours:                3

        Time and location:       Lecture - 18:00 - 17:20pm TR, Old Main 201

        Instructor:                    Xianyi Zeng ( xzeng at utep dot edu )

                                            Bell Hall 202

                                            Office hour: 14:00pm - 15:00pm Tuesday,

                                                                11:00am - 12:00pm Friday,

                                                                 or by appointment.

        Teaching assistant:     TBD

        Textbook:                    Granville Sewell, Computational Methods of Linear Algebra.

                                            3rd Edition, World Scientific Publishing Company 2014.

Course materials:


        Syllabus:                     The course syllabus is found here.

        T 01/17 Lecture:          Lecture Note 1: ln01.pdf. Preliminaries.

                                            Last updated: 02/05/2017

                                            - Page 6, above Eq.(4.4).

                                              Add a footnote to the equivalence of two norms.

                                            - Page 8, Exercise 3.

                                              Add a clarification of only considering diagonalizable matrices.

                                            Homework 1 due 01/26/2017 Thursday by the end of the class.

        T 01/24 Lecture:          Lecture Note 2: ln02.pdf. Gaussian elimination, LU decomposition,

                                            and roundoff error analysis.

                                            Last updated: 02/05/2017

                                            - Page 2, below Eq.(1.5).

                                              Add clarification of how L is computed.

                                            - Page 5, at the end of Section 2.

                                              The comment on the rank of A is revised.

                                            - Page 12, Exercise 1.

                                              The two sub-solvers are revised.

                                            Homework 2 due 02/02/2017 Thursday by the end of the class.

        T 01/31 Lecture:          Lecture Note 3: ln03.pdf. Iterative methods.

                                            Last updated: 02/07/2017

                                            - Page 5, the proof of theorem 3.1 is revised.

                                            - Page 7, the hints of the first two exercises revised.

                                            Homework 3 due 02/09/2017 Thursday by the end of the class.

        T 02/02 Lecture:          Lecture Note 4: ln04.pdf. The conjugate gradient method.

                                            Last updated: 02/17/2017

                                            - Page 7, a convergence estimate is added.

                                            - Page 1, alpha^2 is added to the big-O term.

        T 02/07 Lecture:          Lecture Note 5: ln05.pdf. The minimum-residual Krylov methods.

                                            Last updated: 02/17/2017

                                            - Page 1, revised the footnote.

                                            Homework 4 due 02/16/2017 Thursday by the end of the class.

                                            This homework contains exercises in both Lecture 4 and Lecture 5.

        TR 02/09 Lecture:       Lecture Note 6: ln06.pdf. Generalizing the conjugate gradient method.

        T 02/14 Lecture:          Lecture Note 7: ln07.pdf. BICGSTAB.

                                            Last updated: 02/19/2017

                                            - Added the computational assignment.

                                            Computational Assignment 1 due 03/09/2017 Thursday by the end of

                                            the class.

                                            Data files:

                                            1) Symmetric problem:

                                                mat_sym_A.txt

                                                mat_sym_b.txt

                                                mat_sym_M.txt

                                            2) Unsymmetric problem:

                                                mat_unsym_A.txt

                                                mat_unsym_b.txt

                                                mat_unsym_M.txt

                                            You could use any programming language you like, but Matlab, C, or

                                            C++ are highly suggested.

                                            A full submission include a brief report including how to build and run

                                            your program, as well as plotting convergence results (the residual

                                            plot).

        TR 02/16 Lecture:       Lecture Note 8: ln08.pdf. Introduction to least squares problems.

                                            Last updated: 02/19/2017

                                            - Added an appendix showing that col(A^tA) = col(A^t).

        T 02/21 Lecture:          Lecture Note 9: ln09.pdf. Orthogonal reduction with Givens rotation.

        T 02/28 Lecture:          Midterm 1 Review.

        TR 03/02 Lecture:       Midterm 1.

        T 03/07 Lecture:          Lecture Note 10: ln10.pdf. QR decomposition with Householder

                                            transformations.

        TR 03/09 Lecture:       Lecture Note 11: ln11.pdf. GMRES revisited using Householder

                                            transformations for orthogonalization and Givens rotations for

                                            the least squares solve of Hessenberg matrices.

                                            Homework 5 due 03/23/2017 Thursday by the end of the class.

        T 03/14 Lecture:         Spring Break.

        TR 03/16 Lecture:       Spring Break.

        T 03/21 Lecture:          Lecture Note 12: ln12.pdf. Introduction to the eigenvalue problem.

        T 03/28 Lecture:          Lecture Note 13: ln13.pdf. Jacobi algorithm for symmetric matrices.

                                            Computational Assignment 2: See the end of lecture 11.

                                            Target: Implement GMRES and compare the performance with

                                                        CGS and BICGSTAB for the non-symmetric problem before.

                                            A full report is required in submission.

                                            Due: 04/06/2017 Thursday by the end of the class.

        T 04/04 Lecture:          Lecture Note 14: ln14.pdf. The QR method for general matrices.

                                            Last updated: 04/12/2017

                                            - Added the last section in generalized eigenvalue problem.

                                            Homework 6: Exercises of Lecture Note 12.

                                            Due 04/13/2017 Thursday by the end of the class.

        T 04/11 Lecture:          Lecture Note 15: ln15.pdf. The singular value decomposition.