High Performance Algorithms – Exercise 3
1) Assuming that A is not positive definite , that is vector z exits in which:
𝑧
∗
∙
𝐴
∙
𝑧
<
0
. Let's assume that there exists a Cholesky factorization for A, that is
there exists a lower triangular matrix L such that
𝐴
=
𝐿
∙
𝐿
∗
. After placing the
factorization into the above equation we get:
𝑧
∗
∙
𝐿
∙
𝐿
∗
∙
𝑧
=
𝐵
∗
𝐵
∗
<
0
Where
𝐵
=
𝑧
∗
∙
𝐿
.
That is of course cannot be right because
𝐵
∗
𝐵
∗
>
0
for every matrix B.
2) In a mathematical sense, if a vector z exists in which
𝑧
∗
∙
𝐴
∙
𝑧
<
0
then there is no L
such that
𝐴
=
𝐿
∙
𝐿
∗
as I have shown in the previous question. The following matrix
is not positive definite because there exists a vector z in which
𝑧
∗
∙
𝐴
∙
𝑧
=
0
and it
has Cholesky factorize:
1
1
1
1
for z =
1
―
1
𝑧
∗
∙
𝐴
∙
𝑧
=
0
and A has Cholesky factorization L =
1
0
1
0
.
This is assuming we allow zeros in the diagonal of L.
In the floating point sense assuming the Cholesky factorization is backward stable
then it is not possible for
𝐴
to be positive definite if A is not, otherwise applying the
algorithm on
𝐴
suppose to give us Null because A does not have a factorization and
this is true for all matrices close to
𝐴
thus all matrices close to
𝐴
are not positive
definite.
3) To find the LTL factorization I used a recursive algorithm, the algorithm is similar to
the Cholesky factorization. The algorithm begins by dividing A, L and T into 4
quarter, for each quarter we can divide the factorization into 4 equations :
𝐴
11
=
𝐿
11
∙
𝑇
11
∙
𝐿
𝑇
11
𝐴
12
=
𝐿
11
∙
𝑇
11
∙
𝐿
𝑇
21
+
𝐿
11
∙
𝑇
12
∙
𝐿
𝑇
22
𝐴
21
=
𝐿
21
∙
𝑇
11
∙
𝐿
𝑇
11
+
𝐿
22
∙
𝑇
21
∙
𝐿
𝑇
11
𝐴
22
=
𝐿
21
∙
𝑇
11
∙
𝐿
𝑇
21
+
𝐿
22
∙
𝑇
21
∙
𝐿
𝑇
21
+
𝐿
21
∙
𝑇
12
∙
𝐿
𝑇
22
+
𝐿
22
∙
𝑇
22
∙
𝐿
𝑇
22
The above equations take into account that L is lower triangular.
We can see
𝐴
12
=
𝐴
𝑇
21
as expected. From the above equations we will try to find L
and T.
The first equation is exactly a factorization of
𝐴
11
into LTL form, meaning we can
find
𝐿
11
and
𝑇
11
recursively.
After finding
𝐿
11
and
𝑇
11
we will find
𝐿
21
from
𝐴
21
:
𝐴
21
=
𝐿
21
∙
𝑇
11
∙
𝐿
𝑇
11
+
𝐿
22
∙
𝑇
21
∙
𝐿
𝑇
11
First we can take out
𝐿
𝑇
11
from the equation