Oct.
2007
CHINESE
JOURNAL
OF
ENGINEERING
MATHEMATICS
Vo
l.
24
No.
5
Article
ID:
1005-3085 (2007) 05-0788-07
A
New
Nonmonotonic
Self-adaptive
Tr
ust
Region
AIgorithm
with
Line
Search*
YANG
Yang
1
,2,
SUN
Wen-yu
2
(1- School of Mathematics and Physics Science
,
Xl
时
10U
Institute of Technology, Xuzhou 221008;
2- School of Mathematics and Computer Science
, Nanjing Normal University, Nanjing 210097)
Abstract:
We propose a new
trust
region algorithm which
the
trust
region radius
is
updated
at
a
variable rate. Moreover
,
the
new algorithm performs a backtracking line search from the
fa
i!
ed point instead of resolving
the
trust
region subproblem. A nonmonotonic criterion
is
also used
to
speed up
the
convergence.
We
establish
the
global convergence of
the
new
algorithm. Numerical results are also presented.
Keywords:
unconstrained optimization;
trust
region; line search; nonmonotonic; global convergence
Classification:
AMS(2000) 90C30
CLC
number:
022
1.
2
Document
code:
A
1
Introduction
We
consider
the
following
unconstrained
optimization
problem
JEi:Lf(z)
,
、‘
1·''
咱
ai
''''-‘、、
where
f(x)
is twice
continuously
differentiable.
'fr
ust
region
method
is a
very
effective
and
robust
technique
for solving
problem
(1)
to
find
the
global
optimal
solution.
At
the
kth
step
,
it
calculates
a
trial
step
d
k
by
solving
the
following
trust
region
subproblem
,
d
Lκ
B
T
,
d
嘈
t--q
,"
十
,
G
TK
Qd
+
儿
U
=
<一
、}/
,
GHH
/l
飞
JU
ι
岛川川川
H
AV
n
.,
A4EU
mc
队
(2)
(3)
where
儿
f(Xk)
and
gk
V'
f(Xk)
are
the
function
value
and
the
gradient
vector
at
the
current
approximation
iterate
Xk
,
respectively
,
Bk
is
an
n x n
symmetric
matrix
which
may
be
the
exact
Hessian
H(Xk)
or
the
quasi-Newton
approximation
and
ßk
> 0 is
the
trust
region
radius.
In
this
paper
,
the
notation
11.11
denotes
the
Euclidean
norm
on
Rn.
After
obtaining
d
k
,
the
trust
region
method
computes
the
ratio
Tk
between
the
actual
reduction
and
the
predicted
reduction
of
the
objective
function
to
check
if
dk is
acceptable.
Then
the
trust
region
radius
ßk
is
also
updated
according
to
the
value
of
Tk
, since
Tk
reflect
the
extent
to
which
the
quadratic
Received
date:
2005-11-25.
Biography:
Yang Yang
(Born
in
1981)
,
Female
, Master,
Teachi
吨
Ass
istant. Research
field:
Nonlinear Programming.
*Foundation
item: The National Natural
Science
Foundation
of
China
(10231060)
, the Special Research
Fu
nd of Doctoral Program of Higher Education
of
China
(20040319003)
and the Graduates' Creative Project
of
Jiangsu Province, China