没有合适的资源?快使用搜索试试~ 我知道了~
非凸加二次惩罚性低秩和稀疏分解以实现噪声图像对齐
需积分: 10 0 下载量 25 浏览量
2021-05-12
08:01:47
上传
评论
收藏 2.7MB PDF 举报
温馨提示
本文提出了一种通用的方法来解决低秩结构的恢复问题,在这种方法中,数据可能会因某些未知的变换而变形,并由于稀疏或非稀疏噪声而损坏。 使用非凸罚分法来弥补现有凸罚分法的弊端,并进一步采用二次罚分法更好地处理数据中的非稀疏噪声。 我们利用局部线性逼近(LLA)方法将所得的非凸罚分问题转化为一系列加权凸罚分问题,并且这些子问题可以通过增强拉格朗日乘数(ALM)得到有效解决。 除了与线性相关图像的稀疏和低秩分解的鲁棒对准方法(RASL)进行比较外,我们还提出了一种非凸的惩罚性低秩和稀疏分解(NLSD)模型作为比较。 在受控和非受控数据上进行了数值实验,以证明所提出的方法在RASL和NLSD上的性能优于其他方法。
资源推荐
资源详情
资源评论
.
RESEARCH PAPER
.
SCIENCE CHINA
Information Sciences
doi: 10.1007/s11432-015-5419-2
c
Science China Press and Springer-Verlag Berlin Heidelberg 2016 info.scichina.com link.springer.com
Nonconvex plus quadratic penalized low-rank and
sparse decomposition for noisy image alignment
Xiai CHEN
1,2
, Zhi HAN
1,2
*
, Yao WANG
3
, Yandong TANG
1,2
&HaibinYU
1,2
1
State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences,
Shenyang 110016,China;
2
University of Chinese Academy of Sciences, Beijing 100049,China;
3
School of Mathematics and Statistics, Xi’an Jiaotong University, Xi’an 710049,China
Received May 24, 2015; accepted July 8, 2015
Abstract This paper proposes a general method for dealing with the problem of recovering the low-rank
structure, in which the data can be deformed by some unknown transformations and corrupted by sparse
or nonsparse noises. Nonconvex penalization method is used to remedy the drawbacks of existing convex
penalization method and a quadratic penalty is further used to better tackle the nonsparse noises in the data.
We exploits the local linear approximation (LLA) method for turning the resulting nonconvex penalization
problem into a series of weighted convex penalization problems and these subproblems are efficiently solved via
the augmented Lagrange multiplier (ALM). Besides comparing with the method of robust alignment by sparse
and low-rank decomposition for linearly correlated images (RASL), we also propose a nonconvex penalized low-
rank and sparse decomposition (NLSD) model as comparison. Numerical experiments are conducted on both
controlled and uncontrolled data to demonstrate the outperformance of the proposed method over RASL and
NLSD.
Keywords low-rank decomposition, nonconvex relaxation, quadratic penalized, batch image alignment, sparse
or nonsparse noise
Citation Chen X A, Han Z, Wang Y, et al. Nonconvex plus quadratic penalized low-rank and sparse decompo-
sition for noisy image alignment. Sci China Inf Sci, 2016, 59, doi: 10.1007/s11432-015-5419-2
1 Introduction
In recent years, with the development of Internet technology, massive amounts of image and video data
are available to us. All these high-dimensional data pose steep challenges to existing vision algorithms in
automatically extracting the hidden low-dimensional structures despite changing of viewpoints, illumina-
tions, occlusions, nonsparse noises, or even no alignment. Undone these nuisance factors in the processing
stage is of great importance in obtaining the true intrinsic structures of the data.
The classical Principal Component Analysis (PCA) [1, 2] is the most widely used statistical tool for
high-dimensional data analysis and dimensionality reduction today. But it also has been shown that PCA
technique only works well when the perturbation is i.i.d Gaussian, which means that it is not robust to
gross errors or outliers. The recent proposed Robust PCA [3] method utilizes a convex program that
* Corresponding author (email: hanzhi@sia.cn)
Chen X A, et al. Sci China Inf Sci
guarantees to recover a low-rank matrix despite gross sparse errors under rather broad conditions. To
a large extent, progress in batch image alignment has been driven by the recent breakthroughs in the
recovery of low-rank matrices. In the literatures, it has been shown that, if the given matrix data is a
deformed or corrupted version of an intrinsically low-rank matrix, one can exactly recover the low-rank
structures despite different types of deformation and severe corruptions. Such concepts and techniques
have been successfully applied to multiple correlated images alignment (such as video frames or human
faces) which refers to the problem of transforming different images into the same coordinate system [4–7].
As we shall show in Section 2, the noise image alignment problem we study in this paper can be
transformed to a series of joint nuclear norm and
1
-norm minimization problems. It is known that the
nuclear norm of a matrix can be related to the
1
-norm of a vector. And several studies [8–10] have
shown that the
1
-norm (or Lasso) penalty over-penalizes large entries of vectors, and usually cannot
avoid modeling bias in various sparse learning problems. To correct the intrinsic estimation bias of the
1
-norm, the folded-concave penalty has been proposed and shown nice nearly unbiased property through
numerous numerical and theoretical studies [8, 11–13]. Moreover, the relationship between the
1
-norm
and the nuclear norm also implies that the nuclear norm over-penalizes large singular values, and thus the
modeling bias phenomenon also exists in low rank structure estimation with nuclear norm penalty [14].
As such, it is natural to apply the folded-concave penalization technique to deal with various low-rank
structure learning applications. Several studies have demonstrated the superiority of folded-concave
penalty based approaches over nuclear norm based approaches [15–17]. And then by combining the LLA
algorithm and the ALM method, we present an efficient algorithm for solving the nonconvex problem.
Although Ref. [18] has shown that the sparse and low-rank matrix decomposition (without transforma-
tions) by the convex optimization is also stable to additive Gaussian noise of small magnitude in addition
to sparse errors, it loses efficacy when dealing with the real applications whose observations are often
corrupted by non-sparse noises, which may be stochastic or deterministic, affecting every entry of the
data matrix. The existing methods simply assume that the noises either obey a Gaussian distribution
(PCA) or obey a Laplacian distribution, while in many real applications, the noises are often mixed with
both sparse and nonsparse noises. Therefore, for the wider applicability of the model, it would be of
great significance to simultaneously estimate the sparse and non-sparse errors in order to guarantee the
stable and accurate recovery in the presence of entry-wise noise. In this paper, we proposed to simul-
taneously use the
1
-norm and the
F
-norm to model the noises which can thus model a wider range of
noise distributions.
The main purpose of this paper is to propose a general nonconvex plus quadratic penalized low-rank and
sparse matrices decomposition model, combining the folded-concave penalties and an advanced quadratic
F
-norm penalty, for dealing with the non-sparse noisy image problems. The main contributions of
our work are summarized as: (1) To reduce the modeling bias of
1
-norm, folded-concave penalization
technique is employed to achieve better alignment results; (2) An additional
F
-norm penalty is used to
estimate non-sparse noise in real applications; (3) An efficient LLA-ALM algorithm is derived for finding
a good local solution of the resulting nonconvex optimization problem.
The remainder of this paper is organized as follows. In Section 2, by stating the related work, we
describe the batch image alignment problem. Section 3 presents a generalized low-rank decomposition
model with advanced penalties. Section 4 provides a novel algorithm for the solution of the proposed
model. Section 5 conducts a series of simulation with controlled and natural data sets to demonstrate the
efficiency of the nonconvex based model over RASL for dealing with the problem. Concluding remarks
are given in Section 6.
2 Related work
In real data, the images are often contaminated by occlusion, noise, illumination and even misalignment.
Therefore, dealing with image alignment with robustness is a challenging work to the existing image
processing methods. Peng et al. [19] proposed RASL to robustly align linearly correlated images by
剩余12页未读,继续阅读
资源评论
weixin_38747592
- 粉丝: 6
- 资源: 937
上传资源 快速赚钱
- 我的内容管理 展开
- 我的资源 快来上传第一个资源
- 我的收益 登录查看自己的收益
- 我的积分 登录查看自己的积分
- 我的C币 登录后查看C币余额
- 我的收藏
- 我的下载
- 下载帮助
最新资源
资源上传下载、课程学习等过程中有任何疑问或建议,欢迎提出宝贵意见哦~我们会及时处理!
点击此处反馈
安全验证
文档复制为VIP权益,开通VIP直接复制
信息提交成功