# Orthogonal Matching Pursuit
A *Greedy Algorithm* that aims to find the sparsest solution (i.e., one with the fewest non-zero entries) to
<img src="https://latex.codecogs.com/svg.latex?\inline&space;A\mathbf{x}=\mathbf{y}" title="A\mathbf{x}=\mathbf{y}" />,
where the full row rank matrix <img src="https://latex.codecogs.com/svg.latex?\inline&space;A&space;\in&space;\mathbb{R}^{m&space;\times&space;n}" title="A \in \mathbb{R}^{m \times n}" />
with <img src="https://latex.codecogs.com/svg.latex?\inline&space;m&space;<&space;n" title="m < n" /> generates an underdetermined system.
The optimization problem is described as:
<img src="https://latex.codecogs.com/svg.latex?\min_{\mathbf{x}}&space;\left&space;\|&space;\mathbf{x}&space;\right&space;\|_{0}&space;\quad&space;\textrm{s.t.}&space;\quad&space;A\mathbf{x}=\mathbf{y}" title="\large \center \min_{\mathbf{x}} \left \| \mathbf{x} \right \|_{0} \quad \textrm{s.t.} \quad A\mathbf{x}=\mathbf{y}" />
OMP works by first finding the support:
<img src="https://latex.codecogs.com/svg.latex?\inline&space;S:supp(\mathbf{x})=\{&space;i:x(i)\neq&space;0&space;\}" title="S:supp(x)=\{ i:x(i)\neq 0 \}" />
of the solution, and then solving the least squares problem:
<img src="https://latex.codecogs.com/svg.latex?\inline&space;\mathbf{x}_{S}&space;=&space;A_{S}^{\dag}\mathbf{y}" title="\mathbf{x}_{S} = A_{S}^{\dag}\mathbf{y}" />
corresponding to the support set.
### MATLAB function:
```matlab
x = OMP(A, y, tolerance)
```
## Performance Guarantee
OMP is guaranteed to provide the exact solution (zero tolerance) if this solution exists, and satisfies:
<img src="https://latex.codecogs.com/svg.latex?\|\mathbf{x}\|_{0}<&space;\frac{1}{2}\left&space;(&space;1+\frac{1}{\mu(A)}&space;\right&space;)" title="\|x\|_{0}< \frac{1}{2}\left ( 1+\frac{1}{\mu(A)} \right )" />
where the mutual coherence <img src="https://latex.codecogs.com/svg.latex?\inline&space;\mu(A)" title="\mu(A)" /> measures
the dependence between different columns of the system matrix, and is defined as:
<img src="https://latex.codecogs.com/svg.latex?\mu(A)=\underset{\underset{i\neq&space;j}{1\leq&space;i,j&space;\leq&space;n}}{max}&space;\frac{\mathbf{a}_{i}^{T}&space;\mathbf{a}_{j}}{\|\mathbf{a}_{i}\|_2&space;\|\mathbf{a}_{j}\|_2}" title="\mu(A)=\underset{\underset{i\neq j}{1\leq i,j \leq n}}{max} \frac{\mathbf{a}_{i}^{T} \mathbf{a}_{j}}{\|\mathbf{a}_{i}\|_2 \|\mathbf{a}_{j}\|_2}" />
### Reference:
Bruckstein, Alfred M., David L. Donoho, and Michael Elad.
["From sparse solutions of systems of equations to sparse modeling of signals and images."](http://www.geintra-uah.org/system/files/review_paper_siam_review.pdf)
*SIAM review* 51.1 (2009): 34-81.
白话机器学习
- 粉丝: 1w+
- 资源: 7650
最新资源
- 【ClothSwapFluxReduxBaseSemiAuto】FluxRedux基础换装
- 足球数据集,10714张图片,yolov darknet格式 标注,可识别 裁判员,足球,守门员和球员 89.8%的正确识别率
- Java毕业设计-基于springboot+Vue的毕业生实习与就业管理系统的设计与实现(附源码,部署教程).zip
- Java毕业设计-基于springboot+Vue的毕业设计成绩管理系统的设计与实现(附源码,部署教程).zip
- UI Spline Renderer 1.8(UI样条线曲线绘制工具)
- Java毕业设计-基于springboot+Vue的机动车号牌管理系统(附源码,部署教程).zip
- Java毕业设计-基于springboot+Vue的火锅店管理系统(附源码,部署教程).zip
- Java毕业设计-基于springboot+Vue的火锅店管理系统2(附源码,部署教程).zip
- Java毕业设计-基于SpringBoot+Vue的-Vue的毕业论文管理系统2(附源码,部署教程).zip
- Java毕业设计-基于springboot+Vue的毕业就业信息管理系统的设计与实现(附源码,部署教程).zip
- Java毕业设计-基于springboot+Vue的毕业就业信息管理系统的设计与实现2(附源码,部署教程).zip
- Java毕业设计-基于springboot+Vue的制造装备物联及生产管理erp系统2(附源码,部署教程).zip
- 基于模型预测控制的储能微网双层能量管理优化模型,融合风电、光伏与超级电容器,考虑电池退化成本,实现总运行成本最小化,精准调度消除预测误差波动 ,基于模型预测算法的含储能微网双层能量管理模型 关键词:储
- Java毕业设计-基于springboot+Vue的华府便利店信息管理系统2(附源码,部署教程).zip
- Java毕业设计-基于springboot+Vue的智慧校园之家长子系统(附源码,部署教程).zip
- Java毕业设计-基于SpringBoot+Vue的-Vue的毕业论文管理系统(附源码,部署教程).zip
资源上传下载、课程学习等过程中有任何疑问或建议,欢迎提出宝贵意见哦~我们会及时处理!
点击此处反馈