MIToolbox
=========
v2.1 for C/C++ and MATLAB/Octave
MIToolbox contains a set of functions to calculate information theoretic
quantities from data, such as the entropy and mutual information. The toolbox
contains implementations of the most popular Shannon entropies, and also the
lesser known Renyi entropy. The toolbox also provides implementations of
the weighted entropy and weighted mutual information from "Information Theory
with Application", S. Guiasu (1977). The toolbox only supports discrete distributions,
as opposed to continuous. All real-valued numbers will be processed by x = floor(x).
These functions are targeted for use with feature selection algorithms rather
than communication channels and so expect all the data to be available before
execution and sample their own probability distributions from the data.
Functions contained:
- Entropy
- Conditional Entropy
- Mutual Information
- Conditional Mutual Information
- generating a joint variable
- generating a probability distribution from a discrete random variable
- Renyi's Entropy
- Renyi's Mutual Information
- Weighted Entropy
- Weighted Mutual Information
- Weighted Conditional Mutual Information
Note: all functions are calculated in log base 2, so return units of "bits".
======
Examples:
>> y = [1 1 1 0 0]';
>> x = [1 0 1 1 0]';
>> mi(x,y) %% mutual information I(X;Y)
ans =
0.0200
>> h(x) %% entropy H(X)
ans =
0.9710
>> condh(x,y) %% conditional entropy H(X|Y)
ans =
0.9510
>> h( [x,y] ) %% joint entropy H(X,Y)
ans =
1.9219
>> joint([x,y]) %% joint random variable XY
ans =
1
2
1
3
4
======
To compile the library for use in MATLAB/OCTAVE, execute CompileMIToolbox.m
from within MATLAB, or run 'make matlab' from a terminal.
To compile the library for use with C programs run 'make x86' for a 32-bit
library, or 'make x64' for a 64-bit library.
The C source files are licensed under the LGPL v3. The MATLAB wrappers and
demonstration feature selection algorithms are provided as is with no warranty
as examples of how to use the library in MATLAB.
Update History
- 22/02/2014 - v2.1 - Fixed a couple of bugs related to memory handling.
Added a make install for compatibility with PyFeast.
- 30/07/2011 - v2.00 - Added implementations of the weighted entropy and weighted
mutual information. More cleanup of Mex entry point
to further check the inputs.
- 08/11/2011 - v1.03 - Minor documentation changes to accompany the JMLR publication.
- 15/10/2010 - v1.02 - Fixed bug where MIToolbox would cause a segmentation fault
if a x by 0 empty matrix was passed in. Now prints an
error message and returns gracefully.
- 02/09/2010 - v1.01 - Fixed a bug in CMIM.m where the last feature would not be
selected first if it had the highest MI.
- 07/07/2010 - v1.00 - Initial Release.
FEAST-v1.1.1.zip_FEAST-v1.1.4_feast_feast特征选择_matlab 特征选择_site:w
版权申诉
67 浏览量
2022-07-14
02:32:09
上传
评论
收藏 99KB ZIP 举报
weixin_42651887
- 粉丝: 79
- 资源: 1万+
最新资源
- 基于matlab实现 powell算法 用matlab实现,使用方法内附详细说明.rar
- 基于matlab的手写字体识别程序,并对结果进行保存.rar
- 基于c语言指纹识别demo代码 包括了指纹图像方向图计算、频率计算、gabor滤波器增强,细化,特征点提取,特征点匹配.rar
- 基于c++NSGA-2思想的多目标优化程序,采用进化算法处理多目标实值优化问题.rar
- Linux系统中常用权限管理命令
- Coello Coello等人提出了MOPSO 该程序基于matlab实现针对测试函数matlab程序
- Linux系统中常用权限管理命令
- AIR-AP1815-K9-ME-8-5-182-0.tar For Cisco AP1815
- 实验七.zip
- ESP8266刷固件软件flash-download-tools-v3.6.5,AT固件,机智云固件
资源上传下载、课程学习等过程中有任何疑问或建议,欢迎提出宝贵意见哦~我们会及时处理!
点击此处反馈
评论0