Search:
Computing and Library Services - delivering an inspiring information environment

A Simple Method for Estimating Term Mutual Information

Cai, Di and McCluskey, Thomas L. (2012) A Simple Method for Estimating Term Mutual Information. Journal of Computing, 4 (6). pp. 1-6. ISSN 2151-9617

[img]
Preview
PDF
Cai+2012a.pdf - Published Version

Download (974kB) | Preview

Abstract

The ability to formally analyze and automatically measure statistical dependence of terms is a core problem in many areas of science. One of the commonly used tools for this is the expected mutual information (MI) measure. However, it seems
that MI methods have not achieved their potential. The main problem in using MI of terms is to obtain actual probability distributions estimated from training data, as the true distributions are invariably not known. This study focuses on the problem and proposes a novel but simple method for estimating probability distributions. Estimation functions are introduced; mathematical meaning of the functions is interpreted and the verification conditions are discussed. Examples are provided to illustrate the possibility of failure of applying the method if the verification conditions are not satisfied. An extension of the method is considered.

Item Type: Article
Subjects: Q Science > Q Science (General)
Schools: School of Computing and Engineering
School of Computing and Engineering > High-Performance Intelligent Computing
School of Computing and Engineering > High-Performance Intelligent Computing > Planning, Autonomy and Representation of Knowledge
School of Computing and Engineering > High-Performance Intelligent Computing > Planning, Autonomy and Representation of Knowledge

School of Computing and Engineering > Pedagogical Research Group
Related URLs:
Depositing User: Di Cai
Date Deposited: 13 Nov 2012 16:22
Last Modified: 13 Nov 2012 16:22
URI: http://eprints.hud.ac.uk/id/eprint/15984

Downloads

Downloads per month over past year

Repository Staff Only: item control page

View Item View Item

University of Huddersfield, Queensgate, Huddersfield, HD1 3DH Copyright and Disclaimer All rights reserved ©