首页   按字顺浏览 期刊浏览 卷期浏览 Relative Entropy Measures of Multivariate Dependence
Relative Entropy Measures of Multivariate Dependence

 

作者: Harry Joe,  

 

期刊: Journal of the American Statistical Association  (Taylor Available online 1989)
卷期: Volume 84, issue 405  

页码: 157-164

 

ISSN:0162-1459

 

年代: 1989

 

DOI:10.1080/01621459.1989.10478751

 

出版商: Taylor & Francis Group

 

关键词: Multiple correlation;Nominal-categorical variables;Nonparametric measures of dependence;Ordinal-categorical variables;Partial correlation;Pearson's phi-square

 

数据来源: Taylor

 

摘要:

There has been a lot of work on measures of dependence or association for bivariate probability distributions or bivariate data. These measures usually assume that the variables are both continuous or both categorical. In comparison, there is very little work on multivariate or conditional measures of dependence. The purpose of this article is to discuss measures of multivariate dependence and measures of conditional dependence based on relative entropies. These measures are conceptually very general, as they can be used for a set of variables that can be a mixture of continuous, ordinal-categorical, and nominal-categorical variables. For continuous or ordinal-categorical variables, a certain transformation of relative entropy to the interval [0, 1] leads to generalizations of the correlation, multiple-correlation, and partial-correlation coefficients. If all variables are nominal categorical, the relative entropies are standardized to take a maximum of 1 and then transformed so that in the bivariate case, there is arelative reduction in variabilityinterpretation like that for the correlation coefficient. The relative entropy measures of dependence are compared with commonly used bivariate measures of association such as Kendall'sτband Goodman and Kruskal's λ and with measures of dependence based on Pearson's ϕ2distance. Examples suggest that these new measures of dependence should be useful additional summary values for nonmonotonic or nonlinear dependence. Assuming that the multivariate data are a random sample, the statistical measures of dependence with estimated probability density or mass functions can be studied asymptotically. Standard errors are obtained when all variables are categorical, and an outline of what must be done in the case of all continuous variables is given.

 

点击下载:  PDF (1441KB)



返 回