There are three classical divergence measures exist in the literature on information theory and statistics. These are namely, Jeffryes-Kullback-Leiber (Jeffreys, 1946; Kullback and Leibler, 1951) J-divergence. Sibson-Burbea-Rao (Sibson, 1969), Jensen-Shannon divegernce, (Burbea and Rao, 1982), and Taneja (1995). Arithmetic-Geometric divergence. These three measures bear an interesting relationship among each other. The divergence measures like Hellinger (1909) discrimination, symmetric χ2-divergence, and triangular discrimination are also known in the literature. In this article, we have considered generalized symmetric divergence measures having the measures given above as particular cases. Bounds on the probability of error are obtained in terms of generalized symmetric divergence measures. Study of bounds on probability of error is extended for the difference of divergence measures.
Read full abstract