On the Probabilistic Latent Semantic Analysis Generalization as the Singular Value Decomposition Probabilistic Image

DOI

10.2991/jsta.d.200605.001How to use a DOI?

Keywords

Singular value decomposition; Probabilistic latent semantic analysis; Nonnegative matrix factorization; Kullback–Leibler divergence

Abstract

The Probabilistic Latent Semantic Analysis has been related with the Singular Value Decomposition. Several problems occur when this comparative is done. Data class restrictions and the existence of several local optima mask the relation, being a formal analogy without any real significance. Moreover, the computational difficulty in terms of time and memory limits the technique applicability. In this work, we use the Nonnegative Matrix Factorization with the Kullback–Leibler divergence to prove, when the number of model components is enough and a limit condition is reached, that the Singular Value Decomposition and the Probabilistic Latent Semantic Analysis empirical distributions are arbitrary close. Under such conditions, the Nonnegative Matrix Factorization and the Probabilistic Latent Semantic Analysis equality is obtained. With this result, the Singular Value Decomposition of every nonnegative entries matrix converges to the general case Probabilistic Latent Semantic Analysis results and constitutes the unique probabilistic image. Moreover, a faster algorithm for the Probabilistic Latent Semantic Analysis is provided.

Copyright

© 2020 The Authors. Published by Atlantis Press SARL.

Open Access

This is an open access article distributed under the CC BY-NC 4.0 license (http://creativecommons.org/licenses/by-nc/4.0/).

Download article (PDF)
View full text (HTML)

TY  - JOUR
AU  - Pau Figuera Vinué
AU  - Pablo García Bringas
PY  - 2020
DA  - 2020/06/19
TI  - On the Probabilistic Latent Semantic Analysis Generalization as the Singular Value Decomposition Probabilistic Image
JO  - Journal of Statistical Theory and Applications
SP  - 286
EP  - 296
VL  - 19
IS  - 2
SN  - 2214-1766
UR  - https://doi.org/10.2991/jsta.d.200605.001
DO  - 10.2991/jsta.d.200605.001
ID  - Vinué2020
ER  -