Hong, LiangJie

In this post, I will discuss how Query Likelihood Language Models are formulated, especially through Multinomial Language Model and Multiple Bernoulli Model. A simple Maximum Likelihood Estimator is derived.

In this article, we will talk about a popular Topic Model, Probabilistic Latent Semantic Analysis (PLSA) with details including how it is formulated, how EM (Expectation Maximization) works and how EM is applied to PLSA.