How to Explain “Language Modeling” to Your PM?

There are a lot of deep explanations elsewhere about language models, here I’d like to share some example questions in an interview setting.

How would you explain “language modeling” to your product manager?

Source : NLP Breakfast 2: The Rise of Language Models

Here are some tips for readers’ reference:

Simply put, language modeling is the task of predicting what word comes next given a prompt or the start of a sentence.

More formally, given a sequence of words X(1) up to X(t), a language model is something that computes the probability distribution of the next word, X(t+1). So a language model comes up with the conditional probability of what X(t+1) is given the words it found, from any word from a fixed vocabulary.

Watch how Abby See from Stanford explains it:

Watch the explanation!

Happy practicing!

Thanks for reading my newsletter. You can follow me on Linkedin or Twitter@Angelina_Magr!

There are possibly different angles to answer interview questions. The author of this newsletter does not try to find a reference that answers a question exhaustively. Rather, the author would like to share some quick insights and help the reader to think, practice and do further researches as necessary.

Source of quotes/videos: Stanford CS224N Lecture 6 (Winter 2019) — Lecture 6 — Language Models and RNNs by Dr. Abby See
Source of images/Good reads: Blog . NLP Breakfast 2: The Rise of Language Models