How to Test NLP Models from the Lens of Software Engineering?

Angelina Yang
3 min readMay 17, 2022

Today we would like to get some tips on what to think about before we launch a NLP model to production.

Once we built our new NLP model, beat some benchmarks, what should we do next? When should we pull the trigger to use it in a real production setting?

Microsoft Researcher and Assistant Professor at the University of Washington, Marco Tulio Ribeiro, talked about how to think about testing NLP models in preparation for a successful launch, similar to how we are used to thinking about testing…