Feature-based Transfer Learning vs Fine Tuning?

2 min readOct 3, 2022

--

There are a lot of deep explanations elsewhere so here I’d like to share some example questions in an interview setting.

What’s the difference between feature-based transfer learning vs. fine tuning?

Deeplearning.ai: Transfer learning in NLP

Angelina Yang

Written by Angelina Yang

Head of Data @Underdog Fantasy | Linkedin: https://www.linkedin.com/in/yangyy/

More from Angelina Yang

Angelina Yang

A/B ⚖ Testing with Multiple Metrics

A lot of literature references and guidance about A/B testing anchor on tests based on one single comparison or one single metric. Some of…

4 min readDec 1, 2022

--

Angelina Yang

What’s the Difference Between Attention and Self-attention in Transformer Models?

“Attention” is one of the key ideas in the transformer architecture. There are a lot of deep explanations elsewhere so here we’d like to…

2 min readJul 19, 2022

--

Angelina Yang

How to Add New Tokens to a Transformer Model Vocabulary?

In this post, we will see how to expand the vocabulary of a transformers model by adding your own words or tokens.

2 min readJun 18, 2022

--

Angelina Yang

What is Exploration vs. Exploitation in Reinforcement Learning?

“Exploration and Exploitation dilemma” is one of the key concepts in reinforcement learning. There are a lot of deep explanations elsewhere…

3 min readJul 25, 2022

--

See all from Angelina Yang

Recommended from Medium

Skanda Vivek
in
Towards Data Science

Fine-Tune Transformer Models For Question Answering On Custom Data

A tutorial on fine-tuning the Hugging Face RoBERTa QA Model on custom data and obtaining significant performance boosts

5 min readDec 15, 2022

--

Martin Thissen
in
MLearning.ai

Understanding and Coding the Attention Mechanism — The Magic Behind Transformers

In this article, I’ll give you an introduction to the attention mechanism and show you how to code the attention mechanism yourself.

12 min readDec 6, 2022

--

Lists

What is ChatGPT?

9 stories57 saves

Stories to Help You Grow as a Software Developer

19 stories64 saves

Staff Picks

323 stories82 saves

Stories to Help You Level-Up at Work

19 stories51 saves

Babar M Bhatti

Essential Guide to Foundation Models and Large Language Models

The term Foundation Model (FM) was coined by Stanford researchers to introduce a new category of ML models. They defined FMs as models…

15 min readFeb 6

--

Storius Magazine
in
Storius Magazine

Under the Hood: How OpenAI’s GPT Really Works and What Makes It Different

Training, learning, and some very powerful hardware

10 min readJan 27

--

Skanda Vivek
in
Towards Data Science

Transformer Models For Custom Text Classification Through Fine-Tuning

A tutorial on how to build a spam classifier (or any other classifier) by fine-tuning the DistilBERT model

4 min readJan 20

--

Skanda Vivek
in
Towards Data Science

Extractive vs Generative Q&A — Which is better for your business?

The arrival of ChatGPT hints at a new era of search engines, this tutorial dives into the 2 basic types of AI based question answering

6 min readFeb 6

--

See more recommendations

Help
Status
Writers
Blog
Careers
Privacy
Terms
About
Text to speech