Why Training Your Own Transformer Language Model from Scratch is (not) Stupid

When does pre-training your own Transformer language model make sense? What are the pitfalls, benefits, and steps of pre-training your own model, and the limitations ... Read more

Bron:

Towards Data Science - Medium