BERT classifier fine-tuning with PyTorch, HuggingFace, and Catalyst. Part 1. Intro
In the 1st part of the tutorial we describe the reusable BERT fine-tuning pipeline
I’m sharing the pipeline that I actually use at work (that’s not a Kaggle Notebook anymore) which follows a modular approach, is easy to run and be reproduced.
The follow-up parts of this tutorial cover:
- data preparation for training, from CSV files to PyTorch DataLoaders
- understanding the BERT classifier model by HuggingFace, digging into the code of the transformers library
- running the pipeline with Catalyst and GPUs