A closer look at BookCorpus, a key dataset in machine learning

Sep 19, 2023 ·

BookCorpus has helped train at least thirty influential language models (including Google’s BERT, OpenAI’s GPT, and Amazon’s Bort), according to HuggingFace. This is the research question that…