GPT-wee: How Small Can a Small Language Model Really Get? - a bbunzeck Collection

bbunzeck 's Collections

Character-level LMs

Fifty shapes of BLiMP: syntactic learning curves in LMs

GPT-wee: How Small Can a Small Language Model Really Get?

GPT-wee: How Small Can a Small Language Model Really Get?

updated 12 days ago

Models trained as submission for BabyLM challenge 2023. Paper: https://aclanthology.org/2023.conll-babylm.2