AICurious Logo

What is: mBARTHez?

SourceBARThez: a Skilled Pretrained French Sequence-to-Sequence Model
Year2000
Data SourceCC BY-SA - https://paperswithcode.com

BARThez is a self-supervised transfer learning model for the French language based on BART. Compared to existing BERT-based French language models such as CamemBERT and FlauBERT, BARThez is well-suited for generative tasks, since not only its encoder but also its decoder is pretrained.