AICurious Logo

What is: Dialogue-Adaptive Pre-training Objective?

SourceDialogue-adaptive Language Model Pre-training From Quality Estimation
Year2000
Data SourceCC BY-SA - https://paperswithcode.com

Dialogue-Adaptive Pre-training Objective (DAPO) is a pre-training objective for dialogue adaptation, which is designed to measure qualities of dialogues from multiple important aspects, like Readability, Consistency and Fluency which have already been focused on by general LM pre-training objectives, and those also significant for assessing dialogues but ignored by general LM pre-training objectives, like Diversity and Specificity.