Self-Supervised Learning

Rethinking Semi-supervised Learning with Language Models
Semi-supervised learning (SSL) is a popular setting aiming to effectively utilize unlabelled data to improve model performance in …
Preprint PDF Cite Code HTML
Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations
Bootstrapping an unsupervised sentence encoder by self-distilling knowledge between its bi-encoder and cross-encoder forms, enhancing each other iteratively.
Preprint PDF Cite Code Video HTML Blogpost