Interested?
If you want to see all the experiments and find out why it works in the first place, you can check out the paper here:
arxiv.org/abs/2407.17771
Our code is available with the paper :)
We present Banyan, a model that efficiently learns semantic representations by leveraging explicit hierarchical structure. While transformers excel at scale, they struggle in low-resource settings. Co...
