New minimal pair analysis dataset, this time for American sign-language! Also has a bit of controlled rearing work using the SHuBERT model!
(It’s minimal in the translation and not video, so there’s still lots to do!)
Kanishka Misra
Our preprint is accepted to the CVPR GenSign Workshop! �
We introduce ASL-MTP — a benchmark for targeted linguistic analysis of sign language models using minimal translation pairs, and test the SL translation model on capturing sign language structure.
📄 arxiv.org/abs/2604.27232
arxiv.org
Models of sign language have historically lagged behind those for spoken language (text and speech). Recent work has greatly improved their performance on tasks like sign language translation and isol...