Publications

Lucas Caccia, Alan Ansell, Edoardo Maria Ponti, Ivan Vulić, Alessandro Sordoni (2025). Training Plug-n-Play Knowledge Modules with Deep Context Distillation. COLM 2025.

PDF Cite

Alan Ansell, Ivan Vulić, Hannah Sterz, Anna Korhonen, Edoardo Maria Ponti (2024). Scaling Sparse Fine-Tuning to Large Language Models.

PDF Cite Code

Alan Ansell, Marinela Parović, Ivan Vulić, Anna Korhonen, Edoardo Maria Ponti (2023). Unifying Cross-Lingual Transfer across Scenarios of Resource Scarcity. EMNLP 2023.

PDF Cite Code

Alan Ansell, Edoardo Maria Ponti, Anna Korhonen, Ivan Vulić (2023). Distilling Efficient Language-Specific Models for Cross-Lingual Transfer. ACL 2023 (Findings).

PDF Cite Code

Marinela Parović, Alan Ansell, Ivan Vulić, Anna Korhonen (2023). Cross-Lingual Transfer with Target Language-Ready Task Adapters. ACL 2023 (Findings).

PDF Cite Code

Alan Ansell, Edoardo Maria Ponti, Anna Korhonen, Ivan Vulić (2022). Composable Sparse Fine-Tuning for Cross-Lingual Transfer. ACL 2022.

PDF Cite Code

Alan Ansell, Felipe Bravo-Marquez, Bernhard Pfahringer (2021). PolyLM: Learning about Polysemy through Language Modeling. EACL 2021.

PDF Cite Code

Alan Ansell, Edoardo Maria Ponti, Jonas Pfeiffer, Sebastian Ruder, Goran Glavaš, Ivan Vulić, Anna Korhonen (2021). MAD-G: Multilingual Adapter Generation for Efficient Cross-Lingual Transfer. EMNLP 2021 (Findings).

PDF Cite