Analysis on text representations
- “Randomly Removing 50% of Dimensions in Text Embeddings has Minimal Impact on Retrieval and Classification Tasks”
- Sotaro Takeshita, Yurina Takeshita, Daniel Ruffinelli, Simone Paolo Ponzetto
- EMNLP main 2025 (oral), paper, arXiv, project page, code
- tl;dr: just remove half
- People’s Choice Award (link, post)
- “To MRL or not to MRL: Text Embeddings are Robust to Truncation Without Matryoshka Learning, Except In Heavy Truncation Scenarios”
- Sotaro Takeshita, Yurina Takeshita, Simone Paolo Ponzetto, Daniel Ruffinelli
- To appear at EMNLP 2026 (Findings), arxiv, project page, code
- tl;dr: MRL?
Research paper summarization
- “ACLSum: A New Dataset for Aspect-based Summarization of Scientific Publications”
- Sotaro Takeshita, Tommaso Green, Ines Reinig, Kai Eckert and Simone Paolo Ponzetto
- NAACL 2024 / pdf / data
- tl;dr: annotation for summarization task take a lot of time
- “ROUGE-K: Do Your Summaries Have Keywords?”
- Sotaro Takeshita, Simone Paolo Ponzetto, Kai Eckert
- *SEM 2024 / pdf
- Best Long Paper (link)
- tl;dr: what is keyword?
- “Cross-lingual extreme summarization of scholarly documents”
- Sotaro Takeshita, Tommaso Green, Niklas Friedrich, Kai Eckert and Simone Paolo Ponzetto
- International Journal on Digital Libraries / 2023 / paper / code / data
- tl;dr: publishing a journal paper takes time
- “X-SCITLDR: Cross-Lingual Extreme Summarization of Scholarly Documents”
- Sotaro Takeshita, Tommaso Green, Niklas Friedrich, Kai Eckert and Simone Paolo Ponzetto
- ACM/IEEE Joint Conference on Digital Libraries (JCDL), 2022 / paper / code / data
- tl;dr: Dataset for papers in en to summaries in (de/it/zh/ja).
- “IRSum: One Model to Rule Summarization and Retrieval”
- Sotaro Takeshita, Simone Paolo Ponzetto, Kai Eckert
- GEM Workshop at ACL 2025, paper
- tl;dr: now we don’t have to process the same document twice
System demonstrations
- “GenGO Ultra: an LLM-powered ACL Paper Explorer”
- Sotaro Takeshita, Tornike Tsereteli, Simone Paolo Ponzetto
- ACL SDT 2025, system / paper
- tl;dr: keep running LLM app cheaply is even harder
- “GenGO: ACL Paper Explorer with Semantic Features”
- Sotaro Takeshita, Simone Paolo Ponzetto, Kai Eckert
- ACL SDT 2024
- ACL 2024 SDT / paper / system
- tl;dr: keep running ML app cheaply is hard
Collaborations with friends
- “SciLaD: A Large-Scale, Transparent, Reproducible Dataset for Natural Scientific Language Processing”
- Luca Foppiano, Sotaro Takeshita, Pedro Ortiz Suarez, Ekaterina Borisova, Raia Abu Ahmad, Malte Ostendorff, Fabio Barth, Julian Moreno-Schneider, Georg Rehm
- To appear at LREC 2026, arXiv
- tl;dr: pre-training is expensive
- “ZusammenQA: Data Augmentation with Specialized Models for Cross-lingual Open-retrieval Question Answering System”
- Chia-Chien Hung, Tommaso Green, Robert Litschko, Tornike Tsereteli, Sotaro Takeshita, Marco Bombieri, Goran Glavaš, Simone Paolo Ponzetto
- NAACL 2022 - MIA shared-task / pdf / code
- tl;dr: Cross-lingual QA is hard.