Sebastian Ruder

Cited by

	All	Since 2019
Citations	36326	34573
h-index	54	53
i10-index	93	93

8000

4000

2000

6000

20172018201920202021202220232024345 1212 2835 4340 5332 6270 7836 7919

Public access

View all

12 articles

0 articles

available

not available

Based on funding mandates

Co-authors

Ivan VulićPrincipal Research Associate, University of Cambridge & PolyAIVerified email at cam.ac.uk
Anders SøgaardFull Professor in NLP and Machine Learning, University of CopenhagenVerified email at di.ku.dk
Jonas PfeifferResearch Scientist, Google DeepMindVerified email at google.com
Dani YogatamaReka, USCVerified email at reka.ai
Parsa GhaffariQuantexaVerified email at quantexa.com
Iryna GurevychFull Professor, TU Darmstadt; Adjunct Professor, MBZUAI, UAE; Affiliated Professor, INSAIT, BulgariaVerified email at cs.tu-darmstadt.de
Graham NeubigCarnegie Mellon University, All Hands AIVerified email at cs.cmu.edu
Jeremy HowardHonorary Professor, University of QueenslandVerified email at zz.lc
Melvin JohnsonResearcher, GoogleVerified email at stanford.edu
Orhan FiratGoogle AIVerified email at google.com
John G. BreslinProfessor at the University of Galway and Co-PI at the Insight SFI Research CentreVerified email at universityofgalway.ie
Yi TayResearch Scientist, Google BrainVerified email at google.com
Aditya SiddhantGoogleVerified email at google.com
Junjie HuAssistant Professor, University of Wisconsin-MadisonVerified email at wisc.edu
Donald MetzlerGoogle DeepMindVerified email at google.com
Dara BahriResearch Scientist, Google ResearchVerified email at google.com
Matthew E PetersSpiffy AI, Allen Institute for Artificial IntelligenceVerified email at allenai.org
Thomas WolfCo-founder at HuggingFaceVerified email at polytechnique.edu
Isabelle AugensteinFull Professor, Department of Computer Science, University of CopenhagenVerified email at di.ku.dk
Mostafa DehghaniResearch Scientist, Google DeepMindVerified email at google.com

Sebastian Ruder

Research Scientist, Cohere

Verified email at cohere.com - Homepage

Natural Language Processing Machine Learning Deep Learning Artificial Intelligence


Title Sort by citations Sort by year Sort by title	Cited by Cited by	Year
An overview of gradient descent optimization algorithms S Ruder arXiv preprint arXiv:1609.04747, 2016	10686	2016
Universal Language Model Fine-tuning for Text Classification J Howard, S Ruder Proceedings of ACL 2018, 2018	5141	2018
An Overview of Multi-Task Learning in Deep Neural Networks S Ruder arXiv preprint arXiv:1706.05098, 2017	3714	2017
Gemini: a family of highly capable multimodal models G Team, R Anil, S Borgeaud, Y Wu, JB Alayrac, J Yu, R Soricut, ... arXiv preprint arXiv:2312.11805, 2023	1490	2023
PaLM 2 technical report R Anil, AM Dai, O Firat, M Johnson, D Lepikhin, A Passos, S Shakeri, ... arXiv preprint arXiv:2305.10403, 2023	1218	2023
NusaCrowd: Open Source Initiative for Indonesian NLP Resources S Cahyawijaya, H Lovenia, AF Aji, GI Winata, B Wilie, R Mahendra, ... Findings of ACL 2023, 2023	1091	2023
XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization J Hu, S Ruder, A Siddhant, G Neubig, O Firat, M Johnson Proceedings of ICML 2020, 2020	899	2020
A Survey of Cross-lingual Word Embedding Models S Ruder, I Vulić, A Søgaard Journal of Artificial Intelligence Research 65, 569-631, 2019	770	2019
Transfer learning in natural language processing S Ruder, ME Peters, S Swayamdipta, T Wolf Proceedings of the 2019 conference of the North American chapter of the …, 2019	747	2019
On the cross-lingual transferability of monolingual representations M Artetxe, S Ruder, D Yogatama Proceedings of ACL 2020, 2020	727	2020
Adapterhub: A framework for adapting transformers J Pfeiffer, A Rücklé, C Poth, A Kamath, I Vulić, S Ruder, K Cho, I Gurevych Proceedings of EMNLP 2020: System demonstrations, 2020	612	2020
Long Range Arena: A Benchmark for Efficient Transformers Y Tay, M Dehghani, S Abnar, Y Shen, D Bahri, P Pham, J Rao, L Yang, ... Proceedings of ICLR 2021, 2021	602	2021
MAD-X: An Adapter-based Framework for Multi-task Cross-lingual Transfer J Pfeiffer, I Vulić, I Gurevych, S Ruder Proceedings of EMNLP 2020, 2020	558	2020
Latent Multi-task Architecture Learning S Ruder, J Bingel, I Augenstein, A Søgaard Proceedings of AAAI 2019, 2019	542*	2019
To Tune or Not to Tune? Adapting Pretrained Representations to Diverse Tasks ME Peters, S Ruder, NA Smith Proceedings of the 4th Workshop on Representation Learning for NLP, 2019	514	2019
Neural Transfer Learning for Natural Language Processing S Ruder National University of Ireland, Galway, 2019	402	2019
Compacter: Efficient Low-Rank Hypercomplex Adapter Layers RK Mahabadi, J Henderson, S Ruder Proceedings of NeurIPS 2021, 2021	379*	2021
A Hierarchical Model of Reviews for Aspect-based Sentiment Analysis S Ruder, P Ghaffari, JG Breslin Proceedings of the 2016 Conference on Empirical Methods in Natural Language …, 2016	353	2016
On the Limitations of Unsupervised Bilingual Dictionary Induction A Søgaard, S Ruder, I Vulić Proceedings of ACL 2018, 2018	302	2018
A Hierarchical Multi-task Approach for Learning Embeddings from Semantic Tasks V Sanh, T Wolf, S Ruder Proceedings of AAAI 2019, 2019	270	2019

The system can't perform the operation now. Try again later.

Articles 1–20

Citations per year

Duplicate citations

Merged citations

Add co-authorsCo-authors

Follow

Cited by

Co-authors