Sebastian Ruder

Cited by

	All	Since 2017
Citations	15167	15064
h-index	33	33
i10-index	51	51

5000

2500

1250

3750

201720182019202020212022336 1164 2752 4164 4986 1624

Public access

View all

28 articles

0 articles

available

not available

Based on funding mandates

Co-authors

Ivan VulićSenior Research Associate, University of Cambridge & PolyAIVerified email at cam.ac.uk
Anders SøgaardFull Professor in NLP and Machine Learning, University of CopenhagenVerified email at di.ku.dk
Parsa GhaffariAYLIENVerified email at aylien.com
Jeremy HowardHonorary Professor, University of QueenslandVerified email at zz.lc
Dani YogatamaDeepMindVerified email at google.com
John G. BreslinPersonal Professor at NUI Galway, and Co-PI at Confirm and Insight, FI at VistaMilkVerified email at nuigalway.ie
Jonas PfeifferNew York University, Technical University of DarmstadtVerified email at nyu.edu
Graham NeubigAssociate Professor of Computer Science, Carnegie Mellon UniversityVerified email at cs.cmu.edu
Iryna GurevychProfessor of Computer Science, Technische Universität DarmstadtVerified email at cs.tu-darmstadt.de
Melvin JohnsonResearcher, GoogleVerified email at stanford.edu
Isabelle AugensteinAssociate Professor, Department of Computer Science, University of CopenhagenVerified email at di.ku.dk
Orhan FiratGoogle AIVerified email at google.com
Donald MetzlerGoogleVerified email at google.com
Dara BahriResearch Scientist, Google ResearchVerified email at google.com
Yi TayResearch Scientist, Google AIVerified email at google.com
Matthew E PetersSr Research Scientist, Allen Institute for Artificial IntelligenceVerified email at allenai.org
Mostafa DehghaniResearch Scientist, Google BrainVerified email at google.com
Thomas WolfChief Science Officer at HuggingFaceVerified email at polytechnique.edu
Aditya SiddhantGoogleVerified email at google.com
Junjie HuAssistant Professor, University of Wisconsin-MadisonVerified email at wisc.edu

Sebastian Ruder

Research Scientist, Google

Verified email at google.com - Homepage

Natural Language Processing Machine Learning Deep Learning Artificial Intelligence


Title Sort by citations Sort by year Sort by title	Cited by Cited by	Year
An overview of gradient descent optimization algorithms S Ruder arXiv preprint arXiv:1609.04747, 2016	5558	2016
Universal Language Model Fine-tuning for Text Classification J Howard, S Ruder Proceedings of ACL 2018, 2018	2878*	2018
An overview of multi-task learning in deep neural networks S Ruder arXiv preprint arXiv:1706.05098, 2017	1957	2017
A Survey of Cross-lingual Word Embedding Models S Ruder, I Vulić, A Søgaard Journal of Artificial Intelligence Research 65, 569-631, 2019	498	2019
XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization J Hu, S Ruder, A Siddhant, G Neubig, O Firat, M Johnson Proceedings of ICML 2020, 2020	339	2020
On the cross-lingual transferability of monolingual representations M Artetxe, S Ruder, D Yogatama Proceedings of ACL 2020, 2020	285	2020
To Tune or Not to Tune? Adapting Pretrained Representations to Diverse Tasks ME Peters, S Ruder, NA Smith Proceedings of the 4th Workshop on Representation Learning for NLP, 2019	281	2019
Transfer learning in natural language processing S Ruder, ME Peters, S Swayamdipta, T Wolf Proceedings of the 2019 conference of the North American chapter of the …, 2019	246	2019
A Hierarchical Model of Reviews for Aspect-based Sentiment Analysis S Ruder, P Ghaffari, JG Breslin Proceedings of the 2016 Conference on Empirical Methods in Natural Language …, 2016	232	2016
On the Limitations of Unsupervised Bilingual Dictionary Induction A Søgaard, S Ruder, I Vulić Proceedings of ACL 2018, 2018	200	2018
Neural Transfer Learning for Natural Language Processing S Ruder National University of Ireland, Galway, 2019	194	2019
A Hierarchical Multi-task Approach for Learning Embeddings from Semantic Tasks V Sanh, T Wolf, S Ruder Proceedings of AAAI 2019, 2019	165	2019
Sluice networks: Learning what to share between loosely related tasks S Ruder, J Bingel, I Augenstein, A Søgaard arXiv preprint arXiv:1705.08142 2, 2017	161	2017
Latent Multi-task Architecture Learning S Ruder, J Bingel, I Augenstein, A Søgaard Proceedings of AAAI 2019, 2019	150	2019
Long Range Arena: A Benchmark for Efficient Transformers Y Tay, M Dehghani, S Abnar, Y Shen, D Bahri, P Pham, J Rao, L Yang, ... Proceedings of ICLR 2021, 2021	137	2021
How to (Properly) Evaluate Cross-Lingual Word Embeddings: On Strong Baselines, Comparative Analyses, and Some Misconceptions G Glavas, R Litschko, S Ruder, I Vulic Proceedings of ACL 2019, 2019	136	2019
MAD-X: An Adapter-based Framework for Multi-task Cross-lingual Transfer J Pfeiffer, I Vulić, I Gurevych, S Ruder Proceedings of EMNLP 2020, 2020	130	2020
Strong Baselines for Neural Semi-supervised Learning under Domain Shift S Ruder, B Plank Proceedings of ACL 2018, 2018	129	2018
Learning to select data for transfer learning with Bayesian Optimization S Ruder, B Plank Proceedings of the 2017 Conference on Empirical Methods in Natural Language …, 2017	125	2017
Character-level and multi-channel convolutional neural networks for large-scale authorship attribution S Ruder, P Ghaffari, JG Breslin arXiv preprint arXiv:1609.06686, 2016	110	2016

The system can't perform the operation now. Try again later.

Articles 1–20

Citations per year

Duplicate citations

Merged citations

Add co-authorsCo-authors

Follow this author

Cited by

Co-authors