
Semantic Scholar is a research tool for scientific literature. It is developed at the Allen Institute for AI and was publicly released in November 2015. Semantic Scholar uses modern techniques in natural language processing to support the research process, for example by providing automatically generated summaries of scholarly papers. The Semantic Scholar team is actively researching the use of artificial intelligence in natural language processing, machine learning, human–computer interaction, and information retrieval.
![]() | |
Type of site | Search engine |
---|---|
Created by | Allen Institute for Artificial Intelligence |
URL | semanticscholar |
Launched | November 2, 2015 |
Semantic Scholar began as a database for the topics of computer science, geoscience, and neuroscience. In 2017, the system began including biomedical literature in its corpus. As of September 2022[update], it includes over 200 million publications from all fields of science.
Technology
Semantic Scholar provides a one-sentence summary of scientific literature. One of its aims was to address the challenge of reading numerous titles and lengthy abstracts on mobile devices. It also seeks to ensure that the three million scientific papers published yearly reach readers, since it is estimated that only half of this literature is ever read.
Artificial intelligence is used to capture the essence of a paper, generating it through an "abstractive" technique. The project uses a combination of machine learning, natural language processing, and machine vision to add a layer of semantic analysis to the traditional methods of citation analysis, and to extract relevant figures, tables, entities, and venues from papers.
Another key AI-powered feature is Research Feeds, an adaptive research recommender that uses AI to quickly learn what papers users care about reading and recommends the latest research to help scholars stay up to date. It uses a state-of-the-art paper embedding model trained using contrastive learning to find papers similar to those in each Library folder.
Semantic Scholar also offers Semantic Reader, an augmented reader with the potential to revolutionize scientific reading by making it more accessible and richly contextual. Semantic Reader provides in-line citation cards that allow users to see citations with TLDR (short for Too Long, Didn't Read) automatically generated short summaries as they read and skimming highlights that capture key points of a paper so users can digest faster.
In contrast with Google Scholar and PubMed, Semantic Scholar is designed to highlight the most important and influential elements of a paper. The AI technology is designed to identify hidden connections and links between research topics. Like the previously cited search engines, Semantic Scholar also exploits graph structures, which include the Microsoft Academic Knowledge Graph, Springer Nature's SciGraph, and the Semantic Scholar Corpus (originally a 45 million papers corpus in computer science, neuroscience and biomedicine).
Article identifier
Each paper hosted by Semantic Scholar is assigned a unique identifier called the Semantic Scholar Corpus ID (abbreviated S2CID). The following entry is an example:
Liu, Ying; Gayle, Albert A; Wilder-Smith, Annelies; Rocklöv, Joacim (March 2020). "The reproductive number of COVID-19 is higher compared to SARS coronavirus". Journal of Travel Medicine. 27 (2). doi:10.1093/jtm/taaa021. PMID 32052846. S2CID 211099356.
Indexing
Semantic Scholar is free to use and unlike similar search engines (i.e. Google Scholar) does not search for material that is behind a paywall.[citation needed]
One study compared the index scope of Semantic Scholar to Google Scholar, and found that for the papers cited by secondary studies in computer science, the two indices had comparable coverage, each only missing a handful of the papers.
Number of users and publications
As of January 2018, following a 2017 project that added biomedical papers and topic summaries, the Semantic Scholar corpus included more than 40 million papers from computer science and biomedicine. In March 2018, Doug Raymond, who developed machine learning initiatives for the Amazon Alexa platform, was hired to lead the Semantic Scholar project. As of August 2019[update], the number of included papers metadata (not the actual PDFs) had grown to more than 173 million after the addition of the Microsoft Academic Graph records. In 2020, a partnership between Semantic Scholar and the University of Chicago Press Journals made all articles published under the University of Chicago Press available in the Semantic Scholar corpus. At the end of 2020, Semantic Scholar had indexed 190 million papers. In 2020, Semantic Scholar reached seven million users per month.
See also
- Citation analysis – Examination of the frequency, patterns, and graphs of citations in documents
- Citation index – Index of citations between publications
- Knowledge extraction – Creation of knowledge from structured and unstructured sources
- List of academic databases and search engines
- Scientometrics – Quantitative study of scholarly literature
References
- Jones, Nicola (2015). "Artificial-intelligence institute launches free science search engine". Nature. doi:10.1038/nature.2015.18703. ISSN 1476-4687. S2CID 182440976.
- Eunjung Cha, Ariana (3 November 2015). "Paul Allen's AI research group unveils program that aims to shake up how we search scientific knowledge. Give it a try". The Washington Post. Archived from the original on 6 November 2019. Retrieved November 3, 2015.
- Hao, Karen (November 18, 2020). "An AI helps you summarize the latest in AI". MIT Technology Review. Retrieved 2021-02-16.
- "Semantic Scholar Research". research.semanticscholar.org. Retrieved 2021-11-22.
- Fricke, Suzanne (2018-01-12). "Semantic Scholar". Journal of the Medical Library Association. 106 (1): 145–147. doi:10.5195/jmla.2018.280. ISSN 1558-9439. PMC 5764585. S2CID 45802944.
- Matthews, David (1 September 2021). "Drowning in the literature? These smart software tools can help". Nature. Retrieved 5 September 2022.
...the publicly available corpus compiled by Semantic Scholar – a tool set up in 2015 by the Allen Institute for Artificial Intelligence in Seattle, Washington – amounting to around 200 million articles, including preprints.
- Grad, Peter (November 24, 2020). "AI tool summarizes lengthy papers in a sentence". Tech Xplore. Retrieved 2021-02-16.
- "Allen Institute's Semantic Scholar now searches across 175 million academic papers". VentureBeat. 2019-10-23. Retrieved 2021-02-16.
- Bohannon, John (11 November 2016). "A computer program just ranked the most influential brain scientists of the modern era". Science. doi:10.1126/science.aal0371. Archived from the original on 29 April 2020. Retrieved 12 November 2016.
- Christopher Clark; Santosh Divvala (2016). PDFFigures 2.0: Mining figures from research papers. Proceedings of the 16th ACM/IEEE-CS on Joint Conference on Digital Libraries - JCDL '16. Wikidata Q108172042.
- "Semantic Scholar | Frequently Asked Questions". Archived from the original on July 15, 2023.
- "Semantic Scholar | Semantic Reader". Semantic Scholar. Archived from the original on July 15, 2023.
- "Semantic Scholar". International Journal of Language and Literary Studies. Retrieved 2021-11-09.
- Baykoucheva, Svetla (2021). Driving Science Information Discovery in the Digital Age. Chandos Publishing. p. 91. ISBN 978-0-12-823724-3. OCLC 1241441806.
- Jose, Joemon M.; Yilmaz, Emine; Magalhães, João; Castells, Pablo; Ferro, Nicola; Silva, Mário J.; Martins, Flávio (2020). Advances in Information Retrieval: 42nd European Conference on IR Research, ECIR 2020, Lisbon, Portugal, April 14–17, 2020, Proceedings, Part I. Cham, Switzerland: Springer Nature. p. 254. ISBN 978-3-030-45438-8. OCLC 1164658107.
- Ammar, Waleed (2019). "Open Research Corpus". Semantic Scholar Lab Open Research Corpus. Archived from the original on 2019-03-29. Retrieved 2024-08-05.
- Hannousse, Abdelhakim (2021). "Searching relevant papers for software engineering secondary studies: Semantic Scholar coverage and identification role". IET Software. 15 (1): 126–146. doi:10.1049/sfw2.12011. ISSN 1751-8814. S2CID 234053002.
- "AI2 scales up Semantic Scholar search engine to encompass biomedical research". GeekWire. 2017-10-17. Archived from the original on 2018-01-19. Retrieved 2018-01-18.
- "Tech Moves: Allen Instititue Hires Amazon Alexa Machine Learning Leader; Microsoft Chairman Takes on New Investor Role; and More". GeekWire. 2018-05-02. Archived from the original on 2018-05-10. Retrieved 2018-05-09.
- "Semantic Scholar". Semantic Scholar. Archived from the original on 11 August 2019. Retrieved 11 August 2019.
- "AI2 joins forces with Microsoft Research to upgrade search tools for scientific studies". GeekWire. 2018-12-05. Archived from the original on 2019-08-25. Retrieved 2019-08-25.
- "The University of Chicago Press joins more than 500 publishers working with Semantic Scholar to improve search and discoverability". RCNi Company Limited. Retrieved 2021-11-22.
- Dunn, Adriana (December 14, 2020). "Semantic Scholar Adds 25 Million Scientific Papers in 2020 Through New Publisher Partnerships" (PDF). Semantic Scholar. Retrieved November 22, 2021.
External links
Semantic Scholar topic ID (P6611) (see uses)
Semantic Scholar author ID (P4012) (see uses)
Semantic Scholar corpus ID (P8299) (see uses)
Semantic Scholar paper ID (P4011) (see uses)
- Official website
Semantic Scholar is a research tool for scientific literature It is developed at the Allen Institute for AI and was publicly released in November 2015 Semantic Scholar uses modern techniques in natural language processing to support the research process for example by providing automatically generated summaries of scholarly papers The Semantic Scholar team is actively researching the use of artificial intelligence in natural language processing machine learning human computer interaction and information retrieval Semantic ScholarType of siteSearch engineCreated byAllen Institute for Artificial IntelligenceURLsemanticscholar wbr orgLaunchedNovember 2 2015 9 years ago 2015 11 02 Semantic Scholar began as a database for the topics of computer science geoscience and neuroscience In 2017 the system began including biomedical literature in its corpus As of September 2022 update it includes over 200 million publications from all fields of science TechnologySemantic Scholar provides a one sentence summary of scientific literature One of its aims was to address the challenge of reading numerous titles and lengthy abstracts on mobile devices It also seeks to ensure that the three million scientific papers published yearly reach readers since it is estimated that only half of this literature is ever read Artificial intelligence is used to capture the essence of a paper generating it through an abstractive technique The project uses a combination of machine learning natural language processing and machine vision to add a layer of semantic analysis to the traditional methods of citation analysis and to extract relevant figures tables entities and venues from papers Another key AI powered feature is Research Feeds an adaptive research recommender that uses AI to quickly learn what papers users care about reading and recommends the latest research to help scholars stay up to date It uses a state of the art paper embedding model trained using contrastive learning to find papers similar to those in each Library folder Semantic Scholar also offers Semantic Reader an augmented reader with the potential to revolutionize scientific reading by making it more accessible and richly contextual Semantic Reader provides in line citation cards that allow users to see citations with TLDR short for Too Long Didn t Read automatically generated short summaries as they read and skimming highlights that capture key points of a paper so users can digest faster In contrast with Google Scholar and PubMed Semantic Scholar is designed to highlight the most important and influential elements of a paper The AI technology is designed to identify hidden connections and links between research topics Like the previously cited search engines Semantic Scholar also exploits graph structures which include the Microsoft Academic Knowledge Graph Springer Nature s SciGraph and the Semantic Scholar Corpus originally a 45 million papers corpus in computer science neuroscience and biomedicine Article identifierEach paper hosted by Semantic Scholar is assigned a unique identifier called the Semantic Scholar Corpus ID abbreviated S2CID The following entry is an example Liu Ying Gayle Albert A Wilder Smith Annelies Rocklov Joacim March 2020 The reproductive number of COVID 19 is higher compared to SARS coronavirus Journal of Travel Medicine 27 2 doi 10 1093 jtm taaa021 PMID 32052846 S2CID 211099356 IndexingSemantic Scholar is free to use and unlike similar search engines i e Google Scholar does not search for material that is behind a paywall citation needed One study compared the index scope of Semantic Scholar to Google Scholar and found that for the papers cited by secondary studies in computer science the two indices had comparable coverage each only missing a handful of the papers Number of users and publicationsAs of January 2018 following a 2017 project that added biomedical papers and topic summaries the Semantic Scholar corpus included more than 40 million papers from computer science and biomedicine In March 2018 Doug Raymond who developed machine learning initiatives for the Amazon Alexa platform was hired to lead the Semantic Scholar project As of August 2019 update the number of included papers metadata not the actual PDFs had grown to more than 173 million after the addition of the Microsoft Academic Graph records In 2020 a partnership between Semantic Scholar and the University of Chicago Press Journals made all articles published under the University of Chicago Press available in the Semantic Scholar corpus At the end of 2020 Semantic Scholar had indexed 190 million papers In 2020 Semantic Scholar reached seven million users per month See alsoCitation analysis Examination of the frequency patterns and graphs of citations in documents Citation index Index of citations between publications Knowledge extraction Creation of knowledge from structured and unstructured sources List of academic databases and search engines Scientometrics Quantitative study of scholarly literatureReferencesJones Nicola 2015 Artificial intelligence institute launches free science search engine Nature doi 10 1038 nature 2015 18703 ISSN 1476 4687 S2CID 182440976 Eunjung Cha Ariana 3 November 2015 Paul Allen s AI research group unveils program that aims to shake up how we search scientific knowledge Give it a try The Washington Post Archived from the original on 6 November 2019 Retrieved November 3 2015 Hao Karen November 18 2020 An AI helps you summarize the latest in AI MIT Technology Review Retrieved 2021 02 16 Semantic Scholar Research research semanticscholar org Retrieved 2021 11 22 Fricke Suzanne 2018 01 12 Semantic Scholar Journal of the Medical Library Association 106 1 145 147 doi 10 5195 jmla 2018 280 ISSN 1558 9439 PMC 5764585 S2CID 45802944 Matthews David 1 September 2021 Drowning in the literature These smart software tools can help Nature Retrieved 5 September 2022 the publicly available corpus compiled by Semantic Scholar a tool set up in 2015 by the Allen Institute for Artificial Intelligence in Seattle Washington amounting to around 200 million articles including preprints Grad Peter November 24 2020 AI tool summarizes lengthy papers in a sentence Tech Xplore Retrieved 2021 02 16 Allen Institute s Semantic Scholar now searches across 175 million academic papers VentureBeat 2019 10 23 Retrieved 2021 02 16 Bohannon John 11 November 2016 A computer program just ranked the most influential brain scientists of the modern era Science doi 10 1126 science aal0371 Archived from the original on 29 April 2020 Retrieved 12 November 2016 Christopher Clark Santosh Divvala 2016 PDFFigures 2 0 Mining figures from research papers Proceedings of the 16th ACM IEEE CS on Joint Conference on Digital Libraries JCDL 16 Wikidata Q108172042 Semantic Scholar Frequently Asked Questions Archived from the original on July 15 2023 Semantic Scholar Semantic Reader Semantic Scholar Archived from the original on July 15 2023 Semantic Scholar International Journal of Language and Literary Studies Retrieved 2021 11 09 Baykoucheva Svetla 2021 Driving Science Information Discovery in the Digital Age Chandos Publishing p 91 ISBN 978 0 12 823724 3 OCLC 1241441806 Jose Joemon M Yilmaz Emine Magalhaes Joao Castells Pablo Ferro Nicola Silva Mario J Martins Flavio 2020 Advances in Information Retrieval 42nd European Conference on IR Research ECIR 2020 Lisbon Portugal April 14 17 2020 Proceedings Part I Cham Switzerland Springer Nature p 254 ISBN 978 3 030 45438 8 OCLC 1164658107 Ammar Waleed 2019 Open Research Corpus Semantic Scholar Lab Open Research Corpus Archived from the original on 2019 03 29 Retrieved 2024 08 05 Hannousse Abdelhakim 2021 Searching relevant papers for software engineering secondary studies Semantic Scholar coverage and identification role IET Software 15 1 126 146 doi 10 1049 sfw2 12011 ISSN 1751 8814 S2CID 234053002 AI2 scales up Semantic Scholar search engine to encompass biomedical research GeekWire 2017 10 17 Archived from the original on 2018 01 19 Retrieved 2018 01 18 Tech Moves Allen Instititue Hires Amazon Alexa Machine Learning Leader Microsoft Chairman Takes on New Investor Role and More GeekWire 2018 05 02 Archived from the original on 2018 05 10 Retrieved 2018 05 09 Semantic Scholar Semantic Scholar Archived from the original on 11 August 2019 Retrieved 11 August 2019 AI2 joins forces with Microsoft Research to upgrade search tools for scientific studies GeekWire 2018 12 05 Archived from the original on 2019 08 25 Retrieved 2019 08 25 The University of Chicago Press joins more than 500 publishers working with Semantic Scholar to improve search and discoverability RCNi Company Limited Retrieved 2021 11 22 Dunn Adriana December 14 2020 Semantic Scholar Adds 25 Million Scientific Papers in 2020 Through New Publisher Partnerships PDF Semantic Scholar Retrieved November 22 2021 External linksWikidata has the properties Semantic Scholar topic ID P6611 see uses Semantic Scholar author ID P4012 see uses Semantic Scholar corpus ID P8299 see uses Semantic Scholar paper ID P4011 see uses Official website