Altre scienze socialiIngleseBlogger

Aaron Tay's Musings about librarianship

(Subscribe by email)
Pagina inizialeAtom Foraggio
language
DiscoveryLarge Language ModelAltre scienze socialiInglese
Pubblicato
Autore Aaron Tay

I recently watched a librarian give a talk about their experiments teaching prompt engineering. The librarian drawing from the academic literature on the subject (there are lots!), tried to leverage "prompt engineering principles" from one such paper to craft a prompt and used it in a Retrieval Augmented Generation (RAG) system, more specifically, Statista's brand new "research AI" feature.

Citation-based Literature Mapping ToolsDiscoveryInformation LiteracyLiterature MappingAltre scienze socialiInglese
Pubblicato
Autore Aaron Tay

I have been writing about what I call citation based literature mapping tools for over 5 years now, starting from Citation Gecko in 2018. This trend really intensified in 2020, with the overall victory of the open citation movement making citation linking data effectively "free", and tools like Connected papers, Researchrabbit, LitMaps and more really started to get some traction.

DiscoveryLarge Language ModelAltre scienze socialiInglese
Pubblicato
Autore Aaron Tay

As academic search engines and databases incorporate the use of generative AI into their systems, an important concept that all librarian should grasp is that of retrieval augmented generation (RAG).   You see it in use in all sorts of "AI products" today from chatbots like Bing Copilot, to Adobe's Acrobat Ai assistant that allow you to chat with your PDF.

DiscoveryLarge Language ModelAltre scienze socialiInglese
Pubblicato
Autore Aaron Tay

In the last blog post , I argued that despite the advancements in AI thanks to transformer based large language models, most academic search still are focused mostly in supporting exploratory searches and do not focus on optimizing recall and in fact trade off low latency for accuracy.

DiscoveryLarge Language ModelAltre scienze socialiInglese
Pubblicato
Autore Aaron Tay

One of the tricks about using the newer "AI powered" search systems like Elicit, SciSpace and even JSTOR experiment search is that they recommend that you type in your query or what you want in full natural language and not keyword search style (where you drop the stop words) for better results. So for example do

DiscoveryLarge Language ModelRetrieval Augmented GenerationAltre scienze socialiInglese
Pubblicato
Autore Aaron Tay

Earlier related pieces - How Q&A systems based on large language models (eg GPT4) will change things if they become the dominant search paradigm - 9 implications for libraries In the ever-evolving landscape of information retrieval and library science, the emergence of large language models, particularly those based on the transformer architecture like GPT-4, has opened up a Pandora's box of possibilities and challenges.