TREC Tip-of-the-Tongue Track

@[email protected]
14 Followers
3 Following
26 Posts
TREC Tip-of-the-Tongue Track focuses on known-item identification where the searcher cannot recall a reliable identifier (i.e., "It’s on the tip of my tongue…")
Homepagehttps://trec-tot.github.io/
TREC Tip-of-the-Tongue TrackSep 1, 2025

Some exciting news! 🤗 After 3 amazing years at TREC, the Tip-of-the-Tongue (ToT) shared task will be a core task at NTCIR-19 in 2026. The new track will focus on tip-of-the-tongue information needs in English and East Asian languages.

More details coming soon. See you all in Tokyo next year!

TREC Tip-of-the-Tongue TrackAug 17, 2023

#TREC2023ToT is now accepting runs. Please submit your runs soon! #TRECToT #TREC2023

📄 Guidelines: https://trec-tot.github.io/guidelines
🏃🏽‍♀️ Run submission form: https://ir.nist.gov/trecsubmit/tot.html
⏰ Run submission deadline: Aug 31

TREC 2025 Tip-of-the-Tongue (ToT) Track

Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.

TREC Tip-of-the-Tongue (ToT) Track
TREC Tip-of-the-Tongue TrackJul 24, 2023

We have released the test queries for TREC 2023 Tip-of-the-Tongue Track! #TRECToT #TREC2023ToT

📄 Guidelines: https://trec-tot.github.io/guidelines
⏰ Run submission deadline: Aug 31

Here we gooooooo!

TREC 2025 Tip-of-the-Tongue (ToT) Track

Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.

TREC Tip-of-the-Tongue (ToT) Track
TREC Tip-of-the-Tongue TrackJul 19, 2023

#TRECToT updates:

📰 News: GPT4 baseline run significantly improves DCG over BM25 and dense retrieval. What approaches will you try at the track this year?

⏰ Reminder: Test queries will be released on July 24. Run submission deadline is Aug 31.

Guidelines: https://trec-tot.github.io/guidelines

#TREC2023ToT

TREC 2025 Tip-of-the-Tongue (ToT) Track

Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.

TREC Tip-of-the-Tongue (ToT) Track
TREC Tip-of-the-Tongue TrackJun 28, 2023

#TRECToT update: We have baselines!

We’re releasing 2 baselines using BM25 & dense retrieval that participants can compare against and build on. As these early results show, there's a lot of room to improve on this task!

Check guidelines for more details: https://trec-tot.github.io/guidelines

TREC 2025 Tip-of-the-Tongue (ToT) Track

Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.

TREC Tip-of-the-Tongue (ToT) Track
TREC Tip-of-the-Tongue TrackMay 18, 2023

🚨 Announcement 🚨
TREC 2023 Tip-of-the-Tongue (TREC-ToT) Track guidelines are now online: https://trec-tot.github.io. Test queries will be released in July and August 31st is the submission deadline. #TRECToT #TREC2023ToT

To participate, please pre-register: https://ir.nist.gov/trecsubmit.open/application.html.

Overview

Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.

TREC 2023 Tip-of-the-Tongue (ToT) Track