Build a Retrieval Evaluation Set
Leave with a labelled retrieval dataset and scoring script.
Scheduled for Sunday, 19 March 2028. English 11 AM–2 PM · Hinglish 8 PM–11 PM IST.
Choose your language session
Both sessions cover the same practical topic. Joining links are not yet available. Registration opens only for the next 2 Sundays. Registration costs ₹399 for one 3-hour language session.
In this three-hour live workshop, you will create a labelled retrieval dataset and scoring script. You will work through sample inputs, build the core flow, test realistic failures and review your result with Ajay. Choose English or Hinglish for the same hands-on topic.
What this session will focus on
Your practical takeaway
Leave with a labelled retrieval dataset and scoring script.
YOUR HANDS-ON PLAN
- Define the scope and sample inputs for a labelled retrieval dataset and scoring script.
- Set up the smallest reproducible example using synthetic or public data.
- Write queries with expected supporting passages.
- Measure retrieval misses separately from answer quality.
- Run the checks, review tradeoffs and plan one follow-up improvement.
- Leave with a labelled retrieval dataset and scoring script.
- Verify your result on sample inputs and a realistic failure case.
- Continue practising: extend your labelled retrieval dataset and scoring script using one new input and record the result.
Before you join
Comfort with basic programming and a code editor
Continue practising
Practice exercise: extend your labelled retrieval dataset and scoring script using one new input and record the result.
Related learning path
AI Application Development
Explore the learning librarySession outline
- Who it is for
- Developers and analysts working on data, document search and evidence quality.
- Audience group
- Data & Search Builders
- Suggested level
- Intermediate
- Skill focus
- a Retrieval Evaluation Set
- Series
- Build With Ajay
- Session format
- Live hands-on workshop, tested outcome and Q&A
- Duration
- 180 minutes (3 hours)
- Price
- ₹399 per language session
- Language
- English and Hinglish
Questions before you join
What will I leave with?+
You will leave with a labelled retrieval dataset and scoring script. We will test it on sample inputs and note its limits.
What should I prepare before joining?+
Comfort with basic programming and a code editor Bring a computer and use synthetic or public examples; credentials and paid provider accounts are optional for fixture-based exercises.
Are the English and Hinglish workshops different topics?+
Both language sessions cover Build a Retrieval Evaluation Set. Choose one language session; each registration covers one three-hour workshop.
You have the curiosity.
Let’s turn it into capability.
Start with a practical workshop or bring a specific question to Ajay.