-
Notifications
You must be signed in to change notification settings - Fork 0
Open
Labels
enhancementNew feature or requestNew feature or request
Description
Is your feature request related to a problem?
When running evaluations with duplication factor (e.g., 5), the current CSV export shows each iteration as separate rows. This makes it difficult to compare the same question's answers across iterations and assess consistency.
Describe the solution you'd like
Add an additional export button that restructures the CSV with columns: Golden Question, Ground Truth, Answer 1, Answer 2, Answer 3, Answer 4, Answer 5.
This format:
- Groups identical questions together horizontally
- Allows side-by-side comparison of answers across iterations
- Enables manual color-coding for consistency analysis
This is based on our work with ATREE, Antara and Veddis where we used similar format to check consistency manually
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request
