| Task Name | Video Source | More info | Metric |
|---|---|---|---|
| Retrieval Tasks | |||
| TVR | TV episodes | Average(R@1, 5, 10) with tIoU >= 0.7 | |
| How2R | YouTube (HowTo100M) | Average(R@1, 5, 10) with tIoU >= 0.7 | |
| YC2R | YouTube | Average(R@1, 5, 10) | |
| VATEX-EN-R | YouTube | Average(R@1, 5, 10) | |
| QA Tasks | |||
| TVQA | TV episodes | Accuracy | |
| How2QA | YouTube (HowTo100M) | Accuracy | |
| VIOLIN | TV episodes, Movie clips | Accuracy | |
| VLEP | TV episodes, YouTube | Accuracy | |
| Captioning Tasks | |||
| TVC | TV episodes | CIDEr-D | |
| YC2C | YouTube | CIDEr-D | |
| VATEX-EN-C | YouTube | CIDEr-D | |