Results

We did experiments on the certain theme. This table shows the results.

  Crafts Hobbies Day Time TV Shows Movie Genres School Subjects
Fold Num 11 14 11 13
Accuracy 29/32 36/41 30/35 35/39
  90.63% 85.37% 85.71% 89.74%
F1 93.03% 85.00% 88.37% 90.47%
AUC 0.6042 0.4952 0.6122 0.5294
Label Ratio 0/1 (Unit: set) 28960/14282 6363/7660 29530/18636 25506/24367
  202.77% 83.07% 158.46% 104.7%
Male/Female 11/21 11/30 10/25 11/28
  90.91%/90.48% 90.91%/83.33% 70%/92% 81.82%/92.86%
Sensitivity 0.9091 0.9091 0.7 0.8182
Specificity 0.9048 0.8333 0.92 0.9286
MCI/NC 20/12 20/21 21/14 22/17
  100%/75% 85%/85.71% 90.48%/78.57% 86.36%/94.12%
Sensitivity 1 0.85 0.9048 0.8636
Specificity 0.75 0.8571 0.7857 0.9412

MC-ViViT achieves over 85% accuracy on all four themes. The highest one is 90.63% from Crafts Hobbies. The accuracy of School Subjects reaches 89.74%, which is close to 90%. Three of the F1 Scores are more than 88%, only the F1 score of Day Time TV Shows is 85%. The accuracy and F1 Score solidly support that MC-ViViT has robust performance. The other evidence comes from AUC Score. The average AUC of all four themes is 0.56. Given that not all the clips has MCI features in the video, even for subjects with MCI, it is reasonable to predict parts of their video sequences as NC. Due to this reason, some subjects will be correctly predicted as MCI with low scores.