Skip to content

Latest commit

 

History

History
33 lines (19 loc) · 689 Bytes

README.md

File metadata and controls

33 lines (19 loc) · 689 Bytes
Raw

VLAB

Get Started

Model Weights

  1. Necessary Weights

Unzip the weights under ./output/pretrained_weights folder.

  1. For Finetuning

Unzip the corresponding weights under ./output/pretrain folder.

All weights can be downloaded from https://huggingface.co/David-huang/VLAB

  1. For Testing

Put the corresponding weights under ./output/downstreams/{large, giant} folder.

Run Scripts

# model_size: large, giant
# task: didemo_retrieval, msrvtt_caption, msrvtt_vqa, msrvtt_retrieval, msvd_caption, msvd_vqa, msvd_retrieval

# finetune
sh scripts/finetune/finetune.sh ${model_size} ${task}

# test
sh scripts/test/test.sh ${model_size} ${task}