Unsatisfactory results

[WenTingTseng]

I try to run code like this

python3 run_squad.py \
    --model_type bert \
    --model_name_or_path bert-large-uncased-whole-word-masking \
    --do_train \
    --do_eval \
    --do_lower_case \
    --train_file train-v1.1.json \
    --predict_file dev-v1.1.json \
    --learning_rate 3e-5 \
    --num_train_epochs 2 \
    --max_seq_length 384 \
    --doc_stride 128 \
    --output_dir ../models/wwm_uncased_finetuned_squad/ \
    --per_gpu_eval_batch_size=3   \
    --per_gpu_train_batch_size=3   \
	--overwrite_output_dir \

But I get the bad result F1 score only 7.35

I don't know how to solve it
Thanks a lot for your help

[anil1055]

Hi,

I solved this problem.
1-You'll write 'self.do_lower_case = False or True' according to model situation in bert.py file
2-You'll update def load_model(self,model_path: str,do_lower_case=False) function like def load_model(self,model_path: str,do_lower_case): deleted False in bert.py file.
That's it.