top 6% solution
scheduler: cosine annealing loss: arcface loss
-
EfficientNet
-
NFNet
model 1: sentence-transformers/paraphrase-xlm-r-multilingual-v1
model 2 : sentence-transformers/bert-base-nli-cls-token
model 3 : cahya/distilbert-base-indonesian
CV best : model 1 + model 3 LB best : model 1 + model 2 + model 3
image classification: Vit, resnext
transformer: RoBert
etc: oof stacking, meta model
Most of the top solutions' key points were meta models, but I was sorry to didn't spend much time on meta models