Investigating information dynamics in BERT models during fine-tuning

Frida Hæstrup (201805753)

Repository structure

inside-bert/  
├── src/ 
│   └── configs/
│   │   └── *  # experiment-specific-configs
│   └── utils/
│   │   └── experiments.py # the class for creating an experiment
│   │   └── utils_finetune.py # methods for for fine-tuning
│   │   └── utils_infodynamics.py # methods for extracting information signals
│   │   └── utils_visualizations.py  # methods for visualizing results
│   └── main-finetune.py # main driver for fine-tuning
│   └── main-infodynamics.py # main driver for information dynamisc

Technicalities

The codebase relies on python v 3.12.3.

Licencse

This project is licensed under the MIT License - see the LICENSE file for details.