Floread

감성 분석 기반 전자책 음악 추천 서비스

Contributors

안근우	강인우	염진봉	이석범
kgeunwo77	kiw331	jinbong-yeom	stoneTiger0912

How to use

• Backend

    cd ./floread
    ./gradlew build
    //백그라운드 실행할경우
    nohup java -jar floread-0.0.1-SNAPSHOT.jar &
    //그냥 실행할 경우
    java -jar floread-0.0.1-SNAPSHOT.jar
  

• Kafka

  //다른 환경에서 실행할 경우 환경변수 설정 후
  cd kafka_path
  bin/zookeeper-server-start.sh -daemon config/zookeeper.properties
  bin/kafka-server-start.sh  -daemon config/server.properties
  

• Frontend

    cd ./floread/frontend/todo-react-app
    sudo npm run dev
  

• Model

  

Requirements

• KoBERT requirements(Hugging Face)

  Python >= 3.6
  PyTorch >= 1.8.1
  transformers >= 4.8.2
  sentencepiece >= 0.1.91

• 로컬에서 학습 & 실행할 경우
  ve_kobert.ipynb

sentiment-analysis model

data: AI-Hub 제공

• 감성 대화 말뭉치
• 한국어 감정 정보가 포함된 단발성 대화 데이터셋
• 한국어 감정 정보가 포함된 연속적 대화 데이터셋

*학습데이터 처리 과정: EDA & Preprocess

Performance

Model	학습 데이터	acc	size(mb)	비고
kobert-v9	병합데이터셋-v5	0.702	351.81
kobert-v6	병합데이터셋-v3	0.694	351.79
kcelectra-v3	병합데이터셋-v2	0.679	416.25
kobert-v4	병합데이터셋-v2	0.681	351.79
kcelectra-v2	병합데이터셋	0.681	416.25
kcelectra-v1	감성 대화 말뭉치	0.584	-
koelectra-v1	병합데이터셋	0.601	-
kobert-v3	병합데이터셋	0.674	351.79
kobert-v2	단발성 대화 데이터셋	0.545	351.79
kobert-v1	감성 대화 말뭉치	0.591	351.79

*정확도는 테스트 데이터셋을 4:1로 분할하여 측정
*Fine-tuning 코드는 /sentiment-analysis/train_model에서 train_[모델이름].ipynb으로 찾을 수 있음

License

The MIT License (MIT)

Copyright (c) 2023 floread

Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

Reference

• KoBERT
• KoELECTRA
• KcELECTRA