Skip to content

Korean Cursing expression Detection with fine-tuned klue_BERT (2023-1 KWU TextMining Term Project)

License

Notifications You must be signed in to change notification settings

Tolerblanc/K-urse_Detection_with_BERT

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 

Repository files navigation

K-urse_Detection_with_BERT

TensorFlow Keras

Overview

K-urse_Detection_with_BERT : Korean Cursing expression Detection with fine-tuned klue_BERT

This is the KWU "text mining" output for the first semester of 2023.

See Project Overview Here! : Notion(Korean)

See this model on HuggingFace 🤗 : Link

Evaluation

Model/Metric Accuracy Precision Recall F1 Score
Comparison(Electra base) 0.81 0.69 0.87 0.77
klue-BERT base(Our best result) 0.83 0.76** 0.75 0.75
  • Used Youtube Comments
Model/Metric Accuracy Precision Recall F1 Score
Comparison(Electra base) 0.77 0.52 0.90 0.66
klue-BERT base(Our best result) 0.89 0.75 0.80 0.78

Demo with HuggingFace's Space 🤗

Try Demo Here! Go to HuggingFace Space

Reference

  • Smilegate-AI's Korean Unsmile Dataset : Link
  • JeanLee's K-MHaS Dataset and Paper : Link
  • KLUE(Korean Language Understanding Evaluation) BERT : Link
  • BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding : Link
  • 2runo's Curse Detection Dataset : Link
  • JminJ's Bad Text Classifier : Link

About

Korean Cursing expression Detection with fine-tuned klue_BERT (2023-1 KWU TextMining Term Project)

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published