Skip to content

RUCwenxiang/Answer-Selection

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

39 Commits

bert @ eedf571

bert @ eedf571

 
 

conf

conf

 
 

data

data

 
 

experiments

experiments

 
 

.gitignore

.gitignore

 
 

.gitmodules

.gitmodules

 
 

README.md

README.md

 
 

common_cmd

common_cmd

 
 

data_prepare.py

data_prepare.py

 
 

main.py

main.py

 
 

metrics.py

metrics.py

 
 

run.sh

run.sh

 
 

sample_submission.tsv

sample_submission.tsv

 
 

utils.py

utils.py

 
 

Repository files navigation

BERT based answer selection model

  • 模型框架
    • Roberta/Bert/Macbert + Bi-LSTM + CRF/Softmax
  • 模型融合
    • 简单的模型ensemble, 就是生成多个模型取每个模型预测的概率值的平均值作为最后的预测, 最后一次提交用了四个模型, 如果生成8个模型之后再用LightGBM/XGBoost进行拟合最后的得分会更高
  • 流程
    • 生成训练集, 测试集, 设置一个很大的epoch进行early stopping选一个合适的epoch值
    • 之后按照epoch的值训练多个模型
    • 对多个模型的预测进行简单的平均融合, 上传结果到obs

About

2020年贝壳找房问答匹配竞赛

Topics

text-classification ensemble-learning sequence-labeling pre-trained-language-models

Resources

Readme
Activity

Stars

1 star

Watchers

1 watching

Forks

0 forks
Report repository

Releases

No releases published

Packages

No packages published

Languages