New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add more observations to sklearn text tutorial #172

Open

lopuhin opened this issue Apr 26, 2017 · 0 comments · May be fixed by #174

Contributor

lopuhin commented Apr 26, 2017

More improvements are possible from the last word-level model:

tokenizer issues ("x-ray" -> "ray")
tokenizer + stopwords ("isn" from "isn't")
maybe bigrams ("kidney stones")

If it is easy enough, also implement fixes and show accuracy and explanation with the fixes.

lopuhin linked a pull request

that will close this issue

[WIP] A small pipeline tweak: tokenization (x-ray) #174

Open

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment