Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

some questions for training model #5

Open
UB1010 opened this issue Jun 21, 2016 · 4 comments
Open

some questions for training model #5

UB1010 opened this issue Jun 21, 2016 · 4 comments

Comments

@UB1010
Copy link

UB1010 commented Jun 21, 2016

Hi, udibr,
I was running your code with the data of reuters news, the vocabulary-embedding.ipynb is OK for everything.
train.ipynb also is OK, but with a warning, and too slow to train the model.
I have some questions:
1, How to read the file train.history.pkl? i want to check the history of trainning.
2, I was running predict.ipynb with the model only training 5 iteration, but find a wrong message: "failed to find layer timedistributed_1 in model " when load the model. Why got the wrong message?
3, I find the predict result is not good with the model by 5 iteration. How many iteration that is fine for the result is just OK? I have more than 3K news for training model in CPU, 500 iteration is too slow.

Thank you.

@UB1010 UB1010 changed the title No data/train.hdf5 file? some question for training model Jun 21, 2016
@UB1010 UB1010 changed the title some question for training model some questions for training model Jun 21, 2016
@udibr
Copy link
Owner

udibr commented Jun 22, 2016

  1. just check the code which wrote the history (last cell of train notebook)
  2. This message is OK, I decided not to load the entire model but just the part below the top dense layer, so this is why you see this message. However the weights are returned from the load function and I latter use them directly.
  3. I think 3K examples is not enough. Try to get at least two order of magnitude more data.
    I guess its time to move to using GPU...

@hipoglucido
Copy link

Hi @udibr , I am also running the train notebook and I have one question regarding the line:

if FN1:
    model.load_weights('data/train.hdf5')

If its the first time that I am about to train the model, should model.load_weights('data/train.hdf5') be executed? If that's the case, when is that weights file generated? That path doesn't find the file on my machine.

Thanks a lot

@udibr
Copy link
Owner

udibr commented Jun 24, 2016

there was a small bug in code which I now updated. In any case on first run FN1 should be None and no load should be made

@UB1010
Copy link
Author

UB1010 commented Jun 25, 2016

Thank you for your response.
I want to run the code by Chinese text, can you guide something? Get a new Word Embedding by Chinese, must use GloVe? Can I use another model? Other matters?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants