Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rescan issues #501

Open
T-prog3 opened this issue Dec 26, 2023 · 2 comments
Open

Rescan issues #501

T-prog3 opened this issue Dec 26, 2023 · 2 comments

Comments

@T-prog3
Copy link

T-prog3 commented Dec 26, 2023

I recently ran Force rescan on some blogs and noticed first of all that this function doesn't automatically reset to False after its done. But also when i manually set it to False in Blog Settings or config file then the software continues as if its still True and look through the complete blog and wont stop at last complete crawl or latest post date. It took hours to complete only 10 new posts.

@thomas694
Copy link
Contributor

I wouldn't classify the missing automatic reset as an error.

Once a Force rescan has started, it needs a complete error-free run, either the current one or any future one, to set a new LastId (Last Complete Crawl/Latest Post are irrelevant).

So in your case you can set LastId to any current post id to stop the long scans.

@T-prog3
Copy link
Author

T-prog3 commented Jan 29, 2024

The main issue is that even when i complete the download it still look through full blogs on every run so far. And every post show up as already downloaded, skipping and with the rate limits this can take hours to complete.

One thing i miss is some sort of indicator that show if it download the blog as normal or with Force rescan enabled in the download Queue. Like a F before the star ratings or something. I know that you can look for the check mark in details but this can be tedious with a large amount of blogs and in my case none have that check mark and still it look through it all.

I was under the impression that LastId was the id of the Latest Postdate found and that the scan wouldn't go beyond this date unless rescan was enabled? So does the downloader have to encounter this id to stop? And what happens if this id got removed by the blog or twitter/tumblr?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants