Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Bug: Crawler scrapes page anchors as new pages #195

Open
chriswessels opened this issue Jan 15, 2024 · 1 comment
Open

Bug: Crawler scrapes page anchors as new pages #195

chriswessels opened this issue Jan 15, 2024 · 1 comment
Labels
bug Something isn't working

Comments

@chriswessels
Copy link

When using the Crawler, if there are any links in a page that point to an anchor (e.g. href="#anchor"), these are treated as new Webpages and scraped separately. Links that resolve to anchors on the same page should not resolve to new pages.
@n4ze3m
Copy link
Owner

n4ze3m commented Jan 15, 2024

Yes, the crawler is currently stable; I will fix it soon.

@n4ze3m n4ze3m added the bug Something isn't working label Jan 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@chriswessels @n4ze3m