Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[QUESTION] Tell SkrapeIT to wait until each JavaScript loaded completely #215

Open
ablx opened this issue Jan 13, 2023 · 3 comments
Open
Assignees
Labels
question Further information is requested

Comments

@ablx
Copy link

ablx commented Jan 13, 2023

describe what you want to archive
I want to scrape a website where some content is generated after loading via Javascript (SPA).
However, SkrapeIT returns to fast, so that the content is missing. Instead, there is only a span with "Loading ..." which would be replaced later.

Is there anyway to tell SkrapeIT to either wait a given time or wait until an element is present before it returns?
Other than that, great lib! Thanks!

@ablx ablx added the question Further information is requested label Jan 13, 2023
@UKMIITB
Copy link

UKMIITB commented Mar 11, 2023

@ablx Were you able to find a solution for this ?
I have a problem which requires this exact solution

@skrapeit @christian-draeger
Team can you please check on this question

@ablx
Copy link
Author

ablx commented Mar 16, 2023

@UKMIITB no

@ferreiravinicius
Copy link

ferreiravinicius commented May 9, 2023

@ablx @UKMIITB
Not sure if it's the case, but have you tried this approach?
https://docs.skrape.it/docs/dsl/extract-client-side-rendered-data

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

4 participants