Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Get the scraper working on Docker #229

Open
rwalek668 opened this issue Jun 17, 2021 · 0 comments
Open

Get the scraper working on Docker #229

rwalek668 opened this issue Jun 17, 2021 · 0 comments
Assignees
@StevenWuzz
Labels
backend good first issue Good for newcomers

Comments

@rwalek668
Copy link
Collaborator

We would like to get the scraper working on Docker so that we can automate deployments of the scrape.

We suspect there is currently a blocker to getting the scraper on Docker which is that we currently do not use Chrome Headless mode.

The reason we do not use Chrome Headless mode is that when downloading the files in chrome headless mode, the download does not behave correctly. I suspect that this is because the file keeps getting overwritten/replaced (rather then how downloads normally work where if you download a file with the same name it gets saved as file_name(1).file)

FYI @darpham
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@StevenWuzz StevenWuzz

Labels
backend good first issue Good for newcomers
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@rwalek668 @StevenWuzz