Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Option to ignore pinned tweet while scraping user profile #784

Open
PeschykhinLev opened this issue Mar 21, 2023 · 4 comments
Open

Option to ignore pinned tweet while scraping user profile #784

PeschykhinLev opened this issue Mar 21, 2023 · 4 comments
Labels
enhancement New feature or request module:twitter

Comments

@PeschykhinLev
Copy link

No description provided.

@PeschykhinLev PeschykhinLev added the question Further information is requested label Mar 21, 2023
@JustAnotherArchivist
Copy link
Owner

It's not currently configurable.

@JustAnotherArchivist JustAnotherArchivist changed the title How to ignore pinned tweet while scraping the user's last tweet? Option to ignore pinned tweet while scraping user profile Mar 21, 2023
@JustAnotherArchivist JustAnotherArchivist added enhancement New feature or request module:twitter and removed question Further information is requested labels Mar 21, 2023
@k0lter
Copy link

k0lter commented Apr 21, 2023

If an old pinned tweet exists, it breaks the --since argument.

Imagine an old tweet with 2023-04-01 as date. If you want to get the tweets as of today (snscrape --since "2023-04-21" twitter-profile <user>), snsscrape will return no results.

The pinned tweet is the first tweet returned and as the date is before the --since argument, snsscrape will not process the other tweets.

@JustAnotherArchivist
Copy link
Owner

Yep. I think I intended at some point to insert the pinned tweet into the timeline chronologically. But I'm not sure why that never happened, and also it should still be configurable because people might want to get the exact order shown on the web page. --since will always be broken under that condition though as it assumes reverse chronological order.

@JustAnotherArchivist
Copy link
Owner

This is not implemented yet, but with the addition of #868, it is now possible to filter out the pinned tweets externally if desired. The returned order is still the one on the profile page, i.e. pinned tweet followed by everything else in reverse chronological order.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request module:twitter
Projects
None yet
Development

No branches or pull requests

3 participants