gh repo list with pagination

[kallookoo]

Hi,

It would be perfect to add the option of pagination since the maximum limit is 1000 and it is possible that there are more.
It would also be a good option if we want to make a query limiting it to 10 but we want to query the following 10

[mislav]

Hi, there are no options to do pagination in a way to resume fetching resources from a certain offset (like for page 2 onward), but there is a way to have GitHub CLI do pagination for you. You can supply gh repo list --limit 1000 and it will fetch up to 1,000 rows for you, performing pagination as needed. Note that getting that many rows will take at least 10 API queries, so it might be slow.

[randall-emed]

Is there any way to get over 1000 tho? I have an org with 3700 repos in it, trying to find a way to build a list.

[rorynscott]

@randall-emed I'm in the same boat; +5k pulls in a monorepo and I'm trying to figure out how to get all of them with gh pr list and am at a dead end on how to get beyond the initial 1000. I can script it with API requests, but that would be even slower.

[TheRealWaldo]

Ditto here; well over 1000 PRs even with extensive filtering.

So far the only way I can think to handle this is to script a run that goes through date ranges a day at a time and adds them to the query. Even that isn't future proof however, and would put far more load on GitHub resources.

[nvincent-vossloh]

Hello, using gh api with --paginate option might do the trick:

gh api -H "Accept: application/vnd.github+json" -H "X-GitHub-Api-Version: 2022-11-28" /orgs/ORG/repos --jq '.[].name' -X GET --paginate

[sthompson0]

This worked for my use case! Listing all the repos in my org.

[joshuataylor]

Please consider adding pagination, it would I need to reach for hacky scripts less often.

Everything I've wanted gh-cli to do, I've had to end up reaching for a custom script, mainly because of pagination.

1. Can't paginate on gh repo list.

2. You CAN paginate on the GraphQL endpoint, if you still really want to use the cli:

gh api graphql --paginate -f query='
  query($endCursor: String) {
    viewer {
      repositories(first: 100, after: $endCursor) {
        nodes { nameWithOwner }
        pageInfo {
          hasNextPage
          endCursor
        }
      }
    }
  }
'

Max results is 100 per page for example for example for repository list.

3. Other times I just reach for the PyGithub and throw something at the wall in a minute or so.

import os

from github import Github

# Loads GITHUB_ACCESS_TOKEN from the environment, or just set yours.
g = Github(os.environ.get("GITHUB_ACCESS_TOKEN"), per_page=100)

def list_repositories(user):
    repos = []
    try:
        # Get the user by username
        github_user = g.get_user(user)
        # print(github_user.name)
        # List all repositories (public and private)
        for gh_repo in github_user.get_repos():
            repos.append(gh_repo.full_name)
            # to print as it adds it:
            # print(gh_repo.full_name)
    except Exception as e:
        print(f"An error occurred: {e}")

    return repos


if __name__ == "__main__":
    # Replace 'username' with the GitHub username whose repositories you want to list
    username = "yourname"
    repositories = list_repositories(username)
    # print(f"Repositories for {username}:")
    for repo in repositories:
        print(repo)