New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

GraphQL 无法根据时间抓取特定时间点的项目 #12

Open

bestony opened this issue Oct 1, 2018 · 0 comments

Labels

enhancement help wanted

Member

bestony commented Oct 1, 2018

目前项目使用 GraphQL 来进行数据抓取，但 GraphQL 的数据分页参数 after 接受的是一个特定的指针，而非特定的时间,因此无法直接对特定时间的数据进行抓取，从而只抓取特定时间端内的 commit 数据。

目前的数据抓取是通过抓取一个项目所有的数据并在后续的分析时进行时间隔离的。

可能导致的问题

对于 commit /pr 特别多的项目，可能无法在一次请求中抓取到所有的数据。目前脚本暂无断点续抓的代码

The text was updated successfully, but these errors were encountered:

bestony added enhancement help wanted labels

bestony added a commit that referenced this issue


          加入commit 的时间查询， Linked #12

b50d0c3

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment