Code search not working

[glebov21]

Select Topic Area

Bug

Body

1. Go to https://github.com/dotnet/aspnetcore
2. Search this string: "ConfigureWebDefaults"
3. Result = nothing in code and commits

This file contains ConfigureWebDefaults method
https://github.com/dotnet/aspnetcore/blob/main/src/DefaultBuilder/src/WebHost.cs

[look]

@glebov21 sorry about that 😞 I confirmed it also happened for me so there is likely a problem with indexing that file or repo in the old code search.

However, we have a new code search which is much more powerful and does find this match. Please sign up for the beta and give us your feedback.

[glebov21]

Yes, search from beta working fine 👍

[ppazos]

I tried the new search and doesn´t work repo:ppazos/grails-security-stateless-ng validateAndExtractToken

[lsinger]

@look until the new code search is available, is there a way to rebuild the search index for a repo or something like that? It feels like code search for the https://github.com/woocommerce/woocommerce repo is completely disabled, which is creating quite some friction for our community contributors. 😕

[jakub-g]

I have a reverse problem in our private repo: old code search is working, but new code search always shows

This repository's code is being indexed right now. Try again in a few minutes.

[look]

@jakub-g if you can let me know the repository name(s) that are not indexed, I can look it up and see what the problem is. If you can't post the name in a public discussion, please create a support request and reference my message here.

[pjinggithub]

@look we are use github api to search files with 1 keywords in our organization in a code, but we can not get accurate search result, run same search in guihub.com GUI has same issue. I saw to enable "new code search" under new feature, I did for my personal user, looks we get better search result.
Question:
can I ask my github organization admin to enable "new code search" for the github user which has the private token we use in our code to get same search result like my personal user?

[look]

@pjinggithub we don't yet have an API powered by the new code search, but we are actively working on it. If you let me know your organization name, I can try repairing the legacy search index.

[pjinggithub]

@look Hi Luke, thank you to reply, we tested it with enable "new code search" under new feature for our github service user, and run the api code, just like you said API has not support "new code search", we get the same search result as before.
My organization name is "LoyaltyOne", would appreciate if you can help repairing the legacy search index.

[look]

I reindexed that org, let me know if that addressed your problem.

[pjinggithub]

@look
thank you for reindexing it. I can see the improvement when I do search (not enable new code search) and found more codes with my search condition than before. while my Github API search code did not get similar result using the same github user.
not sure why the behavior is like this.

• I used search command as follow in Github web and found "62 code results"

https://github.com/search?q=org%3ALoyaltyOne+ubuntu-22-slim&type=code

• in the search report created by my Github API code shows "0" as follow screenshot :
  

I noticed looks like the search result is random, sometime show the number is "5", sometime show the number is "0", but never show close to "62".
what is the root cause of Github API behaviour after reindex, the API call search is not improved.
if can not find the root cause, we still can use manually search as reference though it is not ideal.

Thank you for your effort and help!

[creativepl-php]

U destroy search tool. Only "This repository's code is being indexed right now. Try again in a few minutes." message, every time.

[kaiser101]

The new code search is broken. Any changes to the search query takes you to a "Something went wrong" page.

[maggiemagnuson]

Yeah, I'm unable to search against my personal org. Every time I try to run a search the results are always the same: "This account's code has not been indexed yet. Try again later." I've been trying again "later." In fact, I've been trying for the last few days. Am I missing something here?

[TorutheRedFox]

I have been trying for months

[0xHoid]

fix

[Michal-Zablocki]

Hi, please fix this.

[emrecoban]

It is still the same.

[UmerYousuf]

New code searches have multiple issues including pagination limited to 5 pages and sorting issues. When will all these things be fixed? @look

[look]

Increasing the number of results is something we plan on doing. We are not planning to add back date-based sorting at this time.

[kaiser101]

Typical Microsoft. Take something working, break it, then release patches.

[UmerYousuf]

You know recent indexed features are the main part of our codebase but you guys just forcefully disable that feature and enforce this. Also, when will it except to get fixed the pagination issue? Lastly, Is there any way to get back the previous UI

[ArirangSensei]

Can we have an ETA for the fix? Our company is doing a migration from BitBucket to Github and this bug is currently impacting thousands of our repos

[kaiser101]

As a user, I would simply say this to you. Don't get your hopes too high.

[look]

@ArirangSensei sorry for the poor experience. We are working on fixing onboarding of imported repositories. In the meanwhile, please give me your org name so I can reindex it for you.

[ArirangSensei]

@ArirangSensei sorry for the poor experience. We are working on fixing onboarding of imported repositories. In the meanwhile, please give me your org name so I can reindex it for you.

Thanks for your response @look may I know what is the cross impact &outage time for the reindex? I need to inform our DevOps team if there is any.

[look]

Repos should be searchable within 5-10 minutes. There is no downtime.

[ArirangSensei]

Repos should be searchable within 5-10 minutes. There is no downtime.

Let me check with our DevOps team, they need to get this reindex operation evaluated & approved

[eveenendaal]

I just finished porting all my personal repos from GCP to GitHub. The GitHub user interface is amazing, but this search bug is affecting me as well. It’s been a few days, but all my repos still say “This account's code has not been indexed yet. Try again later.” 😢

[look]

Sorry about that. We're working on improving indexing of imported repositories. In the meanwhile, I reindexed all your repositories.

[eveenendaal]

I'm still getting the same error. It doesn't appear the reindexing worked.

[tourbugs]

In code why I'm not able to see sort feature??

[look]

We have removed the ability to sort results.

[jaime11]

Also having the same issue with all my repos

[tourbugs]

@look is there another method to sort the results?

[duzenko]

How do I get the search working for our organization private repositories?
What is your problem with just fixing it?

[kaiser101]

That's Microsoft for you

[redaezziani]

node js ?

[yxt7979]

hii, still "This repository's code is being indexed right now. Try again in a few minutes." in repo fuqichen1998/Deformer

[look]

Our repository status tooling indicates that this repository is indexed, and I get results for a search. Are you still experiencing problems?

[yxt7979]

It works! Thank you so much!

[NickHeap2]

@look I'm trying to scan the advancedcsg org code base to check the impact of some breaking package changes via the REST API but results are missing from repos compared to the web search. Can you reindex to resolve this please?

[look]

I triggered a reindexing for your organization's code. Please note, however, that the API does have different behavior compared to web search. It still uses the legacy code search syntax.

[ReEnMikki]

I triggered a reindexing for your organization's code. Please note, however, that the API does have different behavior compared to web search. It still uses the legacy code search syntax.

So is there no way to use api to search code within forked/ archived repos ?

[gregleesmt]

Majority of my organization's private repo's don't seem to be indexed properly for searching.

[gregleesmt]

took 2 weeks to index!

[jrefano]

not working here, either

[look]

Can you provide some details about what's not working @jrefano?

[kaiser101]

This is the new operating model for github. You send requests for re-indexing each of your repos again. Then @look will re-index them for you and hopefully they will work. But @microsoft, why did you have to break something which was working?

[vinaykharayat]

Microsoft does that with every good poduct, they kill it. I will reconsider using github. My code search in private repos still not working :(

[kaiser101]

Satya Nadella is continuing Bill Gates legacy. Buying Github also gives Microsoft access to a lot of intellectual property. They also killed Atom from Github once they bought Github, so they could monopolize VS Code.

[avishj]

Hey @look, could you please help with re-indexing my repo as well? https://github.com/avishj/coding-problems

Stuck on this for multiple days: This repository's code is being indexed right now. Try again in a few minutes.

[look]

Hi @avishj. I'm not sure what happened, but it's working now.

[avishj]

The search is fixed now, but the languages section still doesn't work, is there something specific I have to do make that update?

[look]

Can you explain what's wrong with the languages? That is not related to the code search index, but I will see what I can do.

[avishj]

If you check out my repository, you'll see that the languages are also out of date. Majority of the codebase is SQL, which is not even shown here.

[vinaykharayat]

Please fix my profile too,
https://github.com/vinaykharayat

[elisimpson]

Search index appears to be broken again today. I'd say at least 80% of time when I try to search my repos it says it hasn't been indexed and to try back later.

[anandvijapur]

Hey @look can you please help with re-indexing my repos - https://github.com/anandvijapur/MyCricketFollowingApp and https://github.com/anandvijapur/MyCricketFollowingServer
Thanks!

[bbnoc]

Hi @look - Could you please re-index all my repos?

[gi11es]

Hi @look this private repo was uploaded a month ago: https://github.com/layerproject/qcm8550_android13.0_ba01_r035

And it still reports "This repository's code is being indexed right now". Can you check if it's really still indexing? It's very large, but I would have thought it would be done by now.

[look]

@gi11es, this repository has too many paths to index. Sorry for the incorrect error message, I am currently working on rolling out a change that will make it more clear why the repository can't be indexed.

[smoya]

Another example of a repository "being indexed" for months - https://github.com/smoya/timescaledb-benchmarker

[look]

Hmm, I'm not sure what was happening, but search is working for me at this time: https://github.com/search?q=repo%3Asmoya%2Ftimescaledb-benchmarker%20contributors&type=code

Are you getting results now?

[GarenWoo]

I'm looking for help. It seems that my repo is suffering from the same problem. Every time I try to search in my repo, it shows that its code is being indexed. This situation has lasted for several weeks.

My repo(private): https://github.com/GarenWoo/Etherpedition

Could u please fix it or give some feasible solutions？

[look]

@GarenWoo, this repository has too many paths to index. Sorry for the incorrect error message, I am currently working on rolling out a change that will make it more clear why the repository can't be indexed.