Skip to content

Commit

Permalink
add _TODO_denorm.txt (temp)
Browse files Browse the repository at this point in the history
  • Loading branch information
aaxelb committed Feb 7, 2025
1 parent f74c87c commit 4c5b016
Showing 1 changed file with 20 additions and 0 deletions.
20 changes: 20 additions & 0 deletions _TODO_denorm.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,20 @@

ok so

trovesearch_denorm has perhaps tooo many indexed fields
(especially text fields and especially longer property paths)

## possible mitigations:

DONE:
- skip indexing nested "identifier" text (saves 107 fields)
- allow wild-card properties only to depth 1 (disallow `cardSearchText[*.*]`)
- stop hashing so much rendering valuesearch responses (get unique ids other ways)

could still do:
- skip making iri-value docs for common values?
- are there common values that will definitely not be value-searched?
- revisit text indexing/querying
- less fuzz? less slop? different analyzers?
- shorter dynamic field names -- hash? make reversible with additional sub-index
- more splitting! split iri-values index (maybe by hash-prefix? or card resource type?)

0 comments on commit 4c5b016

Please sign in to comment.