[feat] Repo registries and RAG workflows#154

Draft

sroussey wants to merge 40 commits intomainfrom

Commits on Dec 30, 2025

[feat] New VectorQuantizeTask, updated VectorSimilarityTask
sroussey
committed

Commits on Jan 4, 2026

[feat] Introduce new AI tasks and enhance document processing capabilities
sroussey
committed
Update packages/ai/src/source/ProvenanceUtils.ts

sroussey
and
Copilot
authored
Update packages/ai/src/source/StructuralParser.ts

sroussey
and
Copilot
authored
Update packages/ai/src/source/ProvenanceUtils.ts

sroussey
and
Copilot
authored
Update packages/ai/src/task/ChunkToVectorTask.ts

sroussey
and
Copilot
authored
Update packages/ai/src/task/QueryExpanderTask.ts

sroussey
and
Copilot
authored
Update packages/task-graph/src/task/Task.ts

sroussey
and
Copilot
authored
Update packages/util/src/vector/Tensor.ts

sroussey
and
Copilot
authored
Initial plan
Copilot
committed
Update packages/ai/src/task/VectorQuantizeTask.ts

sroussey
and
Copilot
authored
Update packages/util/src/vector/VectorUtils.ts

sroussey
and
Copilot
authored
Optimize quantizeToUint8 and quantizeToUint16 with single-pass min/max

Copilot
and
sroussey
committed
Remove unused query variable from InputResolver test (#161)

Copilot
and
sroussey
authored
Fix edge case: return non-zero range for empty arrays in findMinMax

Copilot
and
sroussey
committed
Fix markdown auto-detection to use header pattern matching (#157)

Copilot
and
sroussey
authored
Remove unused task class imports from ChunkToVector.test.ts (#160)

Copilot
and
sroussey
authored
Fix inconsistent vector/tensor terminology in Tensor.ts (#167)

Copilot
and
sroussey
authored
Optimize VectorQuantizeTask min/max calculation for large vectors (#168)

Copilot
and
sroussey
authored
Replace unsafe type assertions with type-safe field extraction in Document.addVariant (#158)

Copilot
and
sroussey
authored
Add test coverage for VectorSimilarityUtils functions (#165)

Copilot
and
sroussey
authored
Extract magic number to named constant in ProvenanceUtils (#159)

Copilot
and
sroussey
authored
Add support for Float16Array in normalize function of VectorUtils.ts
sroussey
committed
Merge branch 'rag' into copilot/sub-pr-154
sroussey
authored
Update packages/ai/src/source/StructuralParser.ts

sroussey
and
Copilot
authored
Fix naming inconsistency between Vector type and TensorSchema (#169)

Copilot
and
sroussey
authored
Enhance jaccardSimilarity function to handle negative values by normalizing inputs to a non-negative range. This includes calculating the global minimum across both vectors and adjusting values acc…
sroussey
committed
Merge branch 'copilot/sub-pr-154' into rag
sroussey
committed
[test] Add tests for VectorUtils, covering magnitude, inner product, normalization, and handling of various TypedArray types. Update normalize function to support an additional parameter for Float3…
sroussey
committed
Add circular reference detection to smartClone method (#162)

Copilot
and
sroussey
authored
Merge branch 'rag-doc' into rag
sroussey
committed
Merge branch 'rag-run' into rag
sroussey
committed
Merge branch 'rag-repos' into rag
sroussey
committed
Merge branch 'rag-workflow' into rag
sroussey
committed

Commits on Jan 6, 2026

Refactor ModelRegistry and InputResolver for improved type handling of model arrays
sroussey
committed