Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add FederatedQueryPlanner #2216

Open
wants to merge 64 commits into
base: integration
Choose a base branch
from
Open

Add FederatedQueryPlanner #2216

wants to merge 64 commits into from

Commits on Sep 19, 2023

  1. Enrich 'i' and 'ri' rows in metadata table with event date 

    Modify the generation of 'i' (indexed rows) and 'ri' (reverse indexed
rows) in the metadata table such that the column qualifier contains the
event date. This is required as a first step to support efforts for
issue #825 so that we can identify dates when an event was ingested and
included in a frequency count for an associated 'f' row, but was not
indexed.
    @lbschanno
    lbschanno committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    cfefd87 View commit details
    Browse the repository at this point in the history

Commits on Sep 29, 2023

  1. Merge branch 'integration' into task/datedIndexMetadata

    @ivakegg
    ivakegg committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    0e4f806 View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2023

  1. Merge branch 'integration' into task/datedIndexMetadata

    @ivakegg
    ivakegg committed Oct 4, 2023
    Configuration menu
    Copy the full SHA
    f2aa20b View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2023

  1. Merge branch 'integration' into task/datedIndexMetadata

    @ivakegg
    ivakegg committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    ab9ee4c View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2023

  1. Merge branch 'integration' into task/datedIndexMetadata

    @lbschanno
    lbschanno committed Nov 7, 2023
    Configuration menu
    Copy the full SHA
    43aeae8 View commit details
    Browse the repository at this point in the history

Commits on Nov 24, 2023

  1. Merge branch 'integration' into task/datedIndexMetadata

    @ivakegg
    ivakegg committed Nov 24, 2023
    Configuration menu
    Copy the full SHA
    83014c1 View commit details
    Browse the repository at this point in the history

Commits on Dec 19, 2023

  1. Add counts to 'i' and 'ri' rows

    @lbschanno
    lbschanno committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    ab14fe2 View commit details
    Browse the repository at this point in the history

Commits on Jan 10, 2024

  1. Merge branch 'integration' into task/datedIndexMetadata

    @lbschanno
    lbschanno committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    9aad9f6 View commit details
    Browse the repository at this point in the history

Commits on Jan 12, 2024

  1. Initial federated query planner implementation

    @lbschanno
    lbschanno committed Jan 12, 2024
    Configuration menu
    Copy the full SHA
    da6ee69 View commit details
    Browse the repository at this point in the history

  2. code formatting

    @lbschanno
    lbschanno committed Jan 12, 2024
    Configuration menu
    Copy the full SHA
    b40201b View commit details
    Browse the repository at this point in the history

Commits on Jan 13, 2024

  1. Fixed issues with FederatedQueryIterable

    @lbschanno
    lbschanno committed Jan 13, 2024
    Configuration menu
    Copy the full SHA
    8ca62b3 View commit details
    Browse the repository at this point in the history

  2. Fix test failures

    @lbschanno
    lbschanno committed Jan 13, 2024
    Configuration menu
    Copy the full SHA
    59d3be9 View commit details
    Browse the repository at this point in the history

  3. Fix failing tests

    @lbschanno
    lbschanno committed Jan 13, 2024
    Configuration menu
    Copy the full SHA
    bde374d View commit details
    Browse the repository at this point in the history

  4. Additional test fixes

    @lbschanno
    lbschanno committed Jan 13, 2024
    Configuration menu
    Copy the full SHA
    461a526 View commit details
    Browse the repository at this point in the history

Commits on Jan 18, 2024

  1. pr feedback

    @lbschanno
    lbschanno committed Jan 18, 2024
    Configuration menu
    Copy the full SHA
    7784b4c View commit details
    Browse the repository at this point in the history

Commits on Jan 23, 2024

  1. Use new MetadataHelper function version

    @lbschanno
    lbschanno committed Jan 23, 2024
    Configuration menu
    Copy the full SHA
    b288196 View commit details
    Browse the repository at this point in the history

Commits on Jan 24, 2024

  1. Extract fields to filter index holes

    @lbschanno
    lbschanno committed Jan 24, 2024
    Configuration menu
    Copy the full SHA
    c34a543 View commit details
    Browse the repository at this point in the history

  2. Correct logic for determining sub date ranges

    @lbschanno
    lbschanno committed Jan 24, 2024
    Configuration menu
    Copy the full SHA
    e0ef160 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'integration' into task/federatedQueryPlanner

    @lbschanno
    lbschanno committed Jan 24, 2024
    Configuration menu
    Copy the full SHA
    9ea3a84 View commit details
    Browse the repository at this point in the history

  4. Remove unnecessary check

    @lbschanno
    lbschanno committed Jan 24, 2024
    Configuration menu
    Copy the full SHA
    7052bcb View commit details
    Browse the repository at this point in the history

  5. code formatting

    @lbschanno
    lbschanno committed Jan 24, 2024
    Configuration menu
    Copy the full SHA
    d44e0f0 View commit details
    Browse the repository at this point in the history

Commits on Jan 27, 2024

  1. Merge branch 'integration' into task/federatedQueryPlanner

    @lbschanno
    lbschanno committed Jan 27, 2024
    Configuration menu
    Copy the full SHA
    fca2fff View commit details
    Browse the repository at this point in the history

  2. Add check for null query model

    @lbschanno
    lbschanno committed Jan 27, 2024
    Configuration menu
    Copy the full SHA
    e341c72 View commit details
    Browse the repository at this point in the history

Commits on Jan 29, 2024

  1. Limit config arg to function scope

    @lbschanno
    lbschanno committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    8779a99 View commit details
    Browse the repository at this point in the history

  2. Update metadata-utils submodule commit

    @lbschanno
    lbschanno committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    a875a20 View commit details
    Browse the repository at this point in the history

  3. code formatting

    @lbschanno
    lbschanno committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    cd20ca5 View commit details
    Browse the repository at this point in the history

Commits on Feb 6, 2024

  1. Merge branch 'integration' into task/federatedQueryPlanner

    @lbschanno
    lbschanno committed Feb 6, 2024
    Configuration menu
    Copy the full SHA
    56e3bad View commit details
    Browse the repository at this point in the history

  2. Fix failing tests

    @lbschanno
    lbschanno committed Feb 6, 2024
    Configuration menu
    Copy the full SHA
    39ecec4 View commit details
    Browse the repository at this point in the history

  3. Additional test fixes

    @lbschanno
    lbschanno committed Feb 6, 2024
    Configuration menu
    Copy the full SHA
    906f3ee View commit details
    Browse the repository at this point in the history

  4. Ensure all original tests pass

    @lbschanno
    lbschanno committed Feb 6, 2024
    Configuration menu
    Copy the full SHA
    9478a62 View commit details
    Browse the repository at this point in the history

Commits on Feb 27, 2024

  1. Add federated planner tests and chained schedulers

    @lbschanno
    lbschanno committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    1bf9201 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'integration' into task/federatedQueryPlanner

    @lbschanno
    lbschanno committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    941607f View commit details
    Browse the repository at this point in the history

Commits on Feb 29, 2024

  1. pr feedback

    @lbschanno
    lbschanno committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    c019c78 View commit details
    Browse the repository at this point in the history

Commits on Mar 6, 2024

  1. metadata-utils 3.0.3 tag

    @ivakegg
    ivakegg committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    9c72dab View commit details
    Browse the repository at this point in the history

  2. Fixed the index hole data ingest to set appropriate time stamps on th… 

    …e keys

Removed some of the code which I believe was trying to diagnose the test issues
    @ivakegg
    ivakegg committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    e5af693 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'integration' into task/federatedQueryPlanner

    @ivakegg
    ivakegg committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    0842cec View commit details
    Browse the repository at this point in the history

  4. Updated applyModel to use the passed in script

    @ivakegg
    ivakegg committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    d774f6f View commit details
    Browse the repository at this point in the history

  5. Remove unneeded changes

    @lbschanno
    lbschanno committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    3da641d View commit details
    Browse the repository at this point in the history

Commits on Mar 7, 2024

  1. Make FederatedQueryPlanner the default

    @lbschanno
    lbschanno committed Mar 7, 2024
    Configuration menu
    Copy the full SHA
    235dad8 View commit details
    Browse the repository at this point in the history

Commits on Mar 8, 2024

  1. Restore original log4j.properties

    @lbschanno
    lbschanno committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    b63b24c View commit details
    Browse the repository at this point in the history

  2. Merge branch 'integration' into task/federatedQueryPlanner

    @lbschanno
    lbschanno committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    0c4ccff View commit details
    Browse the repository at this point in the history

  3. code formatting

    @lbschanno
    lbschanno committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    5515fdc View commit details
    Browse the repository at this point in the history

Commits on Mar 9, 2024

  1. Fix QueryPlanTest

    @lbschanno
    lbschanno committed Mar 9, 2024
    Configuration menu
    Copy the full SHA
    fede1a0 View commit details
    Browse the repository at this point in the history

  2. Updated to test with teardown

    @ivakegg
    ivakegg committed Mar 9, 2024
    Configuration menu
    Copy the full SHA
    6ed7a39 View commit details
    Browse the repository at this point in the history

Commits on Mar 11, 2024

  1. Test debugging edits

    @lbschanno
    lbschanno committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    1d506e3 View commit details
    Browse the repository at this point in the history

Commits on Mar 13, 2024

  1. Updated formatting

    @ivakegg
    ivakegg committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    0578bc2 View commit details
    Browse the repository at this point in the history

  2. Concatenate sub-plans

    @lbschanno
    lbschanno committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    e9a76e6 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'integration' into task/federatedQueryPlanner

    @lbschanno
    lbschanno committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    195dabe View commit details
    Browse the repository at this point in the history

Commits on Mar 14, 2024

  1. Make FederatedQueryPlanner implement Cloneable

    @lbschanno
    lbschanno committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    d6354ce View commit details
    Browse the repository at this point in the history

  2. code formatting

    @lbschanno
    lbschanno committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    c2a57f0 View commit details
    Browse the repository at this point in the history

Commits on Jun 3, 2024

  1. Merge branch 'integration' into task/federatedQueryPlanner

    @lbschanno
    lbschanno committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    6e1f131 View commit details
    Browse the repository at this point in the history

Commits on Jun 11, 2024

  1. Merge branch 'integration' into task/federatedQueryPlanner

    @lbschanno
    lbschanno committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    a2da80c View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2024

  1. Merge branch 'integration' into task/federatedQueryPlanner

    @lbschanno
    lbschanno committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    49c4bc6 View commit details
    Browse the repository at this point in the history

Commits on Jun 25, 2024

  1. Merge branch 'integration' into task/federatedQueryPlanner

    @ivakegg
    ivakegg committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    53a3ea8 View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2024

  1. Merge remote-tracking branch 'origin/integration' into task/federated… 

    …QueryPlanner
    @ivakegg
    ivakegg committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    cbe8d87 View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2024

  1. * Updated with metadata-utils 4.0.5 (index markers and avoid non-inde… 

    …xed fields for holes)

* Fixed test cases with correct responses and periodic failing test cases
* Updated AncestorQueryLogic to handle federate query planner
    @ivakegg
    ivakegg committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    74c9db8 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'integration' into task/federatedQueryPlanner

    @ivakegg
    ivakegg committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    6608e5f View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2024

  1. * Allow subclasses of ShardQueryConfiguration

    @ivakegg
    ivakegg committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    390ae48 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/integration' into task/federated… 

    …QueryPlanner
    @ivakegg
    ivakegg committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    5b52f8b View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2024

  1. Merge branch 'integration' into task/federatedQueryPlanner

    @ivakegg
    ivakegg committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    5516f73 View commit details
    Browse the repository at this point in the history

  2. Updated to throw a NoResultsException for am empty query.

    @ivakegg
    ivakegg committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    8370ea2 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'task/federatedQueryPlanner' of github.com:NationalSecur… 

    …ityAgency/datawave into task/federatedQueryPlanner
    @ivakegg
    ivakegg committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    a9cb2fa View commit details
    Browse the repository at this point in the history

  4. import reorg

    @ivakegg
    ivakegg committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    fece27b View commit details
    Browse the repository at this point in the history

  5. Updated to avoid expanding unfielded if disabled, and to assume no in… 

    …dex holes if no query fields.
    @ivakegg
    ivakegg committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    9aca68a View commit details
    Browse the repository at this point in the history