Simple Algorithms to Start

[Alan-Qiao]

Now that we have a functional baseline algorithm and evaluation function for a simple study #3, we want to build up some simple algorithms to traverse through the entire decision process.

1. Give the algorithm access to the scoring function and just greedily select groupings that would minimize difference score (the lower the score the better performing)
   1. This is probably too slow, and if enough people arrive at once, the combinations possible to test are too high.
   2. Perhaps optimize this later on if we want to revisit this?
2. Greedy algorithm that weighs samples with lower probability greater
   1. Randomly sample from the pool of participants and build a distribution
   2. Compute pdf (kde) over this random space to determine which points are less likely
   3. Resample by inverse pdf

We want to build out the entire testing machinery on simple algorithms so that we easily apply this pipeline to other algorithms.

[Alan-Qiao]