Skip to content

Commit

Permalink
Add more on docs
Browse files Browse the repository at this point in the history
  • Loading branch information
Wh1isper committed Dec 11, 2023
1 parent 2336629 commit a8e1d03
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions docs/source/design/architecture.rst
Original file line number Diff line number Diff line change
Expand Up @@ -53,6 +53,7 @@ Key components
- ``Inspector``: Used to extract metadata such as patterns, types, etc. from raw data.
- ``Transformer``: Used to modify data to comply with requirements, such as masking sensitive information or discarding non-compliant data.
- ``Formatter``: Used to format non-compliant data into compliant data, such as datetime to timestamp.
The **same** Formatter **SHOULD** be used for training and sampling.
- ``Sampler``: Used to sample data. For sparse or huge datasets, it is a more efficient way.
Simple sampling may lead to loss of some information, which **MAY** need to do more processing to ensure uniformity,
*e.g. sparse category should not be missing after sampling.*
Expand Down

0 comments on commit a8e1d03

Please sign in to comment.