You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We should be able to apply methods from TableOperations.jl to reimplement the selectrows and selectcols method for generic tables. This should help us avoid the issue we are currently experiencing with materializing NamedTuples
The text was updated successfully, but these errors were encountered:
For selecting rows, I'm hoping JuliaData/Tables.jl#278 will be more helpful, as it allows individual Tables formats to expose more efficient selection methods to the generic Tables.jl API, which TableOperations.jl cannot do. And one idea, is to subsume table-row access under the more generic getobs API at MLUtils.jl.
But happy to go with your suggestion for TableOperations.jl for column access.
ablaom
changed the title
Possibility of TableOperations.jl in MLJBase
Possibility of TableOperations.jl for column access
Jun 16, 2022
Worth noting here that, as far as I know, selectcols is not used within MLJBase at all, only selectrows. However, I believe it is exposed in MLJModelInterface, and the transformers in MLJModels do use it. I'd be inclined to removing this from MLJModelInterface in the future. A model provider really wanting generic table column accesss could just import Tables.jl or TableOperations.jl, I guess.
TableTransforms.jl has many operations for selecting, filtering, ... generic Tables.jl tables. It is very aligned with ML pipelines and I would consider using it instead of TableOperations.jl, which got stuck in time and is very limited in terms of functionality.
We should be able to apply methods from TableOperations.jl to reimplement the
selectrows
andselectcols
method for generic tables. This should help us avoid the issue we are currently experiencing with materializingNamedTuples
The text was updated successfully, but these errors were encountered: