You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
ella delegates handling of lazy execution/logical plans to datafusion internally. Datafusion/arrow only implements most operations for scalar arrays, which means that extension types like Tensors are unsupported.
Fully implementing support for tensors is going to be somewhat complicated. I will probably require a full set of custom physical nodes that implement all of the operations for tensors. In addition, for tensors to work in plans generated by SQL queries and not just the expressions API we would need some kind of custom planner or analyzer rule that would walk the logical plan and replace nodes as needed.
The text was updated successfully, but these errors were encountered:
ella delegates handling of lazy execution/logical plans to datafusion internally. Datafusion/arrow only implements most operations for scalar arrays, which means that extension types like Tensors are unsupported.
Fully implementing support for tensors is going to be somewhat complicated. I will probably require a full set of custom physical nodes that implement all of the operations for tensors. In addition, for tensors to work in plans generated by SQL queries and not just the expressions API we would need some kind of custom planner or analyzer rule that would walk the logical plan and replace nodes as needed.
The text was updated successfully, but these errors were encountered: