What is the problem the feature request solves?

In prepare_datafusion_session_context (jni_api.rs). We do not specify max_temp_directory_size and use the default of 100GB.

I haven't run into any problems with this setting, but we should probably make this configurable.

Describe the potential solution

No response

Additional context

No response