Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Vaex #243

Open
wants to merge 6 commits into
base: master
Choose a base branch
from
Open

Add Vaex #243

wants to merge 6 commits into from

Conversation

maartenbreddels
Copy link

Hi,

Hope we did this correctly, if there is anything you need, let us know. cc @JovanVeljanoski

Regards,

Maarten

Closes #180

return x.groupby(['id1','id2','id3','id4','id5','id6']).agg({'v3':'sum', 'v1':'count'})

# Generic benchmark function - to improve code readability
def benchmark(func, question, chk_sum_cols):
Copy link
Contributor

@jangorecki jangorecki Feb 10, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One of the goals was to make scripts be matching between languages/solutions. Using helpers makes it more blurry and less reproducible interactively line by line. It has been proposed already at least twice before, in python datatable and Julia DF. I see no way to satisfy those goals and keep using helpers. Helpers would have to be the same in each language, and that requires investigation to compare overhead they would make in each language. Therefore I would suggest to keep the structure quite the same as the other solutions are written now.
Note that I am not longer maintaining the project as I am no longer an employee of h2o.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you @jangorecki, we will do it.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hey @jangorecki

We refactored the code, so now it should be the exact same style as the rest of the repo.

I appreciate that you are not longer employed by h2o and not actively maintaining the project, but can you possibly point us to who should we contact regarding any further reviews, actions etc.

Thank you, and thank you for putting this all together.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not sure but @srini-x had some recent activity in this repo, so possibly he could help on that. Otherwise contacting h2o support or twitter should work.

@@ -10,12 +10,12 @@
exec(open("./_helpers/helpers.py").read())

ver = vaex.__version__['vaex-core']
git = 'alpha'
git = '-'
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This should stay as NA or "" if git hash is not available

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah I think i saw it for some of the other libraries.. but I will fix it !
Thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add Vaex comparison
3 participants