I just went ahead and used the jit wrapper. Decreased my calculation time by 80%. But I'm also thinking about switching to JULIA if similar calculations have to be done a few more times.
As a heavy user of Pandas, dealing with numbers and strings all day, I have found that Numba and Modin are just jokes for me. Maybe establishing all projects in the future on JULIA is the only hope. Native LLVM, no GIL, easy grammar for Python users ... Wow.
Lol... with what you're doing, I'd say either use sql for other things as Pandas is only great for dataframes but is kinda slow on other uses... then use Cython. Python can be fast
@@bernardfinucane2061 haha yes assuming you already know c or c++. Also if you gonna do it, use cuda jit kernels. Don't waste time on vectorize or even worse guvectorize
I just went ahead and used the jit wrapper. Decreased my calculation time by 80%.
But I'm also thinking about switching to JULIA if similar calculations have to be done a few more times.
What did you find in the end? Is Julia faster than Numba?
@@Shreendg don't know, not for me. I've been sticking to Python. Julia may he the future, but if python does all things you need just stick to it.
numba don't support infinite integer :'(
infinites are rational.
@@Stopinvadingmyhardware ( you can't use numba to compute on huge integers )
As a heavy user of Pandas, dealing with numbers and strings all day, I have found that Numba and Modin are just jokes for me. Maybe establishing all projects in the future on JULIA is the only hope. Native LLVM, no GIL, easy grammar for Python users ... Wow.
numba is for mathematical calculations not data cleaning or whatever u are doing.
@@stxnw lmao, exactly
Lol... with what you're doing, I'd say either use sql for other things as Pandas is only great for dataframes but is kinda slow on other uses... then use Cython. Python can be fast
After spending few days on this, just learn C and save your self some time. This is like reinventing the wheel
you have to live it
@@baodau2230 I got it to work. What a waste of a week lol
you really think so ?
I think it takes more a week to get proficient at C.
@@bernardfinucane2061 haha yes assuming you already know c or c++. Also if you gonna do it, use cuda jit kernels. Don't waste time on vectorize or even worse guvectorize