Great video! Thanks. When you resize and make the window bigger, can you config it so that more rows and columns are brought into the viewport? Also free to header rows and first columns? I have tried it with a big dataframe and I cannot resolve this issue.
Hello, can u please make a video on how to read text files with massive speed, i have a folder full of text files with +1Gb each file to search query in. what i can do?
Either use mmap (this example shows line by line but you could just perform a re search over the full content if reading the big file into memory isn't a concern): import mmap with open("FILE", "r+b") as f: mm = mmap.mmap(f.fileno(), 0) for line in iter(mm.readline, b""): print(line) Or if multirow operations aren't as big of an issue/don't need special code to perform on & you need to perform a ton of queries, you can just dump the contents (make a table, column_name = filename, new line in file = new row in column) into some sqlite/duckdb database & perform SQL queries over the top of them. If you REALLY need to go further you could theoretically do multiprocessing & with os.fork() + mmap start applying operations as the file is being read given the current location of the pointer, but if you're dealing with parent/child processes you might want to take this as an opportunity to just learn a lower level language for both your own benefit & understanding + better control
I have a question. I know how things go and how they happen. But I don't know how to code on my own without taking help from GPT, Bard etc. Can I actually make a project using those and place them in my resume?
Using AI to learn isn't bad; searching for how to use a function you forgot or help with some tasks is okay, and everyone does it. But if you can only code with it, it's a problem. Try to code a project without AI, as long as it takes, searching on your own. If you struggle too much it shows you must learn other things before or pratice what you already know. I think.
This is outstanding content. Thank you!
Great video! Thanks. When you resize and make the window bigger, can you config it so that more rows and columns are brought into the viewport? Also free to header rows and first columns? I have tried it with a big dataframe and I cannot resolve this issue.
Seems like it might really come in handy some day.
Is there a way to do conditional formatting in pandastable library ?
Nice! Thank you.
Hello, can u please make a video on how to read text files with massive speed, i have a folder full of text files with +1Gb each file to search query in. what i can do?
try loading the text files lines as a dictionary. it should increase the speed of search querys.
@@evanpendergraft wdym? what is the key and what is the value?
Either use mmap (this example shows line by line but you could just perform a re search over the full content if reading the big file into memory isn't a concern):
import mmap
with open("FILE", "r+b") as f:
mm = mmap.mmap(f.fileno(), 0)
for line in iter(mm.readline, b""):
print(line)
Or if multirow operations aren't as big of an issue/don't need special code to perform on & you need to perform a ton of queries, you can just dump the contents (make a table, column_name = filename, new line in file = new row in column) into some sqlite/duckdb database & perform SQL queries over the top of them. If you REALLY need to go further you could theoretically do multiprocessing & with os.fork() + mmap start applying operations as the file is being read given the current location of the pointer, but if you're dealing with parent/child processes you might want to take this as an opportunity to just learn a lower level language for both your own benefit & understanding + better control
Use the operating system directly. For huge amounts of data scraping, all languages but C are deficient. grep would be your friend.
Can U do other programming languages content, like C#?
Kinda cool. Though why would anyone use this over Excel?
hiw use this in kivy or flet
Thx_.
first
useless but good to know it exists
I have a question. I know how things go and how they happen. But I don't know how to code on my own without taking help from GPT, Bard etc.
Can I actually make a project using those and place them in my resume?
Using AI to learn isn't bad; searching for how to use a function you forgot or help with some tasks is okay, and everyone does it. But if you can only code with it, it's a problem. Try to code a project without AI, as long as it takes, searching on your own. If you struggle too much it shows you must learn other things before or pratice what you already know. I think.
@@NikolazLopes thanks bro
I'll try your approach
Thanks! Is it possible to use Pandastable on Google Colab?