-
Notifications
You must be signed in to change notification settings - Fork 367
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Improve Performance on LocalFileSystem.ls()
if detail=False
#1789
base: master
Are you sure you want to change the base?
Improve Performance on LocalFileSystem.ls()
if detail=False
#1789
Conversation
The failures are not your fault (also seen in #1790 ), I'll fix early next week. |
The windows failure I think is genuine - we are getting windows path separators inside an otherwise posix path in the ls() code path. |
…o-details' into improve-performance-when-using-no-details # Conflicts: # fsspec/implementations/tests/test_local.py
removed the hard coded |
I think using pathlib is the wrong choice for two reasons:
Hah, yeah, instead of removing the one errant "\", it made all the separators like that:
|
ah I was not aware of the |
Can you do a speed test, please, and then I'll merge this. I ask because make_path_posix isn't free either, but should still be faster than info(). |
Relates to #1788
Only get the infos on a file if they are requested by the user - otherwise return just the path as usual.