cwltool enumerates every single file and folder in the output directory, unneccesarily

[mr-c]

cwltool/cwltool/process.py

Line 310 in 734322e

for root, dirs, files in os.walk(outdir):

To reproduce: run cwltool --outdir ${HOME} and a simple CWL description on real user's system

Perhaps a single temporary folder should be created within outdir where the intermediate output directories are then stored under? That way this loop would iterate over just that single folder instead of walking the entire tree from outdir.

[esanzgar]

Are you sure is that line that causes the issue?

I believe it might be this other:

cwltool/cwltool/process.py

Line 334 in 19f2cb6

for root, dirs, files in os.walk(outdir):

This code needs urgent revision, it causes a huge performance penalty.

[mr-c]

@esanzgar you are correct, I didn't use a permalink so the line numbers shifted. I've updated the issue, thanks!

[psafont]

Work happening on #850

[psafont]

Solved with #926