Skip to content

Don't fail when the log directory already exists - #705

Open
Shriraj1901 wants to merge 1 commit into
dask:mainfrom
Shriraj1901:log-dir-race
Open

Shriraj1901 wants to merge 1 commit into
dask:mainfrom
Shriraj1901:log-dir-race

Conversation

@Shriraj1901

Copy link
Copy Markdown

Checking for the directory and then creating it is racy: when several clusters start at once and share a log directory, the one that loses the race gets a FileExistsError. Let makedirs handle the existing case.

Fixes #692

Checking for the directory and then creating it is racy: when several
clusters start at once and share a log directory, the one that loses
the race gets a FileExistsError. Let makedirs handle the existing case.

Fixes dask#692

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Potential for SLURMCluster log directory creation failing

1 participant