Skip to content

[WIP] cases: rewrite Shared Dev Server #1724

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 2 commits into from

Conversation

jorgeorpinel
Copy link
Contributor

@jorgeorpinel jorgeorpinel commented Aug 27, 2020

@shcheklein shcheklein temporarily deployed to dvc-landing-use-cases-s-rzdkxy August 27, 2020 01:42 Inactive
@jorgeorpinel jorgeorpinel changed the base branch from master to use-cases August 27, 2020 01:42
@jorgeorpinel jorgeorpinel changed the title [WIP] cases: rewrite Shared Dev Server cases: rewrite Shared Dev Server Aug 27, 2020
@jorgeorpinel jorgeorpinel temporarily deployed to dvc-landing-use-cases-s-rzdkxy August 27, 2020 03:16 Inactive
Comment on lines 58 to 74
And tell DVC to set group permissions on newly created or downloaded cache
files:
And configure DVC to set group permissions on cached assets, and to enable all
[link types](/doc/user-guide/large-dataset-optimization#file-link-types-for-the-dvc-cache):

```dvc
$ dvc config cache.shared group
$ dvc config cache.type 'reflink,symlink,hardlink,copy'
```

> See `dvc cache dir` and `dvc config cache` for more information.
⚠️ Note that you cam't manually modify tracked data with the above `cache.type`
value. Soft/hard links are disabled by default for this reason, but are needed
for a reliable shared cache.
Copy link
Contributor Author

@jorgeorpinel jorgeorpinel Aug 27, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Here are the updates to address #429 (comment) @shcheklein — note that the manual protect setting is no longer required (it's now automatic with sym/hardlinks).

I'm just not sure I get why this is necessary so only wrote "symlink,hardlink... are needed for a reliable shared cache" for now.

Copy link
Contributor Author

@jorgeorpinel jorgeorpinel Aug 27, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oops, typo in cam't 🤦 - fixing...

add note about enabling all link types to close #429
@jorgeorpinel jorgeorpinel temporarily deployed to dvc-landing-use-cases-s-rzdkxy August 27, 2020 03:20 Inactive
@jorgeorpinel jorgeorpinel changed the title cases: rewrite Shared Dev Server [WIP] cases: rewrite Shared Dev Server Aug 29, 2020
@jorgeorpinel jorgeorpinel force-pushed the use-cases branch 2 times, most recently from 1dd8ac4 to d224c98 Compare August 30, 2020 00:34
@jorgeorpinel
Copy link
Contributor Author

Stale but will retake this ASAP.

@jorgeorpinel jorgeorpinel deleted the use-cases-shrdevsrv branch November 28, 2020 00:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

cases: update Shared Dev Server with an optimization link
2 participants