Send live updates outside a git repo

[dberenbaum]

Docs for iterative/dvclive#646. That PR is for DVCLive, but it's really about logging to Studio from platforms where code is not run inside a Git repo.

The docs PR covers:

• Live updates in Studio when working outside a Git repo
• Live updates in SageMaker jobs
• Live updates in Databricks Repos

[github-actions]

Link Check Report

There were no links to check!

[shcheklein]

It would be great to show / mention that is the simplest but a limited approach. Another alternative is to bundle git repo to Sagemaker, bundle results at the end of the job. I know users who are using that approach and it's not terribly complicated. We even have script examples. So we can potentially do a blog or cleanup and share them.

I'm not sure about Databricks though ...

[dberenbaum]

It would be great if we can see an example and we can add it. I hesitate to mention other approaches now if we don't have clear instructions on how to implement them yet.

[shcheklein]

good stuff. I think there are some alternatives at least in case of Sagemaker - people just bundle the repo, also it's not exactly clear what is the e2e workflow. Those experiments will be detached forever in Studio? do we expect them to just stay there? How about data - does this workflow assume no DVC-tracked data / models?

[dberenbaum]

Those experiments will be detached forever in Studio? do we expect them to just stay there? How about data - does this workflow assume no DVC-tracked data / models?

Yup, that's pretty much it. We can add more in the future, but the simplicity is the point here. It shows that you can get a very similar experience to other trackers with about the same amount of effort. Showing additional value by copying files up and down from sagemaker can be a next step.