Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Storage driver for data embedded in Data.toml #15

Merged
merged 2 commits into from
Jun 1, 2021
Merged

Conversation

c42f
Copy link
Contributor

@c42f c42f commented May 30, 2021

  • Blobs are stored as base64 encoded strings
  • Trees are stored as dictionaries

While we're at it, start to clean up storage backend interface.

Also deprecate abspath(::RelPath) depending on pwd(), as the
assumption that this refers to the filesystem, and that depending on the
global pwd() is actually reasonable seem pretty dubious in hindsight.

CC @fonsp — here's a storage driver for base64 data embedded within the Data.toml!

c42f added 2 commits May 30, 2021 16:34
* Blobs are stored as base64 encoded strings
* Trees are stored as dictionaries

While we're at it, start to clean up storage backend interface.

Also deprecate `abspath(::RelPath)` depending on `pwd()`, as the
assumption that this refers to the filesystem, and that depending on the
global `pwd()` is actually reasonable seem pretty dubious in hindsight.
@c42f c42f merged commit 20bd7e5 into master Jun 1, 2021
@delete-merged-branch delete-merged-branch bot deleted the cjf/embedded-data branch June 1, 2021 02:27
@fonsp
Copy link
Contributor

fonsp commented Jun 1, 2021

Very cool! @lungben @pankgeorg

@pankgeorg pankgeorg mentioned this pull request Jun 1, 2021
8 tasks
@fonsp
Copy link
Contributor

fonsp commented Nov 25, 2021

I thought about this too late, but you can think of base64-ecoded data as a special case of a URL! See JuliaLang/Downloads.jl#122

@c42f
Copy link
Contributor Author

c42f commented Nov 26, 2021

Sure, that's true! It's quite cool for tiny amounts of data.

I guess it's a bit impractical for medium-size data such as could be embedded in the Data.toml without problems. Or tree-structured directory-like data which this PR implements.

Do you think there's redundancy with this PR? To me they seem to be separate use cases with a little bit of overlap.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants