Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

kitfile overview #70

Merged
merged 3 commits into from Mar 7, 2024
Merged

kitfile overview #70

merged 3 commits into from Mar 7, 2024

Conversation

gorkem
Copy link
Contributor

@gorkem gorkem commented Mar 7, 2024

Rearranges the modelkit spec. Updates and removes a few unused files

also rearranges the modelkit spec. Updates and removes
a few unused files
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

awesome! TIL that you dont even need an <img src="..." /> tag, #nice

]
}
```
<!--@include: ../../../../pkg/artifact/spec.md-->
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

FWIW Vitepress imports also supports importing just a range of lines, like:

<!--@include: ../../../../pkg/artifact/spec.md{2, 10}-->

that would only import from line 2 to line 10. Not sure how helpful that is but is good to know.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Out of curiosity, is there a reason why this (and the other pkg md's) lives outside the docs folder? is this reused in the github repo like some sort of "readme" or something?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is just close to where those spec are implemented. Makes it convenient for anyone who needs to modify or understand those implementations

pkg/artifact/spec.md Outdated Show resolved Hide resolved
Comment on lines +11 to +14
The artifacts and their media types are
* Serialized Model: `application/vnd.kitops.modelkit.model.v1.tar+gzip`
* Datasets: `application/vnd.kitops.modelkit.dataset.v1.tar+gzip`
* Code: `application/vnd.kitops.modelkit.code.v1.tar+gzip`
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We're somewhat overloading the term artifact here. The overall ModelKit is an OCI artifact, and the model, datasets, and code are stored as layers within that artifact (since we're reusing the OCI image manifest spec). Referring to the layers as artifacts as well is a little confusing -- is there another word that works (or is "layers" sufficient)?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Layers are confusing too becuase they suggest model kit is built incrementally with layers. I agree that artifact is overused on this context but I could not find a better word to describe

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We could refer to them as packages which would fit with pack and unpack commands. Although that might get confusing since code libraries are often referred to as packages, maybe especially in Python... Could we call them "parcels" - that's also something you can pack/unpack...

* Datasets: `application/vnd.kitops.modelkit.dataset.v1.tar+gzip`
* Code: `application/vnd.kitops.modelkit.code.v1.tar+gzip`

**ModelKit File (Kitfile)** Acts as a record detailing the properties, relationships, and intended uses of the included artifacts. The Kitfile is central to understanding the structure and purpose of a ModelKit. It adopts the `application/vnd.kitops.modelkit.config.v1+json` media type for easy access and interpretation by tools.See the seperate kitfile specification on details
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
**ModelKit File (Kitfile)** Acts as a record detailing the properties, relationships, and intended uses of the included artifacts. The Kitfile is central to understanding the structure and purpose of a ModelKit. It adopts the `application/vnd.kitops.modelkit.config.v1+json` media type for easy access and interpretation by tools.See the seperate kitfile specification on details
**ModelKit File (Kitfile)** Acts as a record detailing the properties, relationships, and intended uses of the included artifacts. The Kitfile is central to understanding the structure and purpose of a ModelKit. It adopts the `application/vnd.kitops.modelkit.config.v1+json` media type for easy access and interpretation by tools. See the seperate kitfile specification on details

Also, should we merge the kitfile specification and spec.md into one document? There's a fair bit of overlap.

pkg/artifact/spec.md Outdated Show resolved Hide resolved
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This document makes no reference to the OCI spec -- do we want to include mention there? Otherwise, it might be confusing to see schemaVersion: 2 in the manifest JSON file.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, we should refer to the OCI spec for this section.

gorkem and others added 2 commits March 7, 2024 10:55
Co-authored-by: Angel Misevski <amisevsk@gmail.com>
Co-authored-by: Angel Misevski <amisevsk@gmail.com>
Copy link
Contributor

@bmicklea bmicklea left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm approving this although I would like us to try and find a better word for the parts of the ModelKit than artifact. I've made a couple of suggestions in a comment. However, I don't see the overloaded use of artifact as a blocker for merging so if we can't decide on something quickly let's go ahead and merge if everything else is good.

Comment on lines +11 to +14
The artifacts and their media types are
* Serialized Model: `application/vnd.kitops.modelkit.model.v1.tar+gzip`
* Datasets: `application/vnd.kitops.modelkit.dataset.v1.tar+gzip`
* Code: `application/vnd.kitops.modelkit.code.v1.tar+gzip`
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We could refer to them as packages which would fit with pack and unpack commands. Although that might get confusing since code libraries are often referred to as packages, maybe especially in Python... Could we call them "parcels" - that's also something you can pack/unpack...

@gorkem gorkem merged commit 0181d96 into main Mar 7, 2024
1 check passed
@gorkem gorkem deleted the doc-kitfile-ov branch March 7, 2024 16:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants