feat: Accept Uint8Array as file code alongside string

[izznatsir]

What kind of change does this pull request introduce?

Feature implementation for #769 .

What is the current behavior?

#769

Sandpack only acceptsfile code in string format even though nodebox accept both string and Uin8Array.

What is the new behavior?

Sandpack accepts both string and Uin8Array as file code.

What steps did you take to test this? This is required before we can merge, make sure to test the flow you've updated.

Not yet tested.

Checklist

• Documentation;
• Storybook (if applicable);
• Tests;
• Ready to be merged;

[vercel]

@izznatsir is attempting to deploy a commit to the CodeSandbox Team on Vercel.

A member of the Team first needs to authorize it.

[codesandbox-ci]

This pull request is automatically built and testable in CodeSandbox.

To see build info of the built libraries, click here or the icon next to each commit SHA.

Latest deployment of this branch, based on commit 9f70efc:

Sandbox	Source
Sandpack	Configuration
sandpack 2 example not updating with customSetup and files in the provider	Configuration

[izznatsir]

There is also readBuffer function in node runtime utils that do the same thing but using Buffer.from(Uint8Array).toString('utf-8') instead of TextDecoder. Should I remove this and update readBuffer implementation to use TextDecoder so it can be used outside nodebox?

[izznatsir]

SandpackFile and SandpackBundlerFile has no information about what encoding is suitable to encode or decode the code. So, all are treated as utf-8. Not all files are encodable into utf-8, but TextDecoder does not understand binary string encoding that is available in Node environment. So, maybe we should add another field in SandpackFile and SanpackBundlerFile called encoding that accepts either binary or utf-8, default to utf-8.

The encoding field can be used to determine whether a file is viewable, so useActiveCode util will return undefined if the encoding is binary and code viewer can display a message that the file is not viewable. This is not implemented yet, what do you think?

Or, we can create a list of file extensions that are encodable into utf-8 and check that in useActiveCode function.

[DeMoorJasper]

Not sure if encoding is really neccessary here, the only runtime that can handle binary data right now is nodebox and there we just write the binary data to the filesystem directly, the only time we need encoding is for reading the pkg.json in sandpack. We can also use something like this if we wanna detect binary for image previews or something: https://github.com/alessioalex/is-binary