Skip to content

Releases: trholding/llama2.c

L2E OS v0.1 "Temple DOS"

02 Oct 14:07
@trholding trholding
L2E_OS_v0.1_Temple_DOS
95bbc0e
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
L2E OS v0.1 "Temple DOS" Latest
Latest

This is the ISO release of L2E OS v0.1 "Temple DOS"

Use an app like etcher or cli tool like dd to raw copy image to a pen drive to boot on a computer.

You can also boot this in qemu using the following command as example:

qemu-system-x86_64 -display gtk,zoom-to-fit=off -m 512 -accel kvm -vga virtio -cdrom l2eos.iso
Assets 3

L2E 0.1 Build

26 Aug 05:22
@trholding trholding
L2E_v0.1
d3b97f4
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
L2E 0.1 Build

This release contains the following:

  • Portable cosmocc build
  • Unikernel build

The smallest model is embedded in them.

See https://github.com/trholding/llama2.c on how to run.

Assets 3

Experimental Standalone and Llama 2 64bit Portable Binary

27 Jul 05:25
@trholding trholding
experimental
7b31221
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
Experimental Standalone and Llama 2 64bit Portable Binary Pre-release
Pre-release

This is a experimental release compiled with the following features:

  • Aarch64 support (slow, emulated with blink, ARM64 Mac, 64bit Raspi, ARM 64 bit machines)
  • Baremetal Support (boot but not fully functiona, can't open model)
  • Standalone (Embedded model)

Due to standalone/baremetal support, this build will ignore cli arguments.

Just copy and run run.com in a cli on any 64 Bit OS

*BSD/Linux Example:

$ ./run.com

Windows Example:

C:> run.com

Initial bootup is slower as model will be uncompressed first.

x86_64 performance is a bit higher with cosmocc non openmp builds.

Test *baremetal boot like this:

qemu-system-x86_64 -serial stdio -hda run.com

*baremetal boots but not yet fully functional as model file can't be opened without a fix in toolchain.

Built with:

cosmocc -Ofast -funsafe-math-optimizations -ffast-math  \ 
-D COSMO_BLINK -D COSMO_METAL -D COSMO_ZIP -o run.com run.c -lm

Includes the following model:

https://huggingface.co/karpathy/tinyllamas/resolve/main/stories15M.bin

Assets 3