artin/llama2.c
1
0
Fork 0
mirror of https://github.com/trholding/llama2.c.git synced 2026-02-06 11:26:53 +00:00
Code Issues Packages Projects Releases Wiki Activity
658 Commits 2 Branches 3 Tags 8.1 MiB
master
Commit Graph

41 Commits

Author SHA1 Message Date
Vulcan
036d7cb9f2 runq - remove blas & optimize 
runq - optimize matmul and quantization functions with OpenMP
 2024-07-20 17:44:29 +05:30
Vulcan
15549bf818 Update Makefile 
Fix OPENMP for certain builds
 2024-07-13 23:27:20 +05:30
Vulcan
63e69a3ad5 Llama3 Model Export Howto 
README.md

- Added instructions for exporting and inferring llama3 model.
- Added instructions to build with ArmPL

Makefile

- Small update to info texts
 2024-07-10 21:58:40 +05:30
Vulcan
4d6452ed5b Makefile: LLVM BOLT Support 
- Makefile: Add LLVM BOLT build

Usage:

make BOLTPREP=1 <target> ;  make run_bolt

- run.c / runq.c : Enable exit command in prompt in embedded model builds

- README.md: Update usage
 2024-04-05 21:37:48 +05:30
Vulcan
c243fb4122 Update README.md 
- updated usage
 2024-04-01 22:18:39 +05:30
Vulcan
1544529a3f Makefile: C -> LLVM Bitcode -> Transpiled C Debug Build 
Makefile: C to LLVM bitcode and LLVM bitcode to transpiled C debug build.

Requires clang-17, and llvm-cbe to be compiled and added to path.

Get llvm-cbe (LLVM C Backend) here: https://github.com/JuliaHubOSS/llvm-cbe

README.md: Updated usage
 2024-04-01 22:10:08 +05:30
Vulcan
5d2fa995d7 MKL build fix + Matmul debug log build 
- run.c: added temp matmul debug for action replay
- Makefile: fixed MKL build, added matmul debug log build
 2024-04-01 21:07:02 +05:30
Vulcan
bf290a49c5 AVX Support 
- run.c : AVX support based on https://github.com/karpathy/llama2.c/blob/feature/avx2/run.c but loop unrolled and other improvements

- Makefile: Applied -march=native -mtune=native to most builds
 2024-04-01 16:54:07 +05:30
Vulcan
ef370104a0 Makefile: Support runq builds 
Usage: make
- Prints all options and the added runq build options.
 2024-03-20 18:42:12 +05:30
Vulcan
6005189b9b Refined Makefile 2023-10-09 23:15:24 +05:30
Razvan Deaconescu
9d516005f3 Makefile: Simplify Makefile.unikernel 
Move file generation rules (.config, model.h, tokenizer.h) out of
`Makefile.unikernel` and into `Makefile`. This simplifies
`Makefile.unikernel` making it Unikraft-specific. And making it easy to
reuse as part of `make -f Makefile.unikraft ...` rules.

Signed-off-by: Razvan Deaconescu <razvand@unikraft.io>
 2023-10-08 17:57:24 +03:00
Vulcan
ae8ea66eda L2E OS v0.1 "Temple DOS" Release + Various Improvements 
L2E OS v0.1 "Temple DOS" Release.
Various Improvements.
Major Makefile overhaul.
 2023-10-02 19:03:18 +05:30
Vulcan
c3210fa0ed win64 & unikernel build fixes 2023-08-28 13:31:54 +05:30
Vulcan
57a807130a Makefile target for termux 
Added make run_incbin target for termux on Android

Usage:

In termux do:

pkg upgrade
pkg install git
pkg install make
pkg install clang
pkg install wget
git clone https://github.com/trholding/llama2.c
cd llama2.c
make run_incbin
./run

Ref: https://github.com/trholding/llama2.c/issues/7
 2023-08-27 02:00:06 +05:30
Vulcan
551b166ba2 Makefile updates 
Added changes from upstream
Added list target to get a list of targets

Usage:
make list
 2023-08-27 01:27:41 +05:30
Vulcan
d311a72304 Makefile fix for missing target 
Added the missing run_cosmocc target
 2023-08-26 23:27:58 +05:30
Vulcan
b508909609 Unikernel fixes 
Makefile and run.c fixes.
 2023-08-26 03:24:04 +05:30
Vulcan
f2fee04b35 unikernel support (WIP) 
Usage:

make run_unik_qemu_x86_64

Run with:

qemu-system-x86_64 -m 256m -accel kvm -kernel build/L2E_qemu-x86_64
 2023-08-26 01:38:15 +05:30
Vulcan
d588cc1289 Various small improvements 
See README.md
 2023-08-23 19:26:40 +05:30
Vulcan
e0c13d9307 Added loop to prompt, INCBIN & strliteral embedding 
New ways to embed models via INCBIN and strliteral

Enabled loop back to prompt  on some targets.

Available via make:
runompincbin
runompstrlit

Cosmopolitan toolchain make targets:
runcincbin
runcstrlit

Loop back to prompt on cosmopolitan make targets are WIP and do not work as expected.

Documentation: TODO
 2023-08-22 11:51:38 +05:30
Vulcan
548bf5df95 Rebase (WIP) 
Do not clone
 2023-08-21 23:53:31 +05:30
Vulcan
2e62eacfbc Baremetal/Portable Embedding (WIP) 
Embedding model, tokenizer & assets for baremetal and portable builds (WIP)
 2023-08-21 15:18:33 +05:30
Vulcan
f7a7ed94c8 Merge remote-tracking branch 'upstream/master' 2023-08-20 17:19:07 +05:30
Andrej Karpathy
88eb238255 add tests into Makefile convenience 2023-08-15 15:57:27 +00:00
Vulcan
33fb82455c Added Apple Accelerate Support (WIP) 
Added Apple Accelerate Support for BLAS

Not yet tested.

Build with:

```bash
make runaccel
```
 2023-08-06 13:22:20 +05:30
Vulcan
3121275cc1
Merge branch 'karpathy:master' into master 2023-08-06 09:29:26 +05:30
Andrej Karpathy
49e3ff6d08 update makefile to use correct arg call after our argparse update 2023-08-05 23:11:11 +00:00
Vulcan
9c31c8487e Intel MKL and ARM PL Support (WIP) 
Support:

- Intel MKL (WIP)
- ARM PL Support (WIP)
 2023-08-05 17:28:45 +05:30
Vulcan
eb94db6f45 Added OpenACC support, other fixes and tweaks 
run.c - Added OpenACC support

Makefile - Added OpenACC build, OpenMP build tweaks

README.md - Documented changes
 2023-08-05 09:34:58 +05:30
Vulcan
324edf89f6 Added BLIS support, fixes, updated documentation 
- Added Support for BLIS
- Fixed CBLAS Support
- Updated Documentation
 2023-08-04 20:10:00 +05:30
Vulcan
27a66e1d1c Update Makefile 2023-08-02 09:15:19 +05:30
Vulcan
d0ecdab6c1 Merge remote-tracking branch 'upstream/master' 2023-08-01 23:25:16 +05:30
Vulcan
36413d903b Added OPENBLAS, CLBLAST GPU and APE prompt support 
Added BLAS support:

+ Openblas
+ CLBlast (GPU)

CLBlast is considerable slower. Needs investigation.

Added APE binary prompt support

Usage:

Ape run:
$   run.com

Baremetal Boot:
$  qemu-system-x86_64 -serial stdio -hda run.com
(input is broken on baremetal)

Updated Makefile

Usage:
make runopenblas
make runclblast
 2023-07-31 23:05:14 +05:30
Vulcan
a70719d127 Update Makefile for cosmocc build 2023-07-30 19:11:01 +05:30
Murilo Curti
72ba34c392
fix: Use correct compiler for Win64 GCC in Makefile 2023-07-27 21:39:09 -03:00
Andrej Karpathy
25b50ee0e2 small stylistic fixes and adjustments, fix bug in Makefile, and change the timing code to skip the first (slow) iteration 2023-07-27 22:42:08 +00:00
Aydyn Tairov
bddde3398a add Makefile option to support builds on amazon linux & centos 2023-07-27 14:59:28 +01:00
richinseattle
b18d325660 add windows build commands 2023-07-26 22:58:48 -07:00
Andrej Karpathy
2711ae8c32 make compiler tunable in Makefile, i think potentially nice and useful 2023-07-26 16:40:40 +00:00
Andrej Karpathy
496466f78f add rundebug to makefile, useful for spotting issues and such 2023-07-24 23:13:59 +00:00
Andrej Karpathy
16edfe6364 add a simple makefile 2023-07-24 21:50:04 +00:00