Skip to content

rahuldshetty/starcoder.js

Repository files navigation

💫StarCoder.js *Experimental*

npm version

THIS IS UNDER DEVELOPMENT AND IS NOT PRODUCTION READY. BROWSER REQUIRES MEM64 SUPPORT TO RUN THIS PROJECT

This project brings starcoder.cpp to browser with power of WebAssembly.

Demo

Web Application : starcoder.js

App

Fibonacci Example

Performance

Prime Example

Following performance speed is captured on Firefox Nightly with following system configuration:

  • CPU: Intel(R) Core(TM) i7-8750H CPU @ 2.20GHz
  • Memory: 24GB

Generation Performance

Build Instructions

git clone https://github.com/bigcode-project/starcoder.cpp
cd starcoder.cpp

Run the notebook in examples/ to convert starcoder model to GGML format.

# Builds JS/WASM dependency in build/ location
build.sh

# Generate Distributable JS
npm run build

# To publish to NPM
npm publish

About

Web browser version of StarCoder.cpp

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published