bitznet · GitHub Topics · GitHub GitHub is where people build software More than 150 million people use GitHub to discover, fork, and contribute to over 420 million projects
microsoft BitNet: Official inference framework for 1-bit LLMs - GitHub usage: run_inference py [-h] [-m MODEL] [-n N_PREDICT] -p PROMPT [-t THREADS] [-c CTX_SIZE] [-temp TEMPERATURE] [-cnv] Run inference optional arguments: -h, --help show this help message and exit -m MODEL, --model MODEL Path to model file -n N_PREDICT, --n-predict N_PREDICT Number of tokens to predict when generating text -p PROMPT, --prompt PROMPT Prompt to generate text from -t THREADS