llamafile test with OmniFusion - вопросы llama на русском
Рет қаралды 54
2 ай бұрынoriginal - github.com/Mozilla-Ocho/llama...
models from - habr.com/ru/companies/airi/ar...
to start server:
llamafile.exe -ngl 9999 -m OmniFusion-1.1-Q5_K_M.gguf --mmproj mmproj-model-f16.gguf
or only cli:
llamafile.exe -ngl 9999 --temp 0 --image test.png -m OmniFusion-1.1-Q5_K_M.gguf --mmproj mmproj-model-f16.gguf -e -p "### User: What do you see?
### Assistant: "
llamafile.exe -ngl 9999 -m OmniFusion-1.1-Q5_K_M.gguf -p "[INST]Write a story about llamas[/INST]"
@user-ne8ot6un8q 5 сағат бұрын
Can I start server from any llamafile? If I will start like ./llava-v1.5-7b-q4.llamafile -ngl 9999 -m OmniFusion-1.1-Q5_K_M.gguf --mmproj mmproj-model-f16.gguf is it suppose work correct?
@user-os1xg1rh4c 3 сағат бұрын
they say so. try.
Life is Short
Рет қаралды 9 МЛН
Scary Teacher 3D Gaming
Рет қаралды 33 МЛН
Immersed
Рет қаралды 95 МЛН
【令人震驚】剛剛：馬斯克發表爆炸性的演示【獨家中英文字幕完整版】｜Shocking: Musk's Bombshell Presentation Leaving Audience Speechless
New SciTech 新科技
Рет қаралды 173 М.
AI Uncovered
Рет қаралды 14 М.
ZProger [ IT ]
Рет қаралды 204 М.