llama-cppv0.4.1
- Updated
LLM inference in C/C++
- Project website: https://github.com/ggml-org/llama.cpp
#Supported Platforms
All platforms supported.
#Features
No default features.
#download
Support downloading a model from an URL
Dependencies:
cpp-httplib
Features:
openssl
and one transitive dependency:
- openssl (through cpp-httplib)
Host Dependencies:
3 transitive dependencies:
- vcpkg-cmake (through cpp-httplib)
- vcpkg-cmake-config (through cpp-httplib)
- vcpkg-cmake-get-vars (through openssl)
#server
Build llama-server and llama-cli
#Used By
- hanjingo-high-jump (feature
llama) - llama-cpp (feature
server)
#Host Tool For
No ports use this.
#Contributors
Stefano Sinigardi
Kai Pastor
talregev
Ankur Verma
miyan