Differences

This shows you the differences between two versions of the page.

--- backends [2026/03/17 16:40] – tys
+++ backends [2026/03/17 16:44] (current) – tys
@@ Line 11: / Line 11: @@
 Additionally, each of these require a separate [[models|model]] to operate.
-=== Inference Engines ===
+==== Inference Engines ====
 Each of the following perform inference without needing additional software. User friendliness is not the first priority with these utilities.
@@ Line 22: / Line 22: @@
 | [[https://github.com/ikawrakow/ik_llama.cpp|ik_llama]] | Improved CPU performance. |
-=== Engine Manangers ===
+==== Engine Manangers ====
 These tools are designed to provide a user-friendly layer which handles backend needs and engine management simultaneously. If you're not sure what to pick, this is a good place to start.
@@ Line 33: / Line 33: @@
 | [[https://ollama.com/|ollama]] | Wraps llama.cpp. |
 | [[https://github.com/theroyallab/tabbyAPI|tabbyAPI]] | Official API server for ExLlama engines. |
-**Note**: This list does not include backends that can directly accept Character Cards - those are considered [[interfaces]].
 ===== 3rd-Party API providers =====
@@ Line 49: / Line 46: @@
 Additionally, most commercial APIs can be utilized such as ChatGPT, Claude, Perplexity, etc.
+===== Additional Resources =====
+SillyTavern's page on [[https://docs.sillytavern.app/usage/api-connections/|API Connections]].