Differences

This shows you the differences between two versions of the page.

--- backends [2026/03/17 16:43] – tys
+++ backends [2026/03/17 16:44] (current) – tys
@@ Line 1: / Line 1: @@
 ====== Backends ======
-By itself, an [[models|LLM]] is just a block of data. The software required to perform inference with that data is typically called a "Backend". Please note - if a "Backend" can process Character Cards directly, it is considered an [[interfaces|interface]].
+By itself, an [[models|LLM]] is just a block of data. The software required to perform inference with that data is typically called a "Backend".
 Sometimes the [[interfaces|interface]] includes a backend (e.g. [[interfaces:LocalTavern]]), other times it is a strict "Frontend" that requires a separate "Backend" to perform inference (e.g. [[interfaces:SillyTavern]]).
@@ Line 11: / Line 11: @@
 Additionally, each of these require a separate [[models|model]] to operate.
-=== Inference Engines ===
+==== Inference Engines ====
 Each of the following perform inference without needing additional software. User friendliness is not the first priority with these utilities.
@@ Line 22: / Line 22: @@
 | [[https://github.com/ikawrakow/ik_llama.cpp|ik_llama]] | Improved CPU performance. |
-=== Engine Manangers ===
+==== Engine Manangers ====
 These tools are designed to provide a user-friendly layer which handles backend needs and engine management simultaneously. If you're not sure what to pick, this is a good place to start.