refactor: 🔨 Mostly working Ollama migration, few tweaks left

This commit is contained in:
2026-05-16 09:11:21 +01:00
parent 968b98f6a2
commit fc08f1a814
6 changed files with 43 additions and 37 deletions
+12 -12
View File
@@ -1,24 +1,24 @@
# --- Connection Settings ---
api:
base_url: "http://framework.tawny-bellatrix.ts.net:1234"
base_url: "http://100.110.238.94:11434"
api_version: "/v1/"
# --- Model Settings ---
models:
enrich: "lm_studio/qwen-" # will have an identifier, based on amount of active LLMs see ./load_ingestion_llms.sh
embedding: "text-embedding-qwen3-embedding-8b"
retrieval: "lm_studio/qwen/qwen3-30b-a3b-2507"
expansion: "lm_studio/qwen/qwen3-30b-a3b-2507"
enrich: "ollama/granite4.1:3b"
embedding: "qwen3-embedding:4b"
retrieval: "ollama/qwen3.6:latest"
expansion: "ollama/granite4.1:3b"
# --- Ingestion Settings ---
ingestion:
data_dir: "/home/jake/DnD"
db_path: "./data/"
db_name: "dmv.db"
active_llms: 2
parallel_requests_per_llm: 2
chunk_size: 800
chunk_overlap: 100
active_llms: 1
parallel_requests_per_llm: 6
chunk_size: 1200
chunk_overlap: 200
embedding_batch_size: 32
time_file_location: "./data/time_file.txt"
@@ -29,7 +29,7 @@ ingestion_agent:
Analyze the provided notes and extract a concise synopsis and relevant metadata.
synopsis = A one-sentence summary of the document.
tags = Relevant tags (NPCs, Locations, Items, Plot Points).
entities = a list of Key names of people, places, or factions.
entities = a list of names for people, places, or factions.
"note -> synopsis:str, tags: list[str], entities: list[str]"
retrieval_agent:
@@ -41,7 +41,7 @@ retrieval_agent:
expansion_agent:
expansion_signature: |
You are a query expansion expert, specialised in Dungeons and Dragons.
Given a user's question, generate 3-5 similar but enhanced search queries that would help find more relevant information.
You are an expert Dungeon Master's assistant.
Given a user's question, generate 3-5 similar but enhanced search queries that would help find more relevant information in DnD notes.
Each expanded query should be distinct and add different perspective to the original question.
Return only the queries as a JSON list with key "queries"."""