Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+lorafrica_lora_adapter.gguf filter=lfs diff=lfs merge=lfs -text
+phi4_mini_instruct_q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,168 @@
+---
+library_name: llama.cpp
+tags:
+- gguf
+- quantization
+- lora
+- african-history
+- phi-4
+license: mit
+datasets:
+- DannyAI/African-History-QA-Dataset
+base_model:
+- microsoft/Phi-4-mini-instruct
+pipeline_tag: text-generation
+---
+
+# Model Card for Model ID
+### Phi-4 Mini African History (GGUF)
+
+This repository contains GGUF versions of the **Phi-4-mini-instruct** base model and the **LoRAfrica** adapter, specialized for African History QA.
+
+- **Base Model:** `phi4_mini_instruct_q4_k_m.gguf`
+- **LoRA Adapter:** `lorafrica_lora_adapter.gguf`
+- **Training Data:** DannyAI/African-History-QA-Dataset
+
+## Model Details
+
+### Model Description
+
+This model is a quantized GGUF version of a LoRA fine-tuning based on Microsoft's Phi-4-mini. It is specifically optimized for efficiency and accuracy when answering questions regarding African history, ranging from ancient empires to contemporary social movements.
+
+- **Developed by:** Daniel Ihenacho
+- **Funded by:** Daniel Ihenacho
+- **Shared by:** Daniel Ihenacho
+- **Model type:** Text Generation (GGUF)
+- **Language(s) (NLP):** English
+- **License:** MIT
+- **Finetune Method:** Axolotl (LoRA)
+
+## Uses
+
+This model is designed for low-latency inference on consumer hardware using `llama.cpp` or other GGUF-compatible backends (Ollama, LM Studio, etc.).
+
+### Primary Use Case
+- QA datasets and educational tools focused on African History.
+
+### Out-of-Scope Use
+- General-purpose coding or mathematical reasoning (performance may be degraded compared to the base Phi-4).
+- Production environments requiring high-stakes factual guarantees without human oversight.
+
+## How to Get Started with the Model
+
+Since this repository contains a separate GGUF base and a GGUF LoRA adapter, you can use them together in `llama.cpp` without needing to merge them permanently.
+
+### Downloading the models
+```bash
+hf download DannyAI/LoRAfrica_GGUF  --local-dir ./gguf_model 
+```
+
+### Using llama-cli
+**NB:** This is for CMD on Windows
+```bash
+.\build\bin\Release\llama-cli -m phi4_mini_instruct_q4_k_m.gguf ^
+ --lora lorafrica_lora_adapter.gguf ^
+ -p "<|system|>You are a helpful AI assistant specialised in African history.<|end|><|user|>Briefly detail the significance story of the Igbo god Amadioha?<|end|><|assistant|>" ^
+ -n 128
+```
+
+### Using llama-cli-server (Preferably)
+**NB:** This is for CMD on Windows
+```bash
+.\build\bin\Release\llama-server -m phi4_mini_instruct_q4_k_m.gguf ^
+ --lora lorafrica_lora_adapter.gguf --host 0.0.0.0 --port 8080
+ ```
+*You could also navigate into the url, by pasting it on your browser http://localhost:8080/v1/chat/completions*
+- It springs up the chat interface for you to use instead of using CMD to send request after starting the server
+The server runs on your local machine
+ ```
+ # Send a Request
+curl http://localhost:8080/v1/chat/completions -H "Content-Type: application/json" -d "{\"messages\": [{\"role\": \"system\", \"content\": \"You are a helpful AI assistant specialised in African history.\"}, {\"role\": \"user\", \"content\": \"Briefly detail the significance story of the Igbo god Amadioha?\"}], \"max_tokens\": 128, \"temperature\": 0.1}"
+```
+**NB:** - [GitHub has more details in the use of cmd, coming soon!] <!--(https://github.com/daniau23/)-->
+### Python Implementation (via llama-cpp-python)
+```python
+from llama_cpp import Llama
+import os
+# Get the number of physical cores on your machine
+cores = os.cpu_count()
+
+# For example, if you have 8 cores, 4 or 6 is usually the sweet spot.
+cores_to_use = cores // 2 
+print(f"Cores on this machine: {cores}")
+print(f"Cores to use: {cores_to_use}")
+
+# Load the base model
+llm = Llama(
+    model_path="./phi4_mini_instruct_q4_k_m.gguf",
+    lora_path="./lorafrica_lora_adapter.gguf", # comment out if you do not want LoRA Adapters
+    n_ctx=2000,
+    n_threads=cores,   # Increase this for faster generation!
+    n_batch=512,       # Helps the CPU process the initial prompt faster
+    n_gpu_layers=0,     # Explicitly disables GPU offloading
+    use_mmap=True,     # ADD THIS: Critically important for low-RAM systems
+    use_mlock=False    # Ensure this is False so it doesn't force-lock RAM
+)
+
+output = llm.create_chat_completion(
+    messages =[
+        {
+            "role": "system", "content":"You are a helpful AI assistant specialised in African history which gives concise answers to questions asked."
+        },
+        {
+            "role": "user", "content":"Briefly detail the significance story of the Igbo god Amadioha?"
+        }
+    ],
+    max_tokens=128,
+    temperature=0.1
+)
+
+print(output["choices"][0]["message"]["content"])
+```
+```
+# Example Output
+Amadioha is a significant deity in Igbo mythology, representing justice and the thunder god. He is believed to reside in the heavens and is often invoked to settle disputes and mete out punishment for wrongdoing. Amadioha's thunderbolts are said to strike down those who commit injustices, symbolizing divine retribution. His presence underscores the importance of justice and moral order in Igbo culture.
+```
+
+``` 
+# for streaming tokens generated
+
+output_stream = llm.create_chat_completion(
+    messages =[
+        {
+            "role": "system", "content":"You are a helpful AI assistant specialised in African history which gives concise answers to questions asked."
+        },
+        {
+            "role": "user", "content":"Briefly detail the significance story of the Ogun Yoruba god?"
+        }
+    ],
+    max_tokens=128,
+    temperature=0.1,
+    stream=True
+)
+
+
+for chunk in output_stream:
+    delta = chunk["choices"][0]["delta"]
+    if "content" in delta:
+        print(delta["content"], end="", flush=True)
+```
+
+
+## Citation
+@Model{
+Ihenacho2026phi4_african_history_lora_gguf,
+  author    = {Daniel Ihenacho},
+  title     = {Phi-4 African History LoRA GGUF},
+  year      = {2026},
+  publisher = {Hugging Face Models},
+  url       = {[https://huggingface.co/DannyAI/phi4_african_history_lora_ds2_axolotl_gguf](https://huggingface.co/DannyAI/phi4_african_history_lora_ds2_axolotl_gguf)},
+}
+
+## Model Card Authors
+Daniel Ihenacho
+
+## Model Card Contact
+
+- [LinkedIn](https://www.linkedin.com/in/daniel-ihenacho-637467223)
+- [GitHub](https://github.com/daniau23)

lorafrica_lora_adapter.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f4a493a07cc6f47e1ad3cf46d8c51972814d24aec3112812ae25930f60943a99
+size 6297056

phi4_mini_instruct_q4_k_m.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6ec1dc61cdda56cd97a4cc22f3aee71569fa60c989368616be92e8ad223fa6ab
+size 2493840704