Poppy_Porpoise-0.85-L3-8B-GGUF

This is quantized version of Nitral-AI/Poppy_Porpoise-0.85-L3-8B created using llama.cpp

Model Description

"Poppy Porpoise" is a cutting-edge AI roleplay assistant based on the Llama 3 8B model, specializing in crafting unforgettable narrative experiences. With its advanced language capabilities, Poppy expertly immerses users in an interactive and engaging adventure, tailoring each adventure to their individual preferences.

Recomended ST Presets:(Updated for 0.85) Porpoise Presets

If you want to use vision functionality:

  • You must use the latest versions of Koboldcpp.

To use the multimodal capabilities of this model and use vision you need to load the specified mmproj file, this can be found inside this model repo. Llava MMProj

  • You can load the mmproj by using the corresponding section in the interface:

image/png

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 69.24
AI2 Reasoning Challenge (25-Shot) 63.40
HellaSwag (10-Shot) 82.89
MMLU (5-Shot) 68.04
TruthfulQA (0-shot) 54.12
Winogrande (5-shot) 77.90
GSM8k (5-shot) 69.07
Downloads last month
104
GGUF
Model size
8.03B params
Architecture
llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.

Model tree for QuantFactory/Poppy_Porpoise-0.85-L3-8B-GGUF

Quantized
(3)
this model

Evaluation results