German-RAG-PHI-4B (Retrieval Augmented Generation)

avemio 's Collections

German-RAG-NEMO-12B (Retrieval Augmented Generation)

German-RAG-LLAMA-3.1-8B (Retrieval Augmented Generation)

German-RAG-MISTRAL-7B-v3.0 (Retrieval Augmented Generation)

German-RAG-EMBEDDING-MODELS

German-RAG-WHISPER-MODELS

German-RAG-BENCHMARKS

German-RAG-DATASETS

German-RAG-PHI-4B (Retrieval Augmented Generation)

updated Feb 7

Here you can find all the final checkpoints & datasets from training Phi-3.5-mini-128k Model from Microsoft on the German-RAG Datasets.

Upvote

avemio/German-RAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI

Question Answering • Updated Feb 7 • 52

Note This model was merged from the SFT- & ORPO Checkpoints. SFT Model with 60% weights & ORPO Model with 40% weights.
avemio/German-RAG-PHI-3.5-MINI-4B-ORPO-HESSIAN-AI

Question Answering • Updated Feb 7 • 27

Note This model was trained on 20.7 Million Tokens in ORPO (Odd-Ratio-Preference Optimization) on synthetically generated or enhanced Data. Please see the German-RAG-ORPO-Dataset (https://huggingface.co/datasets/avemio/German-RAG-ORPO-ShareGPT-HESSIAN-AI) for reference.
avemio/German-RAG-PHI-3.5-MINI-4B-SFT-HESSIAN-AI

Question Answering • Updated Feb 7 • 70

Note This model was trained on 1,5 Billion Tokens in SFT(Supervised Fine-Tuning) on synthetically generated or enhanced Data. Please see the German-RAG-SFT-Dataset (https://huggingface.co/datasets/avemio/German-RAG-SFT-ShareGPT-HESSIAN-AI) for reference.
avemio/German-RAG-PHI-3.5-MINI-4B-CPT-HESSIAN-AI

Question Answering • Updated Feb 7 • 30

Note This model was trained on 507,5 Million Tokens in CPT (Continued Pre-Training) on synthetically generated or enhanced Data. Please see the German-RAG-CPT-Dataset (https://huggingface.co/datasets/avemio/German-RAG-CPT-HESSIAN-AI) for reference.
avemio/German-RAG-ORPO-ShareGPT-HESSIAN-AI

Viewer • Updated Feb 6 • 13.7k • 518 • 2
avemio/German-RAG-SFT-ShareGPT-HESSIAN-AI

Viewer • Updated Feb 6 • 1.01M • 1.28k • 1
avemio/German-RAG-CPT-HESSIAN-AI

Viewer • Updated Feb 6 • 654k • 33
avemio/German-RAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI-Q8_0-GGUF

Question Answering • Updated Feb 7 • 27
avemio/German-RAG-PHI-3.5-MINI-4B-ORPO-HESSIAN-AI-Q8_0-GGUF

Question Answering • Updated Feb 7 • 21
avemio/German-RAG-PHI-3.5-MINI-4B-SFT-HESSIAN-AI-Q8_0-GGUF

Updated Feb 7 • 8

Upvote