Update README.md
Browse files
README.md
CHANGED
@@ -1,10 +1,95 @@
|
|
1 |
---
|
2 |
-
title:
|
3 |
-
emoji:
|
4 |
-
colorFrom:
|
5 |
-
colorTo:
|
6 |
sdk: static
|
7 |
pinned: false
|
8 |
---
|
9 |
|
10 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
+
title: ArtyLLaMA
|
3 |
+
emoji: 🦙🎨
|
4 |
+
colorFrom: indigo
|
5 |
+
colorTo: pink
|
6 |
sdk: static
|
7 |
pinned: false
|
8 |
---
|
9 |
|
10 |
+
# ArtyLLaMA: Empowering Creativity with Open Source AI 🦙🎨
|
11 |
+
|
12 |
+
ArtyLLaMA is an innovative chat interface for Open Source Large Language Models, leveraging the power of LLaMA.cpp. It features dynamic content generation and display through an "Artifacts-like" system, making AI-assisted creativity more accessible and interactive.
|
13 |
+
|
14 |
+
## Model Description
|
15 |
+
|
16 |
+
ArtyLLaMA is not a model itself, but a framework that allows users to interact with various LLaMA-based models. It provides a user-friendly interface for generating creative content, code, and visualizations using state-of-the-art language models.
|
17 |
+
|
18 |
+
### Key Features:
|
19 |
+
|
20 |
+
- 🧠 **LLaMA Integration**: Seamless support for LLaMa.cpp via the llama-cpp-python package
|
21 |
+
- 🎨 **Dynamic Artifact Generation**: Create and display content artifacts during chat interactions
|
22 |
+
- 🖥️ **Real-time HTML Preview**: Instantly visualize HTML artifacts
|
23 |
+
- 🔄 **Multi-Model Support**: Choose from multiple language models in the `/models` folder
|
24 |
+
- 📱 **Responsive Design**: Mobile-friendly interface built with Tailwind CSS
|
25 |
+
- 🌙 **Dark Mode**: Easy on the eyes with a default dark theme
|
26 |
+
- 🚀 **Local Inference**: Run models locally for privacy and customization
|
27 |
+
|
28 |
+
## Intended Use
|
29 |
+
|
30 |
+
ArtyLLaMA is designed for developers, researchers, and creative professionals who want to:
|
31 |
+
|
32 |
+
- Explore the capabilities of open-source language models
|
33 |
+
- Generate creative content, including code, designs, and written text
|
34 |
+
- Prototype AI-assisted applications and workflows
|
35 |
+
- Learn about and experiment with local AI inference
|
36 |
+
|
37 |
+
## Limitations
|
38 |
+
|
39 |
+
- Requires local installation and setup
|
40 |
+
- Performance depends on the user's hardware capabilities
|
41 |
+
- Limited to models compatible with LLaMA.cpp
|
42 |
+
- Does not include built-in content moderation (users should implement their own safeguards)
|
43 |
+
|
44 |
+
## Ethical Considerations
|
45 |
+
|
46 |
+
Users of ArtyLLaMA should be aware of:
|
47 |
+
|
48 |
+
- Potential biases present in the underlying language models
|
49 |
+
- The need for responsible use and content generation
|
50 |
+
- Privacy implications of using AI-generated content
|
51 |
+
|
52 |
+
## Technical Specifications
|
53 |
+
|
54 |
+
- **Framework**: Python with Flask backend, HTML/CSS/JavaScript frontend
|
55 |
+
- **Required Libraries**: llama-cpp-python, Flask, Tailwind CSS, Alpine.js
|
56 |
+
- **Supported Model Formats**: GGUF (compatible with LLaMA.cpp)
|
57 |
+
- **Hardware Requirements**: Varies based on the chosen model size (optimized for systems with GPU acceleration)
|
58 |
+
|
59 |
+
## Getting Started
|
60 |
+
|
61 |
+
1. Clone the repository: `git clone https://github.com/kroonen/ArtyLLaMA`
|
62 |
+
2. Set up a Python environment: `conda create -n ArtyLLaMa python=3.11 && conda activate ArtyLLaMa`
|
63 |
+
3. Install dependencies: `pip install -r requirements.txt`
|
64 |
+
4. Place LLaMA models in the `/models` directory
|
65 |
+
5. Configure `app.py` for your hardware
|
66 |
+
6. Run the application: `python app.py`
|
67 |
+
7. Access the interface at `http://localhost:5000`
|
68 |
+
|
69 |
+
For more detailed instructions and documentation, visit our [GitHub repository](https://github.com/kroonen/ArtyLLaMA).
|
70 |
+
|
71 |
+
## License
|
72 |
+
|
73 |
+
ArtyLLaMA is distributed under the MIT License. See the [LICENSE](https://github.com/kroonen/ArtyLLaMA/blob/main/LICENSE) file for more information.
|
74 |
+
|
75 |
+
## Citation
|
76 |
+
|
77 |
+
If you use ArtyLLaMA in your research or projects, please cite it as follows:
|
78 |
+
|
79 |
+
```bibtex
|
80 |
+
@software{artyllama2024,
|
81 |
+
author = {Robin Kroonen},
|
82 |
+
title = {ArtyLLaMA: Empowering Creativity with Open Source AI},
|
83 |
+
year = {2024},
|
84 |
+
url = {https://github.com/kroonen/ArtyLLaMA}
|
85 |
+
}
|
86 |
+
```
|
87 |
+
|
88 |
+
## Contact
|
89 |
+
|
90 |
+
For questions, feedback, or collaborations, please reach out to:
|
91 |
+
|
92 |
+
- GitHub: [https://github.com/kroonen/ArtyLLaMA](https://github.com/kroonen/ArtyLLaMA)
|
93 |
+
- Email: [email protected]
|
94 |
+
|
95 |
+
We welcome contributions and feedback from the community!
|