decisionslab/DLab-852-Mini

The Model decisionslab/DLab-852-Mini is a fine-tuned version of microsoft/Phi-3.5-mini-instruct, optimized to replicate and align with the cultural nuances of Hong Kong. This model leverages a large, curated dataset of Hong Kong cultural values to enhance decision-making simulations, behavioral reasoning, and social interaction modeling, achieving performance levels that outperform the base model in key cultural alignment benchmarks.

Model Overview

Model Name: decisionslab/DLab-852-Mini
Base Model: microsoft/Phi-3.5-mini-instruct
Intended Use: Simulation of Hong Kong cultural behavior, decision-making processes, and social interactions.
Language(s): Primarily English

Model Description

decisionslab/DLab-852-Mini is designed to emulate the everyday life, conversations, and behavioral shifts of Hong Kongers by incorporating a dataset rich in local cultural values. Recognizing that cultural context significantly influences decision-making and social behavior, our fine-tuning process explicitly addresses the subjective nature of human behavior.

Key enhancements include:

Cultural Alignment: Fine-tuning on Hong Kong-specific datasets to capture local cultural nuances.
Benchmark Improvements:
- Individualism (IDV): 86% closer alignment to Hong Kong's cultural benchmark compared to the base Phi-3.5-mini.
- Uncertainty Avoidance (UAI): 84% better alignment versus Phi-3.5-mini.
- Indulgence (IVR): 74% improved mirroring of Hong Kong values.

These performance gains were validated using CD-Eval—a benchmark developed by researchers at Beijing Jiaotong University and Microsoft—demonstrating a significant cultural reasoning advantage.

Intended Use Cases

Cultural Simulation: Predicting and simulating behavioral trends and societal reactions in Hong Kong.
Policy and Decision Support: Enhancing simulation models for policy analysis and strategic decision-making.
Social Interaction Modeling: Tailoring conversational agents to interact authentically with Hong Kong users.
Academic and Market Research: Providing insights into culturally driven behavioral patterns.

Usage with mlx

Install the necessary package:

pip install mlx-lm

Load and generate a response with the model:

from mlx_lm import load, generate

model, tokenizer = load("decisionslab/DLab-852-Mini")

prompt = "你好, can you simulate a typical day in Hong Kong?"

if tokenizer.chat_template is not None:
    messages = [{"role": "user", "content": prompt}]
    prompt = tokenizer.apply_chat_template(messages, add_generation_prompt=True)

response = generate(model, tokenizer, prompt=prompt, verbose=True)
print(response)

Evaluation

The model's cultural alignment has been rigorously evaluated using CDEval:

Individualism (IDV): 86% closer alignment to Hong Kong cultural benchmarks.
Uncertainty Avoidance (UAI): 84% improvement over Phi-3.5-mini.
Indulgence (IVR): 74% better performance in mirroring local values.

These evaluations underscore the model’s effectiveness in capturing the subtleties of Hong Kong's cultural landscape.

License

All content in this repository is proprietary and confidential. The software and any associated documentation are the exclusive property of Decisions Lab. Unauthorized copying, distribution, modification, or use via any medium is strictly prohibited. Use of this software requires explicit permission from Decisions Lab.

Contact

For inquiries, collaborations, or feedback, please contact Decisions Lab via [email protected].

decisionslab
/

Dlab-852-Mini

You need to agree to share your contact information to access this model