huihui-ai commited on
Commit
5fcbe7d
·
verified ·
1 Parent(s): 57b1ed9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +65 -3
README.md CHANGED
@@ -1,7 +1,69 @@
1
  ---
2
- language: en
 
 
 
 
 
 
 
3
  tags:
 
 
4
  - mlx
5
- pipeline_tag: text-generation
6
- library_name: mlx
7
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language:
3
+ - en
4
+ - zh
5
+ library_name: transformers
6
+ license: mit
7
+ pipeline_tag: text-generation
8
+ base_model:
9
+ - zai-org/GLM-4.6
10
  tags:
11
+ - abliterated
12
+ - uncensored
13
  - mlx
14
+ - chat
 
15
  ---
16
+
17
+ # huihui-ai/Huihui-GLM-4.6-abliterated-mlx-4bit
18
+
19
+
20
+ This is an uncensored version of [zai-org/GLM-4.6](https://huggingface.co/zai-org/GLM-4.6) created with abliteration (see [remove-refusals-with-transformers](https://github.com/Sumandora/remove-refusals-with-transformers) to know more about it).
21
+
22
+ **This is just the MLX model we generated under Linux using mlx-lm version 0.28.3; it hasn’t been tested in an Apple environment. If there are any issues, please let us know.**
23
+
24
+ ## Usage
25
+
26
+ ```python
27
+ from mlx_lm import load, generate
28
+
29
+ model, tokenizer = load("huihui-ai/Huihui-GLM-4.6-abliterated-mlx-4bit")
30
+
31
+ prompt = "Write a story about Einstein"
32
+
33
+ messages = [{"role": "user", "content": prompt}]
34
+ prompt = tokenizer.apply_chat_template(
35
+ messages, add_generation_prompt=True
36
+ )
37
+
38
+ text = generate(model, tokenizer, prompt=prompt, verbose=True)
39
+
40
+ print(text)
41
+ ```
42
+
43
+ ### Usage Warnings
44
+
45
+
46
+ - **Risk of Sensitive or Controversial Outputs**: This model’s safety filtering has been significantly reduced, potentially generating sensitive, controversial, or inappropriate content. Users should exercise caution and rigorously review generated outputs.
47
+
48
+ - **Not Suitable for All Audiences**: Due to limited content filtering, the model’s outputs may be inappropriate for public settings, underage users, or applications requiring high security.
49
+
50
+ - **Legal and Ethical Responsibilities**: Users must ensure their usage complies with local laws and ethical standards. Generated content may carry legal or ethical risks, and users are solely responsible for any consequences.
51
+
52
+ - **Research and Experimental Use**: It is recommended to use this model for research, testing, or controlled environments, avoiding direct use in production or public-facing commercial applications.
53
+
54
+ - **Monitoring and Review Recommendations**: Users are strongly advised to monitor model outputs in real-time and conduct manual reviews when necessary to prevent the dissemination of inappropriate content.
55
+
56
+ - **No Default Safety Guarantees**: Unlike standard models, this model has not undergone rigorous safety optimization. huihui.ai bears no responsibility for any consequences arising from its use.
57
+
58
+
59
+ ### Donation
60
+
61
+ If you like it, please click 'like' and follow us for more updates.
62
+ You can follow [x.com/support_huihui](https://x.com/support_huihui) to get the latest model information from huihui.ai.
63
+
64
+ ##### Your donation helps us continue our further development and improvement, a cup of coffee can do it.
65
+ - bitcoin(BTC):
66
+ ```
67
+ bc1qqnkhuchxw0zqjh2ku3lu4hq45hc6gy84uk70ge
68
+ ```
69
+ - Support our work on Ko-fi (https://ko-fi.com/huihuiai)!