You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
| original | failed at all, easily accepted racist, sexist overally toxic prompts that were well formulated | Very sensitive on swear words, failed to reckognize context | good performance | good performance |
49
-
| unbiased | Managed to find some hidden toxicity but not on all sentences | Very sensitive explicit language but shown ability to recognize context | Did well but failed to reckognize some gender stereotype mockery | good performance |
50
-
| multilingual | Managed to find some hidden toxicity but not on all sentences | Very sensitive explicit language but shown ability to recognize context | Did well but failed to reckognize some gender stereotype mockery | good performance |
46
+
| Model name | Not obviously toxic | Not obviously non-toxic | Obviously toxic | Obviously non-toxic |
| original | failed at all, easily accepted racist, sexist overally toxic prompts that were well formulated | Very sensitive on swear words, failed to recognize context | good performance | good performance |
49
+
| unbiased | Managed to find some hidden toxicity but not on all sentences | Very sensitive explicit language but shown ability to recognize context | Did well but failed to recognize some gender stereotype mockery | good performance |
50
+
| multilingual | Managed to find some hidden toxicity but not on all sentences | Very sensitive explicit language but shown ability to recognize context | Did well but failed to recognize some gender stereotype mockery | good performance |
51
51
52
-
Subjectivly 'unbiased' looks like the best performing model.
52
+
Subjectively 'unbiased' looks like the best performing model.
53
53
54
54
I don't think it would do well as a security layer in a live version of open
55
55
assistant unless we do some finetuning first, because it can be fooled to pass
Copy file name to clipboardexpand all lines: notebooks/example/README.md
+2-2
Original file line number
Diff line number
Diff line change
@@ -3,7 +3,7 @@
3
3
[](https://colab.research.google.com/github/LAION-AI/Open-Assistant/blob/main/notebooks/example/example.ipynb)
4
4
5
5
This folder contains an example reference notebook structure and approach for
6
-
this project. Please try and follow this structure as closely as possible. While
6
+
this project. Please try to follow this structure as closely as possible. While
7
7
things will not exactly be the same for each notebook some principles we would
8
8
like to try ensure are:
9
9
@@ -34,7 +34,7 @@ same directory that the notebook lives in so relative links etc should work as
34
34
expected (for example `example.ipynb` will read some sample data from
35
35
`data/data.csv`).
36
36
37
-
If you are adding a notebook please try and add a similar cell to the top of the
37
+
If you are adding a notebook please try to add a similar cell to the top of the
38
38
notebook so that it is easy for others to run the notebook in colab. If your
39
39
notebook does not have any dependencies beyond what already comes as standard in
40
40
Google Colab then you do not need such a cell, just an "Open in Colab" badge
0 commit comments