From dd497bb521faaec8e977d31a0f6c653513cd8cb8 Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?Zden=C4=9Bk=20Kasner?= Date: Thu, 1 Aug 2024 09:26:18 +0200 Subject: [PATCH 1/2] Add factgenie Add an open-source framework for span-level annotations of texts generated by LLMs. --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index 26f1043..58bd30b 100644 --- a/README.md +++ b/README.md @@ -73,6 +73,7 @@ Contributing: I gladly accept additions to the lists below; please submit an iss * [DataQA](https://github.com/dataqa/dataqa) - classification, NER, NEL * [DAML](https://github.com/vmware/data-annotator-for-machine-learning) -- Data Annotator for Machine Learning (DAML) -- text classification, NER, tabular classification and regression, image (bounding box, polygon), log labelling * [doccano](https://github.com/chakki-works/doccano) -- NER, sentiment, translation +* [factgenie](https://github.com/kasnerz/factgenie) -- span-level annotations, focused on LLM hallucinations * [FoLiA Linguisitc Annotation Tool (Flat)](https://github.com/proycon/flat) * [Hover](https://github.com/phurwicz/hover) * [Label Studio](https://github.com/heartexlabs/label-studio) -- image, audio, text From e93b295763db8d6fcb1160125d7ac1aaa50717c7 Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?Zden=C4=9Bk=20Kasner?= Date: Thu, 1 Aug 2024 14:16:13 +0200 Subject: [PATCH 2/2] Improve description of the factgenie framework --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 58bd30b..289de46 100644 --- a/README.md +++ b/README.md @@ -73,7 +73,7 @@ Contributing: I gladly accept additions to the lists below; please submit an iss * [DataQA](https://github.com/dataqa/dataqa) - classification, NER, NEL * [DAML](https://github.com/vmware/data-annotator-for-machine-learning) -- Data Annotator for Machine Learning (DAML) -- text classification, NER, tabular classification and regression, image (bounding box, polygon), log labelling * [doccano](https://github.com/chakki-works/doccano) -- NER, sentiment, translation -* [factgenie](https://github.com/kasnerz/factgenie) -- span-level annotations, focused on LLM hallucinations +* [factgenie](https://github.com/kasnerz/factgenie) -- token-level annotations from crowdworkers and LLMs * [FoLiA Linguisitc Annotation Tool (Flat)](https://github.com/proycon/flat) * [Hover](https://github.com/phurwicz/hover) * [Label Studio](https://github.com/heartexlabs/label-studio) -- image, audio, text