Who Wrote the Scientific News? Improving the Discernibility of LLMS to Human-Written Scientific News
Salvato in:
| Pubblicato in: | ProQuest Dissertations and Theses (2024) |
|---|---|
| Autore principale: | |
| Pubblicazione: |
ProQuest Dissertations & Theses
|
| Soggetti: | |
| Accesso online: | Citation/Abstract Full Text - PDF |
| Tags: |
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
MARC
| LEADER | 00000nab a2200000uu 4500 | ||
|---|---|---|---|
| 001 | 3111173129 | ||
| 003 | UK-CbPIL | ||
| 020 | |a 9798384455080 | ||
| 035 | |a 3111173129 | ||
| 045 | 2 | |b d20240101 |b d20241231 | |
| 084 | |a 66569 |2 nlm | ||
| 100 | 1 | |a Soós, Dominik | |
| 245 | 1 | |a Who Wrote the Scientific News? Improving the Discernibility of LLMS to Human-Written Scientific News | |
| 260 | |b ProQuest Dissertations & Theses |c 2024 | ||
| 513 | |a Dissertation/Thesis | ||
| 520 | 3 | |a Large Language Models (LLMs) have rapidly advanced the field of Natural Language Processing and become powerful tools for generating and evaluating scientific text. Although LLMs have demonstrated promising as evaluators for certain text generation tasks, there is still a gap until they are used as reliable text evaluators for general purposes. In this thesis project, I attempted to fill this gap by examining the discernibility of LLMs from human-written and LLM-generated scientific news. This research demonstrated that although it was relatively straightforward for humans to discern scientific news written by humans from scientific news generated by GPT-3.5 using basic prompts, it is challenging for most state-of-the-art LLMs without instruction-tuning. To unlock the potential evaluation capability of LLMs on this task, we propose guided-few-shot (GFS), an instruction-tuning method that significantly improves the discernibility of LLMs to human-written and LLM-generated scientific news. To evaluate our method, we built a new dataset, SANews, containing about 362 triplets of scientific news text, LLM-generated news text, and the corresponding scientific paper abstract on which the news articles were based. This work is the first step for further understanding the feasibility of using LLMs as an automated scientific news quality evaluator. | |
| 653 | |a Computer science | ||
| 653 | |a Artificial intelligence | ||
| 653 | |a Computer engineering | ||
| 773 | 0 | |t ProQuest Dissertations and Theses |g (2024) | |
| 786 | 0 | |d ProQuest |t ProQuest Dissertations & Theses Global | |
| 856 | 4 | 1 | |3 Citation/Abstract |u https://www.proquest.com/docview/3111173129/abstract/embedded/6A8EOT78XXH2IG52?source=fedsrch |
| 856 | 4 | 0 | |3 Full Text - PDF |u https://www.proquest.com/docview/3111173129/fulltextPDF/embedded/6A8EOT78XXH2IG52?source=fedsrch |