本文探讨了使用大型语言模型（LLM）翻译文章对读者阅读体验的影响。作者发现，一篇由ChatGPT翻译的文章获得的评价远低于预期，推测原因在于读者识别出LLM的写作风格，从而认为文章缺乏原创性。文章提出了几个问题，如读者对LLM翻译文章的阅读意愿、文章内容本身的质量以及如何改进翻译策略。作者希望通过分析读者反馈，找到提高文章受欢迎程度的方法。

🤔文章作者最初使用ChatGPT将俄语文章翻译成英语，但文章获得的评价远低于预期，这引发了作者对翻译质量和读者阅读体验的思考。

🧐作者认为，读者可能在阅读文章的头一两段后，就识别出LLM的写作风格，从而认为文章缺乏原创性，导致阅读兴趣下降，并直接关闭文章。

💡作者提出了几个问题，包括读者对LLM翻译文章的阅读意愿、文章内容本身的质量以及如何改进翻译策略。例如，是否应该手动翻译，或者在文章开头添加声明，说明文章由LLM翻译。

🤔作者希望通过分析读者反馈，了解LLM翻译对文章受欢迎程度的影响，并找到提高文章质量和读者阅读体验的方法。

Published on May 3, 2025 2:45 PM GMT

TL;DR: Recently I wrote a post that got much less karma than I expected. My best guess is that the main reason is that I translated it from Russian to English via ChatGPT, and this easily recognizable LLM-style convinced readers from the first lines that “There aren’t any original thoughts; it is a standard, machine-generated fluff piece”. Is it correct, or does the post itself contain any major issues?

More detailed thoughts:

I expected the ideas from this post to be quite non-trivial (the math is simple, but practical results are more or less interesting; I mean, even Bayes’ and Aumann’s theorems are very simple from the mathematical point of view, but they bring many useful insights).
When I read it in the mentioned book, I found it very interesting.When I published the original Russian post in my Telegram channel, it became one of the most liked posts there.It is not easy to see it from the text, but I added many personal insights of my own to the book’s ideas (most of them are “how exactly it goes from the math” and “why it is still working in real life”).
I expected - including after considering my previous post - a rating of about 10-20 (and if I were an author who has been writing for a long time and proved his posts as useful for community, maybe I could expect 50+). Rating of 5 (2 of which are default rating based on author’s karma) makes me feel very confused.My main hypothesis is as follows: the user opened the post, read one or two paragraphs, noticed distinct LLM-generated style, understood that it’s just another empty machine-generated piece of text, closed the post.Part of the effect may be due to my not adding any tags to the post. But I don’t expect it was the main reason.Perhaps the post itself is not well written or lacks new ideas; but my evals of such effect are already contained in my expected 10-20 rating.

And now, more detailed questions:

Are my assumptions correct? More specifically, I have the following questions (depending on how much effort you are willing to put in):
If you see text, which is obviously LLM-written/translated, what is the probability that you would stop reading after one or two paragraphs (except in cases where there is quite a revelation within these paragraphs)?How strong is feeling from first one or two paragraphs of this particular post, that “There is nothing interesting in here; I will barely update; it’s just another LLM-written post”?If you read the whole post - how much information from it is interesting? Are there any significant flaws in its content? How unpleasant is reading such LLM-style text?
Assuming that the main problem is just LLM-translation, what should I do next time? Should I translate it manually (as I did for this particular question-post - unfortunately, it took significantly more effort, and I’m not sure about its quality)? Or maybe I should add a disclaimer at the beginning of a post: “This text is completely thought through and written by myself, but translated by an LLM with minimal editing”? Or should I do something else?

Discuss