OriginalityAI Plagiarism & AI Detection Plugin

OriginalityAI Plagiarism & AI Detection Plugin

by Joseph Thibault -
Number of replies: 8
Picture of Particularly helpful Moodlers Picture of Plugin developers Picture of Testers

Hi, we recently released an update to a new Plagiarism and AI Detection tool in the Plugins database. The plugin connects Moodle to Originality.AI and provides an "on-demand" scan for teachers. 

https://moodle.org/plugins/plagiarism_origai

The plugin now supports both of the available API calls: plagiarism scan, and AI detection scan from the teacher interface for assignments, quizzes, and forums. 

image.png

Once a scan is run, the results are displayed

image%20%281%29.png

We strive to make this helpful, easy-to-use, and cost-effective. If there are any comments please let us know!

Average of ratings: Useful (1)
In reply to Joseph Thibault

Re: OriginalityAI Plagiarism & AI Detection Plugin

by Justin Hunt -
Picture of Particularly helpful Moodlers Picture of Plugin developers
This is awesome Joe.
Can you tell me more about the AI score. What information is it giving us?
In reply to Justin Hunt

Re: OriginalityAI Plagiarism & AI Detection Plugin

by Joseph Thibault -
Picture of Particularly helpful Moodlers Picture of Plugin developers Picture of Testers
Justin, thanks for the question.
 
1st I should acknowledge that AI detectors, including this one, are not infallible: They can be gamed by various "humanizer" or "undetection" tools or by prompting by students and have been shown to falsely identify human writing as AI, esp in cases of ESL writing or in lower grades (they should not be used the sole evidence in deciding the acceptability of student work). 
 
The 1% shown above is after the report has been run (e.g. a teacher or admin clicked to "call" the API for the particular text). 

Originality.AI does a sentence-by-sentence check and returns the data to provide a more granular report within Moodle (thanks to Amit!). This is displayed once the call is completed to the teacher on a new page:
image.png
It also includes an unlisted URL available to the teacher/admin to view the full report on the Originality.AI site which gives the same information with a bit more curb appeal (tho the facts remain the same):
image%20%281%29.png
The classification of AI is clearly labeled with a legend on each "full report" page:
image%20%282%29.png
According to the site documentation and disclaimers: "This score reflects our AI's confidence in predicting that the content scanned was produced by any popular AI tool such as ChatGPT, GPT-4o, Gemini 1.5 Pro, Claude 3, Mistral, Llama 3, etc. A score of 90% Original and 10% AI should be thought of as "We are 90% confident that this content was created by a human" and NOT that 90% of the article is Human and 10% AI."
 
I hope that helps!
 
Average of ratings: Useful (1)
In reply to Justin Hunt

Re: OriginalityAI Plagiarism & AI Detection Plugin

by Justin Hunt -
Picture of Particularly helpful Moodlers Picture of Plugin developers
Got it. So in the screenshot in the original post, it's 99% confident that the submission was not AI (and 1% confident that it was).
Thanks for the detailed reply. That is very interesting.
In reply to Justin Hunt

Re: OriginalityAI Plagiarism & AI Detection Plugin

by Joseph Thibault -
Picture of Particularly helpful Moodlers Picture of Plugin developers Picture of Testers

Ah, I got you now, yeah we were pretty sparse on the info:

Match %: 0%
AI %: 1%

Match % is similarity match to other sources, lower is better. 0% = 100% original

AI % is the estimated % that is generated by AI, 0% = 100% human.

Average of ratings: Useful (1)
In reply to Joseph Thibault

Re: OriginalityAI Plagiarism & AI Detection Plugin

by charles okurut omuut -
this is interesting. How do i enable that on my newly paid MoodleCloud. iam trying with turnitin and it gives me feedback "No plugins of this type are installed"
In reply to Joseph Thibault

Re: OriginalityAI Plagiarism & AI Detection Plugin

by Joseph Thibault -
Picture of Particularly helpful Moodlers Picture of Plugin developers Picture of Testers
FYI new version released today. This plugin now supports:
.doc, .pdf uploads
expands AI models through a selector
works on text uploaded to assignments or text entered via text editor on assignments, forums, and quizzes.
 
At scale this is $0.01 per 100 words (one of the least expensive and most flexible detection options on the market) 
In reply to Joseph Thibault

OriginalityAI Plagiarism & AI Detection Plugin

by Joseph Thibault -
Picture of Particularly helpful Moodlers Picture of Plugin developers Picture of Testers
As of May 15th the AI Multi-lang model now supports 30 languages: https://originality.ai/blog/multilanguage-ai-detection
  1. Russian
  2. Spanish
  3. Turkish
  4. Italian
  5. French
  6. German
  7. Portuguese
  8. Dutch
  9. Chinese Traditional
  10. Chinese Simplified
  11. Greek
  12. Polish
  13. Vietnamese
  14. Japanese
  15. Persian
  16. Korean
  17. Ukrainian
  18. Indonesian
  19. Hindi
  20. Standard Arabic
  21. Czech
  22. Swedish
  23. Danish
  24. Thai
  25. Urdu
  26. Slovak
  27. Norwegian
  28. Bulgarian
  29. Romanian
  30. Finnish