AI in Moodle to help teachers to add automated and specific feedback to questions

AI in Moodle to help teachers to add automated and specific feedback to questions

by Dominic Gagne -
Number of replies: 14

You probably saw what Microsoft has started to deliver to teachers last week in Teams educational platform : among other things, the integrated AI can now generate a quiz from a given text that also contains specific feedback for each choice. All this is integrated in the same platform that the teacher knows well without having to know how to prompt.

Is Moodle working on something similar?

Average of ratings: -
In reply to Dominic Gagne

Re: AI in Moodle to help teachers to add automated and specific feedback to questions

by Marcus Green -
Picture of Core developers Picture of Particularly helpful Moodlers Picture of Plugin developers Picture of Testers

Moodle HQ is working on an AI Subsystem that is due to be min Moodle 4.5 scheduled for October 2024

https://tracker.moodle.org/browse/MDL-80888

This plugin which uses ChatGPT from OpenAIallows the creation of Multiple Choice Questions from a given text

https://moodle.org/plugins/local_aiquestions

I have used it and I like what it does.

You can see other ChatGPT related plugins here

https://moodle.org/plugins/?q=chatgpt

I have been working on an AI Quiz question type that can use ChatGPT and other Large Language Model back ends. In this animation it is using the 

LLama3 Model

https://fosstodon.org/@marcusgreen/112481025701572256



Average of ratings: Useful (5)
In reply to Marcus Green

Re: AI in Moodle to help teachers to add automated and specific feedback to questions

by Dominic Gagne -
Thank you very much for that great answer Marcus!
Average of ratings: Useful (1)
In reply to Dominic Gagne

Re: AI in Moodle to help teachers to add automated and specific feedback to questions

by Przemek Kaszubski -
Picture of Particularly helpful Moodlers Picture of Testers
Hello, Dominic. Do you happen to have any link etc . for this:
"You probably saw what Microsoft has started to deliver to teachers last week in Teams educational platform : among other things, the integrated AI can now generate a quiz from a given text that also contains specific feedback for each choice."
I searched yesterday and somehow could not find anything, nor can I see anything to the effect on our institutional Teams.
Thanks, and kind regards.
Przemek
In reply to Przemek Kaszubski

Re: AI in Moodle to help teachers to add automated and specific feedback to questions

by Dominic Gagne -
Sorry,

Here is the link to my reference :
Even if there are quite a few impressive new features using AI, I exagerated concerning the automatic and specific feedback wich isn't directly offered in Teams or Forms yet. Sorry.
Average of ratings: Useful (1)
In reply to Dominic Gagne

Re: AI in Moodle to help teachers to add automated and specific feedback to questions

by Przemek Kaszubski -
Picture of Particularly helpful Moodlers Picture of Testers
Pretty mind-blowing stuff, though. Thanks for sharing !
In reply to Dominic Gagne

Re: AI in Moodle to help teachers to add automated and specific feedback to questions

by Marcus Green -
Picture of Core developers Picture of Particularly helpful Moodlers Picture of Plugin developers Picture of Testers
I have created some documentation for my question type which can be seen here
Average of ratings: Useful (1)
In reply to Marcus Green

Re: AI in Moodle to help teachers to add automated and specific feedback to questions

by Dominic Gagne -
Thanks a lot for that great work Marcus!!!!

It's very impressive, but sadly, it wouldn't be acceptable in our organisation where teachers have to approuve anything that is coming from AI and going to the students before it gets there.

In a world where there are also unicorn, for that type of written question, there would be a way for the teacher to approuve the feedback before it gets to the student directly in Moodle. If it was a type of question that can be automatically corrected (multiple choices, ...), again in the same unicorn world, Moodle/AI would generate feedback and add it directly to the questions that are already in the course or Moodle/AI would generate both the questions and the automatic feedback from a given text or video.

I know, I'm asking a lot, but these days... and there is still time before moodle 4.5...
Average of ratings: Useful (1)
In reply to Dominic Gagne

Re: AI in Moodle to help teachers to add automated and specific feedback to questions

by Marcus Green -
Picture of Core developers Picture of Particularly helpful Moodlers Picture of Plugin developers Picture of Testers
"It's very impressive, but sadly, it wouldn't be acceptable in our organisation where teachers have to approve anything that is coming from AI and going to the students before it gets there. "

I can understand that and it was one of the first questions I was asked after presenting it in Japan. I have a section in the documentation called "Teacher moderation".

https://github.com/marcusgreen/moodle-qtype_aitext/wiki/Teacher-moderation

Which describes how the teacher can review/edit the AI Feedback before it is seen by students. However I created this with a view to  learning i.e. formative assessment where quick feedback is very beneficial. 

I have quite a few ideas for improving the question type, both for the way it gives feedback and for options on how the feedback is given. I have had an excellent code contribution from Justin Hunt (of Poodll fame), who created a prompt testing option. This is useful because the quality of the prompt determines the quality of the feedback.


Average of ratings: Useful (2)
In reply to Dominic Gagne

Re: AI in Moodle to help teachers to add automated and specific feedback to questions

by Visvanath Ratnaweera -
Picture of Particularly helpful Moodlers Picture of Translators
You must have meant https://www.nbcnewyork.com/news/business/money-report/microsoft-launches-free-ai-assistant-for-all-educators-in-us-in-deal-with-khan-academy/5433259/, 21 May 2024. (found in https://news.slashdot.org/story/24/05/21/1550212/microsoft-launches-free-ai-assistant-for-all-educators-in-us-in-deal-with-khan-academy/, 22 May) Unfortunately it is for the US only. And none less than Salman Khan at the helm, the US will soon take the lead in education world-wide. It is a great relief that this appears under Future major features.

BTW, what is the "platform that the teacher knows well"? Is it Microsoft Teams by any chance? Moodle may not have something similar, but many things that are much better.
wink
Average of ratings: Useful (1)
In reply to Visvanath Ratnaweera

Re: AI in Moodle to help teachers to add automated and specific feedback to questions

by Przemek Kaszubski -
Picture of Particularly helpful Moodlers Picture of Testers
Thanks, Visvanath. Very useful pointers and comments.
Cheers,
Przemek
In reply to Przemek Kaszubski

Re: AI in Moodle to help teachers to add automated and specific feedback to questions

by Brett Dalton -
Picture of Moodle HQ Picture of Particularly helpful Moodlers
In reply to Dominic Gagne

Re: AI in Moodle to help teachers to add automated and specific feedback to questions

by Ken Currie -

We, at CAPDM, use our own 'content display' plugin, which is very similar to the OUContent plugin.  We can develop any feature we want in it and have recently seamlessly embedded ChatGPT into it.

There are various hooks we use (all of which are configurable and others can be added).  For example, in Reflective Activities we use explicit buttons to allow a question to be asked or for a random quiz to be generated - both using the text of the reflection as the context of the prompt.

We have also added a hook to allow a question to be asked of any <p> tag, using the content of the paragraph as the context of the prompt.

Both are intended to provide scalable support for the student who might be struggling with a concept and wish to ask a very specific question in the absence of a real tutor.

We have taken this a stage further and done the same for all the core texts used on a programme (e.g. OpenStax texts for an MBA).  However we have created embeddings of the content of these texts, stored in a vector database, so that any question asked is padded out with the top 10 hits to provide the context for the eventual prompt.  This way we can begin to ensure a relevance to everything asked.

If anyone is interested in a demo, the code, or whatever, just ask.  This is a feature that I suspect all the publishers will offer - at a price.  At least we limit it to only the content relevant and used on a programme/course.