AI in Moodle to help teachers to add automated and specific feedback to questions

AI in Moodle to help teachers to add automated and specific feedback to questions

Dominic Gagne -
回帖数:14

You probably saw what Microsoft has started to deliver to teachers last week in Teams educational platform : among other things, the integrated AI can now generate a quiz from a given text that also contains specific feedback for each choice. All this is integrated in the same platform that the teacher knows well without having to know how to prompt.

Is Moodle working on something similar?

回复Dominic Gagne

Re: AI in Moodle to help teachers to add automated and specific feedback to questions

Marcus Green -
Core developers的头像 Particularly helpful Moodlers的头像 Plugin developers的头像 Testers的头像

Moodle HQ is working on an AI Subsystem that is due to be min Moodle 4.5 scheduled for October 2024

https://tracker.moodle.org/browse/MDL-80888

This plugin which uses ChatGPT from OpenAIallows the creation of Multiple Choice Questions from a given text

https://moodle.org/plugins/local_aiquestions

I have used it and I like what it does.

You can see other ChatGPT related plugins here

https://moodle.org/plugins/?q=chatgpt

I have been working on an AI Quiz question type that can use ChatGPT and other Large Language Model back ends. In this animation it is using the 

LLama3 Model

https://fosstodon.org/@marcusgreen/112481025701572256



回复Marcus Green

Re: AI in Moodle to help teachers to add automated and specific feedback to questions

Dominic Gagne -
Thank you very much for that great answer Marcus!
回复Dominic Gagne

Re: AI in Moodle to help teachers to add automated and specific feedback to questions

Przemek Kaszubski -
Particularly helpful Moodlers的头像 Testers的头像
Hello, Dominic. Do you happen to have any link etc . for this:
"You probably saw what Microsoft has started to deliver to teachers last week in Teams educational platform : among other things, the integrated AI can now generate a quiz from a given text that also contains specific feedback for each choice."
I searched yesterday and somehow could not find anything, nor can I see anything to the effect on our institutional Teams.
Thanks, and kind regards.
Przemek
回复Przemek Kaszubski

Re: AI in Moodle to help teachers to add automated and specific feedback to questions

Dominic Gagne -
Sorry,

Here is the link to my reference :
Even if there are quite a few impressive new features using AI, I exagerated concerning the automatic and specific feedback wich isn't directly offered in Teams or Forms yet. Sorry.
回复Dominic Gagne

Re: AI in Moodle to help teachers to add automated and specific feedback to questions

Przemek Kaszubski -
Particularly helpful Moodlers的头像 Testers的头像
Pretty mind-blowing stuff, though. Thanks for sharing !
回复Dominic Gagne

Re: AI in Moodle to help teachers to add automated and specific feedback to questions

Marcus Green -
Core developers的头像 Particularly helpful Moodlers的头像 Plugin developers的头像 Testers的头像
I have created some documentation for my question type which can be seen here
回复Marcus Green

Re: AI in Moodle to help teachers to add automated and specific feedback to questions

Dominic Gagne -
Thanks a lot for that great work Marcus!!!!

It's very impressive, but sadly, it wouldn't be acceptable in our organisation where teachers have to approuve anything that is coming from AI and going to the students before it gets there.

In a world where there are also unicorn, for that type of written question, there would be a way for the teacher to approuve the feedback before it gets to the student directly in Moodle. If it was a type of question that can be automatically corrected (multiple choices, ...), again in the same unicorn world, Moodle/AI would generate feedback and add it directly to the questions that are already in the course or Moodle/AI would generate both the questions and the automatic feedback from a given text or video.

I know, I'm asking a lot, but these days... and there is still time before moodle 4.5...
回复Dominic Gagne

Re: AI in Moodle to help teachers to add automated and specific feedback to questions

Marcus Green -
Core developers的头像 Particularly helpful Moodlers的头像 Plugin developers的头像 Testers的头像
"It's very impressive, but sadly, it wouldn't be acceptable in our organisation where teachers have to approve anything that is coming from AI and going to the students before it gets there. "

I can understand that and it was one of the first questions I was asked after presenting it in Japan. I have a section in the documentation called "Teacher moderation".

https://github.com/marcusgreen/moodle-qtype_aitext/wiki/Teacher-moderation

Which describes how the teacher can review/edit the AI Feedback before it is seen by students. However I created this with a view to  learning i.e. formative assessment where quick feedback is very beneficial. 

I have quite a few ideas for improving the question type, both for the way it gives feedback and for options on how the feedback is given. I have had an excellent code contribution from Justin Hunt (of Poodll fame), who created a prompt testing option. This is useful because the quality of the prompt determines the quality of the feedback.


回复Dominic Gagne

Re: AI in Moodle to help teachers to add automated and specific feedback to questions

Visvanath Ratnaweera -
Particularly helpful Moodlers的头像 Translators的头像
You must have meant https://www.nbcnewyork.com/news/business/money-report/microsoft-launches-free-ai-assistant-for-all-educators-in-us-in-deal-with-khan-academy/5433259/, 21 May 2024. (found in https://news.slashdot.org/story/24/05/21/1550212/microsoft-launches-free-ai-assistant-for-all-educators-in-us-in-deal-with-khan-academy/, 22 May) Unfortunately it is for the US only. And none less than Salman Khan at the helm, the US will soon take the lead in education world-wide. It is a great relief that this appears under Future major features.

BTW, what is the "platform that the teacher knows well"? Is it Microsoft Teams by any chance? Moodle may not have something similar, but many things that are much better.
眨眼
回复Visvanath Ratnaweera

Re: AI in Moodle to help teachers to add automated and specific feedback to questions

Przemek Kaszubski -
Particularly helpful Moodlers的头像 Testers的头像
Thanks, Visvanath. Very useful pointers and comments.
Cheers,
Przemek
回复Dominic Gagne

Re: AI in Moodle to help teachers to add automated and specific feedback to questions

Ken Currie -

We, at CAPDM, use our own 'content display' plugin, which is very similar to the OUContent plugin.  We can develop any feature we want in it and have recently seamlessly embedded ChatGPT into it.

There are various hooks we use (all of which are configurable and others can be added).  For example, in Reflective Activities we use explicit buttons to allow a question to be asked or for a random quiz to be generated - both using the text of the reflection as the context of the prompt.

We have also added a hook to allow a question to be asked of any <p> tag, using the content of the paragraph as the context of the prompt.

Both are intended to provide scalable support for the student who might be struggling with a concept and wish to ask a very specific question in the absence of a real tutor.

We have taken this a stage further and done the same for all the core texts used on a programme (e.g. OpenStax texts for an MBA).  However we have created embeddings of the content of these texts, stored in a vector database, so that any question asked is padded out with the top 10 hits to provide the context for the eventual prompt.  This way we can begin to ensure a relevance to everything asked.

If anyone is interested in a demo, the code, or whatever, just ask.  This is a feature that I suspect all the publishers will offer - at a price.  At least we limit it to only the content relevant and used on a programme/course.