You probably saw what Microsoft has started to deliver to teachers last week in Teams educational platform : among other things, the integrated AI can now generate a quiz from a given text that also contains specific feedback for each choice. All this is integrated in the same platform that the teacher knows well without having to know how to prompt.
Is Moodle working on something similar?
AI in Moodle to help teachers to add automated and specific feedback to questions
by Dominic Gagne -
Number of replies: 14
In reply to Dominic Gagne
Re: AI in Moodle to help teachers to add automated and specific feedback to questions
by Marcus Green -
Moodle HQ is working on an AI Subsystem that is due to be min Moodle 4.5 scheduled for October 2024
https://tracker.moodle.org/browse/MDL-80888
This plugin which uses ChatGPT from OpenAIallows the creation of Multiple Choice Questions from a given text
https://moodle.org/plugins/local_aiquestions
I have used it and I like what it does.
You can see other ChatGPT related plugins here
https://moodle.org/plugins/?q=chatgpt
I have been working on an AI Quiz question type that can use ChatGPT and other Large Language Model back ends. In this animation it is using the
LLama3 Model
https://fosstodon.org/@marcusgreen/112481025701572256
In reply to Marcus Green
Re: AI in Moodle to help teachers to add automated and specific feedback to questions
by Dominic Gagne -
Thank you very much for that great answer Marcus!
In reply to Dominic Gagne
Re: AI in Moodle to help teachers to add automated and specific feedback to questions
by Przemek Kaszubski -
Hello, Dominic. Do you happen to have any link etc . for this:
"You probably saw what Microsoft has started to deliver to teachers last week in Teams educational platform : among other things, the integrated AI can now generate a quiz from a given text that also contains specific feedback for each choice."
I searched yesterday and somehow could not find anything, nor can I see anything to the effect on our institutional Teams.
Thanks, and kind regards.
Przemek
"You probably saw what Microsoft has started to deliver to teachers last week in Teams educational platform : among other things, the integrated AI can now generate a quiz from a given text that also contains specific feedback for each choice."
I searched yesterday and somehow could not find anything, nor can I see anything to the effect on our institutional Teams.
Thanks, and kind regards.
Przemek
In reply to Przemek Kaszubski
Re: AI in Moodle to help teachers to add automated and specific feedback to questions
by Dominic Gagne -
Sorry,
Here is the link to my reference :
Even if there are quite a few impressive new features using AI, I exagerated concerning the automatic and specific feedback wich isn't directly offered in Teams or Forms yet. Sorry.
Here is the link to my reference :
Even if there are quite a few impressive new features using AI, I exagerated concerning the automatic and specific feedback wich isn't directly offered in Teams or Forms yet. Sorry.
In reply to Dominic Gagne
Re: AI in Moodle to help teachers to add automated and specific feedback to questions
by Przemek Kaszubski -
Pretty mind-blowing stuff, though. Thanks for sharing !
In reply to Dominic Gagne
Re: AI in Moodle to help teachers to add automated and specific feedback to questions
by Marcus Green -
I have created some documentation for my question type which can be seen here
In reply to Marcus Green
Re: AI in Moodle to help teachers to add automated and specific feedback to questions
by Dominic Gagne -
Thanks a lot for that great work Marcus!!!!
It's very impressive, but sadly, it wouldn't be acceptable in our organisation where teachers have to approuve anything that is coming from AI and going to the students before it gets there.
In a world where there are also unicorn, for that type of written question, there would be a way for the teacher to approuve the feedback before it gets to the student directly in Moodle. If it was a type of question that can be automatically corrected (multiple choices, ...), again in the same unicorn world, Moodle/AI would generate feedback and add it directly to the questions that are already in the course or Moodle/AI would generate both the questions and the automatic feedback from a given text or video.
I know, I'm asking a lot, but these days... and there is still time before moodle 4.5...
It's very impressive, but sadly, it wouldn't be acceptable in our organisation where teachers have to approuve anything that is coming from AI and going to the students before it gets there.
In a world where there are also unicorn, for that type of written question, there would be a way for the teacher to approuve the feedback before it gets to the student directly in Moodle. If it was a type of question that can be automatically corrected (multiple choices, ...), again in the same unicorn world, Moodle/AI would generate feedback and add it directly to the questions that are already in the course or Moodle/AI would generate both the questions and the automatic feedback from a given text or video.
I know, I'm asking a lot, but these days... and there is still time before moodle 4.5...
In reply to Dominic Gagne
Re: AI in Moodle to help teachers to add automated and specific feedback to questions
by Marcus Green -
"It's very impressive, but sadly, it wouldn't be acceptable in our organisation where teachers have to approve anything that is coming from AI and going to the students before it gets there. "
I can understand that and it was one of the first questions I was asked after presenting it in Japan. I have a section in the documentation called "Teacher moderation".
https://github.com/marcusgreen/moodle-qtype_aitext/wiki/Teacher-moderation
Which describes how the teacher can review/edit the AI Feedback before it is seen by students. However I created this with a view to learning i.e. formative assessment where quick feedback is very beneficial.
I have quite a few ideas for improving the question type, both for the way it gives feedback and for options on how the feedback is given. I have had an excellent code contribution from Justin Hunt (of Poodll fame), who created a prompt testing option. This is useful because the quality of the prompt determines the quality of the feedback.
I can understand that and it was one of the first questions I was asked after presenting it in Japan. I have a section in the documentation called "Teacher moderation".
https://github.com/marcusgreen/moodle-qtype_aitext/wiki/Teacher-moderation
Which describes how the teacher can review/edit the AI Feedback before it is seen by students. However I created this with a view to learning i.e. formative assessment where quick feedback is very beneficial.
I have quite a few ideas for improving the question type, both for the way it gives feedback and for options on how the feedback is given. I have had an excellent code contribution from Justin Hunt (of Poodll fame), who created a prompt testing option. This is useful because the quality of the prompt determines the quality of the feedback.
In reply to Marcus Green
Re: AI in Moodle to help teachers to add automated and specific feedback to questions
by Przemek Kaszubski -
Great stuff !
In reply to Dominic Gagne
Re: AI in Moodle to help teachers to add automated and specific feedback to questions
by Visvanath Ratnaweera -
You must have meant https://www.nbcnewyork.com/news/business/money-report/microsoft-launches-free-ai-assistant-for-all-educators-in-us-in-deal-with-khan-academy/5433259/, 21 May 2024. (found in https://news.slashdot.org/story/24/05/21/1550212/microsoft-launches-free-ai-assistant-for-all-educators-in-us-in-deal-with-khan-academy/, 22 May) Unfortunately it is for the US only. And none less than Salman Khan at the helm, the US will soon take the lead in education world-wide. It is a great relief that this appears under Future major features.
BTW, what is the "platform that the teacher knows well"? Is it Microsoft Teams by any chance? Moodle may not have something similar, but many things that are much better.
BTW, what is the "platform that the teacher knows well"? Is it Microsoft Teams by any chance? Moodle may not have something similar, but many things that are much better.
In reply to Visvanath Ratnaweera
Re: AI in Moodle to help teachers to add automated and specific feedback to questions
by Przemek Kaszubski -
Thanks, Visvanath. Very useful pointers and comments.
Cheers,
Przemek
Cheers,
Przemek
In reply to Przemek Kaszubski
Re: AI in Moodle to help teachers to add automated and specific feedback to questions
by Brett Dalton -
For reference this is the same tool Canvas has partnered with Khan Academy to deliver in their LMS.
In reply to Dominic Gagne
Re: AI in Moodle to help teachers to add automated and specific feedback to questions
by Przemek Kaszubski -
I'd encourage for this discussion to be linked (and perhaps summarised) at https://moodle.org/mod/forum/view.php?id=8776 (= Moodle Research Lab > Artificial Intelligence > Moodle AI Lounge) ?
In reply to Dominic Gagne
Re: AI in Moodle to help teachers to add automated and specific feedback to questions
by Ken Currie -
We, at CAPDM, use our own 'content display' plugin, which is very similar to the OUContent plugin. We can develop any feature we want in it and have recently seamlessly embedded ChatGPT into it.
There are various hooks we use (all of which are configurable and others can be added). For example, in Reflective Activities we use explicit buttons to allow a question to be asked or for a random quiz to be generated - both using the text of the reflection as the context of the prompt.
We have also added a hook to allow a question to be asked of any <p> tag, using the content of the paragraph as the context of the prompt.
Both are intended to provide scalable support for the student who might be struggling with a concept and wish to ask a very specific question in the absence of a real tutor.
We have taken this a stage further and done the same for all the core texts used on a programme (e.g. OpenStax texts for an MBA). However we have created embeddings of the content of these texts, stored in a vector database, so that any question asked is padded out with the top 10 hits to provide the context for the eventual prompt. This way we can begin to ensure a relevance to everything asked.
If anyone is interested in a demo, the code, or whatever, just ask. This is a feature that I suspect all the publishers will offer - at a price. At least we limit it to only the content relevant and used on a programme/course.