If you want to volunteer to continue shaping and improving this module to make it slicker and easier to use, please volunteer right here! We need you! Workshop needs you!
This convergence may allow a more consistent approach to peer assessment and would raise the profile of such features as more people use assignment than workshop.
PS. Is the plug-in type assignment likely for 1.5 as I have some development ideas I will want to move forward on but don't want to spend money on something which will become shortly obsolete?
Firstly, yes, the plugin structure for assignment is just about to land in CVS.
Secondly, I've never really thought of Workshop as an Assignment module before (unlike Exercise and Journal, both already slated to become so). It always seemed so big and individual in the way it did things. However, the plugin structure I have would actually allow workshop to work as a sub-module, if that made sense from a user interface point of view.
Definitely something to keep in mind, particularly as some of the other proposed Assignment ideas floating round also use peer review.
All of the moodlers I come across in real life don't use workshop because they can't get their head around it.
Peer and self assessment for assignment would be fantastic and those who wanted to take things further could then dip into the workshop sub module.
That said, I do feel strongly that workshop feels like a moodle addition rather than a part of moodle, and having all of the excellent workshop features 'ported' into the consistent and understandable assignment interface would be my assessment nirvana!
And possible incorporate the idea of teams into the core of assignment. It makes more since for the assignment to handle the teams than the core of moodle.
First, the workshop code is pretty seriously unstructured in places and is arguably in significant need of a re-write. If one was going to bring this into the Assignment module then that might be a good opportunity to either heavily revise the code or re-write it from scratch.
Second, there are serious (IMHO) issues about the way that peer assessments are assigned and evaluated that would need to be discussed (again, IMHO) broadly to figure out what the Moodle community wants/needs. The problem is that if one is going to use the doing of assessments as part of the grade then one needs to assign a balance collection of assignments to assess and that's not at all trivial to do, especially in the face of things like late and missing assignments.
The Assignment module is clean and makes sense. This is not so clearly true for the Workshop module. I'd hate to see the desire to bring in neat features of the Workshop module muddy up the Assignment waters.
We definitely need to try to get peer assessment and team assignments into the core.
Leaving it out of the core of Moodle is also tantamount to ignoring a fundamental truth, kids learn as much from their peers, and more deeply, as they do from their teachers.
This module has too much to offer to lose it now. Its time has come to grow, not wither. Can I program? No! but I can teach and I know a good idea when I see it.
In its Circular 2/05: Call for Projects to Develop e-Learning Tools for Learners and Teachers JISC ... "invites Higher Education Institutions in England and Further Education Colleges in receipt of HEFCE funding to submit funding proposals to develop, trial, evaluate and disseminate open source e-learning tools for learners and teachers between May 2005 and March 2006. The circular is aimed at multi-disciplinary teams consisting of software developers, teaching practitioners, learning technologists and pedagogy experts who are looking to mature and refine existing open source e-learning tools and invites bids to develop, trial, evaluate and disseminate open source e-learning tools for teachers and learners.
I think the Moodle community should be able to assemble such a team here in England to develop a peer assessment tool based on the work that we have already done on the workshop module.
Can all English users of the workshop module in higher or further education who would be happy to be partners in such a team please raise their hand? Non-English partners are welcome as well as long as the lead institution is English.
Workshop is what I would have aimed to use for most of our projects/assignments but I don't like the way it does grading. Our first use for this would be in our FE courses which are based around Edexcel BTEC - these are criterion based and the way this is setup in the Exercise module is ideal(though I have one thing I don't like about the Exercise module which is that there is no Project description in HTML - it has to be an uploaded document)
It may be that in the new plug version of the Assignment module all of my requirements will be answered but I haven't yet seen a version of it or even a list of what it is setting out to do. I think I'll await a proper Beta version of 1.5 before playing too much.
Anyway to reiterate - very happy to take part in this project - we are a small private establishment working in partnership with 2 colleges and the University of Plymouth providing courses in music technology, sound engineering and media. See www.deepbluesound.co.uk for more details. Approx 250 - 300 students total.
We use moodle in a secondary school ICT department - think the idea of workshop is fantastic but we have struggled to use it with the kids and the ideas in this forum sound as Darren put it like Assessment Nirvana.
I have done assessment work with some universities and would be glad to offer help if it was needed.
I have only just started using moodle in a similar situation secondary ICT so I am a long way behind.
This looks great! I could wait for the following lesson to assess work but other teachers will be using the same course at different times and synchonysing the use of the workshop would be almost impossible. I could change the times for my classes and so could some of the other staff, but I would prefer not to have the part time staff editing the courses. (any edits would/could mess up other groups schedules)
Has any one found a way around this.
I would love to set different times for different groups or even to remove the time options and use the manual option to move through the different stages.
At he moment I am looking at using the my files block from humbolt for pupils to upload and share work for peer assessment and for the assessor to use the same method or e-mail to return the assessed work, however this means less structured assessment and no records unless all assessed files are also e-mailed/shared with me.
Has anyone else got any other ways of providing peer assessment for groups sharing the same course?
I cant offer programming ressources now (this will change!), but I would be glad to help in designing future aspects of this module. we use this several time a week in differnt situations.
Any progress in this subject? Is there a maintainer already? Thanks for any information.
I'm still looking at the code for moodle though...
Hi Martin, I am sure, that we will find developement ressources for that in Austria - if you dont mind, I would like to organize that process as a maintainer.
80% of my moodle work at university is done with "workshop" and I have 2 theses students writing about that method ...
please tell me, what I should do
I'm so glad you stand up to keep this module in Moodle. I honestly believe this is one of the modules which contributes a lot in making Moodle really a tool making complicated tasks for teachers easy. I'm sorry I can't help on this, other than posting a few notes on what I think is important to keep in mind when continuing the developement of the Workshop module.
I think the most important problem I can see, is that teachers find it extremely difficult to use. The bloat of settings (I know it's just that what can make it fit like a good shoe) is scarying people away. So I think there is a lot of challenge there to make the setup of a workshop and the workflow more intuitive.
Secondly, for this particular module (and excercise), I think it should in time become an assignement, which would bring the assignements up to 5 types
- off line
- upload file
- on line
- upload file with self evaluation
- upload file with self and peer evaluation
Just some early morning thoughts...
Thanks a lot for standing up
Thanks Koen for your inputs,
PEER - as a learning strategie is one of the most effective methods. I use it normaly weekly for my students, but with an special aproach:
- Peer Assessment as a method of collaboration, and just doing it, will grant you the points for that week.
- Doing that weekly, there should be no reason to fail an examination because half of the examination is done with collaboration work during the semester, by working together, the final examination is therefore not very difficulty.
First we have to fix some security bugs for 1.6, but we are starting a collection of wishes for the next workshop-generation (my students will look through this forum), which should be a combination of excercise and workshop, with a beginner and expertmode.
I hope Ray will be with us ... with his experience!
Perhaps if someone could integrate the Workshop Module into the Assignment Module, we wouldn't really need to maintain this Module - but this is in the future. Perhaps a "Rubric-based assignment" and integrate Peer Assessment into the core of Assignment?
Just some thoughts.
Hi, the problem is not an integration - the problem will be a very complex modul - and the assignment modul is usefull as easy to use instrument, wwithot any problems in configuration. if there is a way to combine this - in future - it may be a thought ...but now, the only way to use workshop is to fix some bugs and make it easy to use ...
Peter, thanks for tanking on this role. I hope I am not getting to far ahead posting my wish list already.
I like what workshops have allowed my classes to do and learn but we keep turning up problems that are making me look for alternatives for peer assessment.
I want to be able to use a workshop with different classes but they may not have compatible time frames, if there is the option for groups there needs to be the option for seperate time frames (but you will still also need to be able to easily set the same conditions for all groups)
Teachers able to upload files after the submission date to allow for ilness, technical problems etc
Pupils need to be able to return to part done assessments so that they can work more flexibly. Most recently some had to save assessments early when they discovered they did not have the appropriate software at home to complete assessments for some of the submitted files., only to discover that they could not complete the assessment at a later date.(to get around this i had to delete assessments and then they often got re-allocated to a different student for assessment)
For quick and easy use in a single lesson the option ofmanual control of the phases would allow me to ensure that all files are uploaded then move on to the next phase.
I would also like to be able to use the scales that we have created for use in assignments to give a final grade for workshops. We have specific grading criteria that pupil are familiar with and I would like to use rubrics to give a grade for each section then to give an overall grade for the project using the scales.
Control of self assessmentas a separate phase with options for before, with or after peer assessment I find that the peer assessment has a big influence in pupils self assessment. The larger picture makes them more realistic in the self assessment and would like to use this to help them become more objective in their self assessments.
The most critical missing feature for us is capability to handle students working in teams. I realize that implementing this hinges mostly on Moodle core expanding the concept of groups as it has been proposed a while ago.
1. Assess teacher samples (excellent feature)
2. Submit first draft
3. Peer feedback/assessment (graded, but with option for it not to factor into final grade)
4. Submit second draft
5. Teacher feedback/assessment (again, with option not to factor into final grade)
6. Final submission
7. Final assessment (peer and teacher graded, with option to make only this assessment stage count for the grade)
If there's a way to do this right now (without creating the second draft stage by starting a new workshop, which is what I currently have to do, which is inconvenient to teacher and students), I don't know what it is.
It would also be nice if teachers could assign which students assess which other students; random generation of peer assessors could be an option, but I would love to have the option to design those groupings myself.
Also, is it me, or are the instructions / help pop-ups incomplete?
Don't mean to overwhelm and appreciate that this may be a tall order, but my what a nice writing workshop this would enable!
We're in the process of adding the grades and calendaring and backup/restore. Hopefully it'll all be finalized by May.
Interesting, Brian--this "Project Module" is not included in whatever version of Moodle our school 'moodle-master' is managing for us. (Sorry I don't know enough about Moodle to identify which version we use at my school)
I'm moving to a new school and planning to set up Moodle on a new server (independently) when I get there in July--and I would like to install the most stable version around.
Whatever version I'm using right now is very unstable (eg, most html boxes--'Recent Activity,' 'Current Users', 'RSS Feeds'disappear and never work again). What versions are known for their stability? What's the best version that includes the Project Module?
I'm using Moodle 1.6cvs and haven't hit many issues at all. Last semester I used 1.5 and had zero issues that I couldn't work around pretty readily (which have all been solved in 1.6).
Embarrassing question: how do I learn which version my school uses?
In the expansion of the Project Module that I have a team working on, we borrow a lot of code from the workshop module to do the rubrics, peer assessments and statistical analysis. We further have it working with groups. It keeps track of the groups itself for 1.5.3, but I'm hoping we get it to create groups in Moodle itself for 1.6 (since multiple groups are supported).
If we could modularize the code and move it into a core of some kind that other modules can use... we'd be golden.
However, Workshop is already in the standard Moodle install.. so I'm very happy someone's agree to maintain it for a bit longer (and improve it). Our project module is probably too "heavy" for a a little workshop... and if the workshop gets to a point where we can just embed it - Awesome!
Thanks agin for picking this up.
thanks for your input, we are collecting now all wishes, which are posted in this workshop - forum.
But first we have to find a way to fix some bugs in the modul, to get it stabel for 1.6.
We will have a intensive discussion in the (near) future, because everybody who testes this modul AND was able to use it, becomes a workshop - fan.
We need a modul which should be handsome and mighty ...
We've started working on a way to provide a peer review tool, based on the one that Virginia Tech wrote as discussed here:
The VT tool has some nice features: the rubric interface works with the quiz question interface, it has a pretty straightforward interface, and is set up to allow reviewing of any activity or resource in the course (though this has to be implemented by extending a class in the code).
Anyway, below are my review and design notes, with Dr. Eschenbach's criteria in bullets:
LMS Project Manager
Virginia Tech Moodle Peer Review Module Report & Development Proposal
Last week I tested, debugged, and reviewed the Peer Review module from Virginia Tech. It had a few bugs that needed recoding and I made one of the interface changes suggested by the original authors.
Unfortunately it is built to work with a newer version of the assignment module than the one we are using on the current main HSU Moodle installation, so we will not be able to run it on the main installation until we upgrade the assignment module this summer.
I set it up on our test installation, and we could copy the course list and send the students over to the new installation if you would like to try using it for a current course. The first required change as outlined below would be to
Measured against Dr. Eschenbachs criteria, the module meets the criteria below:
- Faculty member builds a questionnaire for each student to complete.
- The questionnaire has text boxes and/or numerical responses for students to complete.
Students can also send a file back to the reviewed student, either with or in lieu of the rubric.
- Each student has to review a subset of students in the class, perhaps including self.
- All peer reviews of a single student's work are added together randomly and anonymously in a single document that is made accessible to the student after faculty review.
It does not meet these two requirements:
- If possible, simple stats of numerical scores are provided and the student can see self assessment separately from peer assessment
Students cannot self assess and there are no overall statistics.
- Faculty can review and edit inappropriate answers
This is not supported in the current version, reviews become available as soon as students complete them.
These are the required changes for this module to meet Dr. Eschenbach original request:
1) Make it self contained (remove dependencies on assignment) OR make it an assignment plug-in. Making it self contained will make it able to run independent of assignment versions, but more importantly it will simplify the process of creating and using a peer review (as it will not require an assignment be set up first).
2) Add optional ability for instructors to control posting of reviews.
3) Add optional ability for students to self assess.
4) Make module stats available in a single page, anonymous for students and optionally anonymous for instructors.
From the VT teams list of changes:
a) Provide better feedback to instructors for new reviews regarding review status; provide intra-page navigation links to reviews received.
b) Improve email functions
c) Better comment code.
Currently it is not clear which students have been reviewed. This should be part of step 2, to show instructors a list of reviews that have been submitted.
Backup and restore code (currently rubrics are not backed up).
If folks message me I can send them a demo login.
Hi Michael, I am deeply impressed of your inputs!
As i wrote above, we will structure ideas and whishes.
The modul name is important as a signal - and i am shure we will find a name, which fits the solution.
Some uses peer-review, some peer-assessments, peer-...
Workshop WIILL NOT disappear .
How should I organice my lessons , without Workshop ?
Thanks for your input!
The problem is that a couple of students pressed the 'submit' button before they could finish writing their assignment and now there is no way they can get back in to complete what they had started. The submission dates were extended to see whether that would allow them to go back in but to no avail. Is there any way to delete the "attempt", as you can do with the quiz module, for instance and allow the user to start afresh?
- you may give them the oportunity of multiple tries - but this will change the grading strategy
- if you delete the assiggnment - there will be a second change - BUT if the peer-review has been completet - WITH no content - you will loose this information from the other students ...
BUT in the new modul, which will be available until summer - THIS wil be fixed!
>if you delete the assiggnment - there will be a second change - BUT if the
>peer-review has been completet - WITH no content - you will loose this
>information from the other students ...
OK, you mean I will loose the peer evaluations submitted for those particular assignments, I suppose. NOT the evaluations submitted for the rest of the asignments, right?
Thats right, BUT I am not shure, if students who have done their reviews will get then another review. They will loose their work - this will be corrected in futur!
Looking forward to seeing new developments in this module.