Feedback on the Teaching With Moodle MOOC

Feedback on the Teaching With Moodle MOOC

by Andrew Davis -
Number of replies: 15

Spent some time last night having a closer look at week 1 of the mooc and have some feedback. Take or disregard as you see fit smile

If anyone else is participating in the course and has any thoughts feel free to post here.

Consider moving the videos to the top of the book pages. See https://learn.moodle.net/mod/book/view.php?id=28060&chapterid=4065
My train of though was basically "ok, finding your way around. urgh, wall of text. This desperately needs screen shots or something.... reading... re-reading... oh wait, there is a video! I read for nothing!!"

On my laptop the video was not on screen until I scrolled down. Even if it was onscreen as we have these lovely videos that walk the student through and show as well as tell we should probably push the videos to the fore.

Also, the first page of the setting up your course book is explaining extremely basic things like the navigation bar but we don't explain how to move through a book activity. Maybe a note at the bottom of the page would be helpful. Not sure if there are sufficient analytics to determine if people are getting stuck here but I wouldn't be surprised if first time Moodle users weren't sure what to do.

I am not clear on the value of the week 1 survey (https://learn.moodle.net/mod/survey/view.php?id=28065) The stated reason seems tenuous"This is designed to help you reflect on your participation as a learner in the course." Is it just to introduce the survey module? If so we should probably provide an intro "this is the survey module. this is what you might use it for."

Given that the quiz (https://learn.moodle.net/mod/quiz/view.php?id=28066) is introducing the quiz module for the first time it could possibly also do with a blurb about the quiz module similar to the survey module.

Average of ratings: -
In reply to Andrew Davis

Re: Feedback on the Teaching With Moodle MOOC

by Mary Cooch (personal account) -
Picture of Documentation writers Picture of Testers

Thanks Andrew for your excellent feedback - more to come I hopesmile 

Just for anyone who might have missed this, Moodle HQ is running a free MOOC on the basics of teaching with Moodle for non-technical types (like me) and you can still join here: Learn Moodle We are just at the end of the first week (of 4)

To respond to your points:

  • Interesting thought about moving the videos to the top of the pages. As a text person myself, I first thought of text and I didn't want people to think there was only a video (and not scroll down to the text) so I guess I did/thought the opposite of what occurred to you! Based on your comment,s I think if we run the MOOC again -which we do hope to do - I will use a short intro paragraph at the start, mentioning there is more text underneath the video - a sort of compromise.
  • I haven't heard from anyone stuck with navigating through the book yet, but it is something I can mention in the live launch in a possible rerun of the MOOC. I mention the books with their text and videos so I could add a slide to explain how to move from one page to another - or, as you say, add a note at the bottom of the pages.
  • In terms of the survey and the quiz, we had a long discussion before the first MOOC in 2013 about how much information to give new participants about what activity they were doing and why. Initially we added extra explanatory text about each activity but it was felt it was too much - information overload - and so we settled instead for identifying each activity in the title (Quiz: Week 1 or Choice: Previous experience with Moodle) on the understanding that if people watched the live sessions or went through the video tutorials or text they would find out what these words (Quiz/Choice) meant in Moodle. 


Average of ratings: Useful (1)
In reply to Andrew Davis

Re: Feedback on the Teaching With Moodle MOOC

by Samantha Gartner -
Picture of Moodle HQ

Andrew, I tend to agree with your point on the value of the quiz for week 1. However, the quiz content for week 1 was excellent and very relevant to Moodle. 

Mary, perhaps for the next MOOC we can draft content about how people found out about Learn Moodle, if they are aware of certain Moodle services, Moodle Partners and social networks - using the opportunity for market research. 

Average of ratings: Useful (1)
In reply to Andrew Davis

Re: Feedback on the Teaching With Moodle MOOC

by Visvanath Ratnaweera -
Picture of Particularly helpful Moodlers Picture of Translators
Feedback from the first iteration: "Your thoughts on the Learn Moodle 'Teaching with Moodle' course" https://moodle.org/mod/forum/discuss.php?d=240593 in the Moodle community sites forum https://moodle.org/mod/forum/view.php?id=7135.
In reply to Visvanath Ratnaweera

Re: Feedback on the Teaching With Moodle MOOC

by dawn alderson -

Hi,

Visvanath, thanks for the post/prompt.  Those Google links are old work- in- progress, the final paper is, has been, with a journal for review. 

The outcomes from the research study entitled  

What pedagogy and learning opportunities manifest in the Teaching with Moodle MOOC? A case study


was presented at the ALT conference during 2014 and was well received.  In addition, the findings and methodology were shared during a MOOC that was led by Dr, Nellie Deutsch, again in 2014, and well received.  

So, overall, the research was well worth doing in order to disseminate best practice and ideas about micro-event analysis and the affordances of moodle, when used as a learning platform within a MOOC. That said, the sample was small.  Too small for publication, upon reflection.

We did well to get the work out there, given I did not join the MOOC until week 3ish combined with the fact I needed to navigate the scene as a newbie.  We were led to believe there were no more MOOCs on the cards and so the work was shelved, and as a consequence other research projects/pubs have taken prominence across 2014.

My feeling, in order to move forward, might be to add a quant data set to what we have in order to look at impact...so some pre- and post-data sets, combine that with the qual data we have already, which can be built upon with a fresh focus group of participants- as before....so working deductively with the qual side of things.   

If there is anyone able to let me know what I can access in terms of available data sets (i.e. I am unclear about the use of survey mentioned in this thread, for example) and tis do-able we may have a paper in the making that is worth pub.  Of course, dissemination can also include conference and other arenas.

I am coding for a project at the mo about Twitter, and I have a paper that needs writing -up for another project-as soon as poss for a Feb sub, thus I won't be able to enrol on the MOOC, this time around.

thanks

Dawn       



In reply to Andrew Davis

Re: Feedback on the Teaching With Moodle MOOC

by Andrew Davis -

My thoughts on week 2 to integrate or disregard according to your own judgement smile


https://learn.moodle.net/mod/page/view.php?id=28068
The 40 minute video seems a bit much. Although it wasn't a self paced course when I did it this course (https://www.coursera.org/learn/calculus1/outline) takes a different approach that I really like. Most videos are in the 3-10 minute range and are all about a single topic.

Multiple short videos means that the student can easily refer back to a particular video instead of trying to finding a point within a long video, its easy for me to know where I am up to if I have to shut down my computer and come back another day and I get a small "task complete" emotional pay off by finishing a video and having multiple small videos lets me get that more often.

Given all that consider splitting out and pre-recording specific videos about individual topics being covered while reducing the live component. The scripted portions don't need to be live while Q&A does. Perhaps each week release the new week's pre-recorded videos and then, a few days later, do a live session that is solely to answer questions.

In "Book: How can I help my learners learn?" (https://learn.moodle.net/mod/book/view.php?id=28069&chapterid=4080) perhaps the glossary and the filter pages should be last. It feels slightly odd to be going through the activity types and to take a side trip to learn about filters before returning to activities.

Perhaps the activity description for https://learn.moodle.net/mod/glossary/view.php?id=28070 should explicitly mention that these terms will be automatically turned into links anywhere else they appear by the glossary filter. This was stated in the book activity but may bear repeating.

I don't believe the glossary video actually showed the glossary filter working. I am harping on about the glossary filter a bit but its something that doesn't make much sense until you see it work and then it becomes obvious.

I am really confident that I did the week 1 quiz but now it is saying that I have not done it. Maybe I just spaced out and shut the browser before finishing it or something. Has anyone else reported problems?

Average of ratings: Useful (1)
In reply to Andrew Davis

Re: Feedback on the Teaching With Moodle MOOC

by Mary Cooch (personal account) -
Picture of Documentation writers Picture of Testers

This is some great feedback Andrew; thankyou!

  • Fair point about the length of the live session - in fact, you don't actually have to watch the video as the tasks are outlined below, but I suppose people feel obliged to, and the explanation of what is coming up in the week is there (but could be added separately) Another reason for doing a live session is because - well - people like live sessions and the ability to ask questions in real time. But you've given  us food for thought for the next time around, certainly about the tutorial   (is that what you meant by "scripted"? It's not scripted but it is prepared, yes) versus the Live Q and A.
  • We can add a  mention in the glossary description about auto-linking. In fact we didn't turn on auto-linking until the week the glossary activity was part of the learning, and Helen and I are discussing limiting auto-linking to specific areas of the course. For example I have already switched it off in the Introduce yourself forum as complete newbies might be very confused by it the first time they encounter it. It is also turned off in the quizzes.
  • Re the Week 1 quiz not being marked complete, it says it is "still in progress" - did you definitely save and submit? What happens if you go back to it, continue and save and submit now? Something we need to clarify...
In reply to Andrew Davis

Re: Feedback on the Teaching With Moodle MOOC

by dawn alderson -

Good Morning Andrew,

Hope you are looking forward to week 3 of the MOOC.

You have included some very interesting evaluations there, thanks for that.

When you say: The scripted portions don't need to be live while Q&A does.

This reminds me of a large lecture I used to run with 100 odd students....50 Early Years/KS1 trainee Teachers and 50 KS2.  It was a generic lecture...for the PGCE course, called Educational Professional Studies (EPS).  Anyway, the notion of 'script' was often discussed in view of the 5 Ps -I used to use as a sort of mantra in my own practice and share with the students:

-planning.....what is going to be covered/how?

-prep.....what do I need?

-pitch.....what level of accessibility do I need to consider?

-pace........how can I keep my audience awake?

-plenary.....consolidate the headlines of the session

We generally came to the conclusion at the end of every session....and I did many sessions with a high number of diff cohorts, so lots of ideas and connections with their developing practices; in having a script it was suggested to be pointless, instead flexibility, listening to your learners, going off script so, some of the planning/prep stuff might not be used...as in a handout anyway-highlighted elsewhere- which leaves the 'performance' to include an attempt to connect with the learner, reflecting a relaxed stance, sometimes with humour.  It was often considered that an ability to laugh at one's self was essential, because learners love it when things don't go to plan; can be an aid memoir for the subject knowledge, and of course there were many other things too that the students found interesting in evaluating their practices for reflective activity in order to inform the next session in their teaching.     

Dawn

In reply to dawn alderson

Re: Feedback on the Teaching With Moodle MOOC

by dawn alderson -

Have managed to sign up for this afterall.....lovely stuff going on eh.

Really great sense of community in receiving an update email from Helen....

re: After three weeks we now have over 4900 Teaching with Moodle participants (up 300 from last week)

Superb!

D

In reply to Andrew Davis

Re: Feedback on the Teaching With Moodle MOOC

by Emma Buzza -

Great Feedback Andrew. I agree with many of your points:

  • I too found it frustrating to find that the text was repetitive of the video content - the videos were a good length (about 3mins) so just a text intro to the video and links to additional resources would have sufficed (I started to ignore the text after a while)
  • The live recordings were way too long. Maybe edit them into several chunks for future course iterations? ie housekeeping/ course requirements, content topic 1, content topic 2, Q&A, showcase
  • There was no feedback, and therefore little value, on the survey activities. Were they just a demo? What happens to the data?

Overall I thought the course was well run, and I liked several of the features:

  • The facilitators maintained a helpful and friendly presence
  • The completion boxes were a really helpful way to keep track of progress
  • The books were an effective method to contain content and media
  • The demonstration videos were short and sweet, and appropriate for just in time learning
  • I liked that the activities were made fun and not too difficult - we were able to focus on the learning objective of the feature use itself - not get stuck on the contribution content
  • I loved the opportunity to interact with users from around the globe, and consider Moodle functionality for various purposes

My main feedback for future versions of the course is to consider the needs of the cohort of your learners foremost in mind when designing the course. The course is predominantly full of busy professionals trying to learn Moodle in addition to their work responsibilities, and the course is a large commitment (way more than the 2-3 hours per week advertised).  By enrolling in this course they have demonstrated that they are the future champions for Moodle in their organisations, and they deserve a positive outcome for their efforts.

Videos need to be short, the course content should allow for an extended self-paced option (within reason), assessment deadlines (actual dates) need to be stated /emphasised in week 1 (not announced a few days prior to submission), and the course completion should not be hinged on a single time limited activity with no alternative option to demonstrate learning.

Very disappointing that participants that had put so many hours in to complete every other activity were locked out of the week 3 workshop activity based on a deadline, and therefore had no alternative way to complete the course - completion rates must have been impacted - and I feel for those that joined the course late and would not have been aware that they had no chance of completing (see above 300+ in week 3!). If an assessed activity results in pass/fail of a course, the learning objective should be reflective of the critical skills required. Eg in teaching a Moodle course, I would have thought things like participation in forums, setting up profiles, setting up topics and adding content, manually enrolling users, and generating activity reports would have been crucial skills teachers would need to master as a minimum - workshops are an advanced feature for many Moodle users.


Average of ratings: Useful (2)
In reply to Emma Buzza

Re: Feedback on the Teaching With Moodle MOOC

by dawn alderson -

Morning Emma,

I enjoyed reading your feedback, I think you have been very helpful.  

I know there is another MOOC planned for August 9th, therefore I am able to make time across my schedule, to read a plan of action for movement forward in terms of improvements for that course.

I offer my expertise, and I hope it is received in the way in which it is meant, that is, as a critical friend/mentor/colleague.

all good wishes

Dawn    

In reply to dawn alderson

Re: Feedback on the Teaching With Moodle MOOC

by Emma Buzza -

Thankyou. I hope the feedback is taken in the good spirit in which it is offered.....as a champion and advocate for Moodle use, I want to see people succeed in their Moodling. smile

In reply to Emma Buzza

Re: Feedback on the Teaching With Moodle MOOC

by Mary Cooch (personal account) -
Picture of Documentation writers Picture of Testers

Thankyou Emma for your valuable feedback and insight from a participant's viewpoint. (I also have feedback from a facilitator's viewpoint so I hope I get the time to post about that myself too smile )

I will take on board Andrew's and your suggestion about the text in the Books and we certainly will reconsider the format and length of the  live sessions and the needs of the targetted learners. We plan to run the course on a regular basis and so can be adapting it, honing it each time.

We set a workshop activity for two reasons: (1) because we wanted participants to see the potential of Moodle  and be inspired to explore it further (we did not expect participants to be setting up their own workshops) and (2) because we wanted to demonstrate how deadline are used in Moodle. Participants could start the workshop on Sunday 25th January and although the submission deadline was Friday 30th January, we allowed late entries until  Wednesday 4th February. Although a deadline was mentioned in the course overview and was stated both in the workshop description itself and in the calendar, and in our twice weekly noticeboard emails, you make an excellent point about emphasising this more. Next time we will make sure to mention the deadline during the first week and also start the workshop earlier so participants have more than the eleven days we did give them. We'll also ensure anyone joining from the third week onwards is made aware of the deadline in the course welcome message. (I did reply to some Introduce yourself posts with a reminder about it but one thing I have learned is that you can  never make things too clear smile )


In reply to Mary Cooch (personal account)

Re: Feedback on the Teaching With Moodle MOOC

by Emma Buzza -

Thanks Mary,  your ability to be responsive to over 4000 participants was inspirational! 

I think another reason why the deadline was so jarring was that students tend to fall into a bit of a routine with a way in which a course is run. If there were time limited assessments every week, we would have integrated them into the week as a priority.....as it was, nothing else was time limited. It has been interesting to be taking a participant perspective for a change smile

Having said that - I am looking forward to hearing about some of the challenges and learnings of running a MOOC from a facilitator POV.