Feature for creating custom reports (was Wanted: New feature ideas for GSOC projects)

Feature for creating custom reports (was Wanted: New feature ideas for GSOC projects)

A. T. Wyatt發表於
Number of replies: 27
I would like to see a series of useful reports for admins and instructors. There are a variety of requests that have been made in the forums, so it would be wonderful to have a set of one click reports to provide all kinds of data in csv format.

atw
評比平均分數:Useful (2)
In reply to A. T. Wyatt

Re: Wanted: New feature ideas for GSOC projects

Matt Campbell發表於
How about the ability to create custom reports, import and export them? With the SQL mapped so you could just drag and drop elements, like you would with a report model using something like Microsoft Report Builder.

Thanks,
Matt
In reply to A. T. Wyatt

Re: Wanted: New feature ideas for GSOC projects

Tim Hunt發表於
Core developers的相片 Documentation writers的相片 Particularly helpful Moodlers的相片 Peer reviewers的相片 Plugin developers的相片
Saying 'a variety of requests that have been made in the forums' is not very helpful. What, specifically, would you like. And if they are good ideas, whey are they not in the tracker, with lots of votes for them?
In reply to Tim Hunt

Re: Wanted: New feature ideas for GSOC projects

A. T. Wyatt發表於
I wasn't sure that details were warranted at this point in the conversation, but there are quite a few good reports already in the modules and plugins database if you filter by admin reports (and you created quite a few of them!)

For example, we would very much love to have a report that captured the course shortname, longname, instructor(s), and the course ID number.

Or to be able to export a list for each course similar to the listing you get when you restore a course--number of resources (by type), activities, quizzes, assignments, etc. If I could get that across my whole server, I could do some interesting longitudinal analysis of the type of content and activities we were delivering through electronic means.

I would like to be able to export the site level course overview reports, and get the data for more than 4 weeks at a time. Or to get information for more than one course at a time in the statistics reports. We can export the logs of different kinds, but I don't think you can export other types of site admin reports.

I would also like to be able to aggregate performance data on outcomes across multiple courses. This would really help with a variety of assessment tasks.

I am sure we can all come up with other examples when the time comes! But I really like Matt's idea about having an interface where you could create your own report. That would be the very best idea, because everyone will have different needs at different times.

atw
In reply to A. T. Wyatt

Re: Wanted: New feature ideas for GSOC projects

Martin Dougiamas發表於
Core developers的相片 Documentation writers的相片 Moodle HQ的相片 Particularly helpful Moodlers的相片 Plugin developers的相片 Testers的相片
Perhaps it would best to think about this in terms of a generic report generator ... I think there's some open source ones around and one could be customised for Moodle, or a Moodle plugin would communicate directly to an external one.

Of course finding the best one to start with would be part of the project 微笑

Some examples of report generators :
Ah, I just saw Matt's post ... yes, exactly.


In reply to A. T. Wyatt

Re: Feature for creating custom reports

Helen Foster發表於
Core developers的相片 Documentation writers的相片 Moodle HQ的相片 Particularly helpful Moodlers的相片 Plugin developers的相片 Testers的相片 Translators的相片
atw, thanks for your idea of having an interface for creating custom reports. It would be great if you could create an issue for it in the tracker, then everyone can vote for it to be implemented.
In reply to Helen Foster

Re: Feature for creating custom reports

A. T. Wyatt發表於
Done, Helen! http://tracker.moodle.org/browse/MDL-18323

@MD--Thanks for these links. I really did not know much about these tools, so now I will go check them out!

atw
In reply to A. T. Wyatt

Re: Feature for creating custom reports

Matt Campbell發表於
Voted and commented.

Another consideration would be scheduling - I've built a report and it's available, how about a way to say "Send me the previous month's worth of data on the first of every month"?

Thanks,
Matt
In reply to Matt Campbell

Re: Feature for creating custom reports

Sharon Goodson發表於
Voted!!
In reply to Sharon Goodson

Re: Feature for creating custom reports

Helen Foster發表於
Core developers的相片 Documentation writers的相片 Moodle HQ的相片 Particularly helpful Moodlers的相片 Plugin developers的相片 Testers的相片 Translators的相片
Thanks everyone, 'Custom report generator' is now included in the Projects for new developers list.
評比平均分數:Useful (1)
In reply to Helen Foster

Re: Feature for creating custom reports

Nikhil Mishra發表於
Possible Integration with existing report generation framework like phpreport or jasper.

Among all different Flavors , Jasper is very rich and flexible for generation and exporting reports in different formats. of course open source.

Adding to it, Jasper has very good rendering engine so One can have all weird nice looking graphs,histograms and charts approve


Do we need to reinvent d wheel ? thoughtful or just integrate moodle with jasper ... ?

It would be worth doing cos much of hardwork already done i.e Thnx to developers of PHP-Java Bridge.


So all boils down to give a flexible and extensible Interface so that users can exploit power of both.


Comments Insanely invited


In reply to Helen Foster

Re: Feature for creating custom reports

José Cedeño發表於
I'm a student interested in helping with this project idea for the Google Summer of Code. Is help still needed or are people going to be using the service of the Moodle partner as described in a comment below?

Thanks
In reply to José Cedeño

Re: Feature for creating custom reports

Dan Marsden發表於
Core developers的相片 Particularly helpful Moodlers的相片 Peer reviewers的相片 Plugin developers的相片 Plugins guardians的相片 Testers的相片 Translators的相片
Hi Jose,

AFAIK - the custom reporting provided by the Moodle partner Remote Learner is part of a commercial package they offer. There is still a lot of interest in an open-source custom reporting tool for Moodle. Don't forget, you can submit more than one gsoc Application if there are other projects that interest you!
In reply to A. T. Wyatt

Re: Feature for creating custom reports

Nikhil Mishra發表於

Personal Details

  • Name :- Nikhil Mishra
  • Email :-
    • mishranikhil@yahoo.com,
    • nikhil.mishra@kuliza.com,
    • mishra007in@gmail.com,
    • nikhilmishra@moodle.org
  • Other contact methods
    • Yahoo IM with id:mishranikhil@yahoo.com
    • Jabber:-nikhilmishra@jabber.org (* new)
    • CellPhone: +91-9632830680


Flow of document:-

  • Motivation
  • Research which is my background study
    • Report Genration (
      • What it is, and its parts
      • Moodle support for reports
        • Gradebook for graded items
        • Admin Reports and Scorm Reports
        • Limitation of existing support( need for Custom Interface)
    • Solution
      • Existing Tools
        • PHP Based
          • Easy Integration But less flexible and less exported formats and graphs supported
        • Java Based
          • Need Of Integration but very rich in content and support for all formats.
          • Ways Of Integration.
  • Deliverables





Motivation :

I take this opportunity to introduce myself as Nikhil currently enrolled in Final Semester of MS IT @ DAIICT.
Memories of My first submission 4 years ago on moodle are still crystal clear. Ever since I was very much excited about this elearning mammoth. I started my humble journey as Teaching Assistant by creating quizzes,forums ,wikis and podcasts and soon became a poular face for moodle related queries in campus.

Fortunately, a recent happening wherein my professor wanted to track trends of student progress in form of rich reports had left me brainstorming over custom report generation interface.Being on final semester with no course to study this semster and 6 month period free, I decide to take this issue. Luckily after some moodling and googling I found that I was not alone :- my post on Feb,20 on forum proved fruitful.The same day our post idea became issue on moodle tracker (Thanks to A.T. Wyatt ) . I have enclosed Links of forum and Tracker your kind perusal.

Encl:

1: http://moodle.org/mod/forum/discuss.php?d=116895

2: http://tracker.moodle.org/browse/MDL-18323

Research and BackGround Study :-

  • Report generation In General :-


Internals Of an Reporting Engine



What it is and Parts ?

One might wonder What Report is?

In layman’s terminology ;-"Presentation Of required data to user in required format".Data Resides in database which we acces usually by an sql statementThus Basically any report ultimately boils down to an sql to fetch given data.After above It is Presentation tier job to present in required form to user.


  • Existing Support For Reports

Moodle has very good built-in rich reports. Lets look at moodle report generation

We can divide report generation in broadly 2 parts

1) GradeBook

2) Admin Reports

3) Scorm Reports which work on Scorm repository and are based on SCORM.


So we are left with 2 option :-

Admin Reports is set of collection of built-in administrative reports.

Gradebook is very rich in term of reporting, calculating columns for graded items.

It has also support for plugin called visual for graphs and charts.


  • Limitation of existing support( need for Custom Interface)

Lets Take an example where user needs a non-administrative Reports for non-graded items ?

-> Question ultimately introduces need of custom interface for report generation


Solution


Well one might think to start with writing your self code base including whole reporting engine including layers discussed above.

The complexity will increase when we try to include most of report needs. ? The other concerns to a developer are number of export formats our solution is going to support

Adding to it, it would be more of reinventing wheel because many open source developers have developed cutting edge business intelligence and reporting tools

So we need to think in directions of integration of existing powerful tools

Existing Tools:-


Following are Existing Popular Open Source Reporting Tools:-

1) Jasper

2) BIRT

3) Pentaho :- unfortunately a Commercial open source 傷心 so cost of ownership is a point to ponder.

4) PHP Reports



We can divide above options into Jasper and BIRT in group of JAVA based Reproting tools and PHPReports as in other group of PHP based tool.


PHP Based


  • PHPReports can be easily integrated with moodle but is not as rich and flexible as other alternatives

JAVA Based

  • Support for all file formats export and Import
  • All types of Charts Posssible
  • Flexible for Custom Reports
  • But Moodle is PHP and Tools are JAVA ?

So we need to have think integrating Jasper and BIRT :-


Integration Of Java-Base Reporting Tools :-




Different Possible Architectures



In brief following are 4 ways of possible integration :-

· SOAP over HTTP via XML-RPC

· Quercus via Resin Application server

· PHP/JAVA bridge based on Java Script Reference (JSR 223)

· Simple redirection to Reporting tool and getting results i.e user directly interacts with our reporting tool. Thus 2 independent server would be running as One transparent server to user.


I have also a good background study for each of these tools which I will post in forum.


I have vison of Reporting Interface which provides Drag and Drop Facility in addition to standard SQL support.


Schedule Of Deliverables


Till April 20


Installing Moodle :- Status Completed

Learning SVN and Build system:- Completed

Setting Up SVN/CVS with moodle :- Status Completed

Setting Up Build : - Status Completed

Building A basic Block and Module:-Completed

Refining Of Problem Statement And User Requirements-Status Ongoing

Freeze on First Version Of Reporting Requirements after Feedback:- Status Ongoing


April 20- May23

Delivarable: Project Estimation Sheet with effort and hours.

Requirement Specifications,SDS,ER Diagram.Activity Diagrams

Strecth Goals : A Hello World Report.


Prepare An PERT sheet for tasks :- 3 Days

Outline Tasks for Month:-

Get Acquainted with norms of community.

Gap Analysis Of Open Source Tools For the Features.

Decide frequency Of Planned Meetings With Mentor

Freeze on Reporting TOOL.

Biweekly possibly Friday as per Mentors convenience : Re factoring Of Schedule to accomplish chages and uncertainites

Informally,I will Start Coding.


Till June 20

Delivarable:-First Live Version Of Reporting tool Open.


Tasks:-

Begin Massive coding on class diagrams as output of previous activity

Commit very 4th day to your branch and take feedbacks.

Strecth Goals for June 20 :-Create atleast 1 Theme for the same.

Create a Youtube Video for Promotion.



June 20 - To July 20:-


Deliverable :-Version two with GUI i.e including Drag and Drop for reports to be live.

Tasks:-

Send Code For MidTerm Evalutions.

Get Feedbacks and Improve Upon same

Wirte Outline Test Cases.


REST:-

Delivrable:Lots Of videos , documentation and our custom reporting interface

Tasks:-

FEEDBACK from community.

Create Context sensitive Help :- host it on moodle.org

Create You tube Video as Manual fro your s/w.

Write Blog about your experience during GSOC. 微笑

Preparing For Moodle Lounge 眨眼



My Details :-

http://placement.daiict.ac.in:8084/placement/daiict/resumes/200712014.pdf

微笑


Au revoir


MElange Betrayed me dint allow to edit my app......... ?

In reply to Nikhil Mishra

Re: Feature for creating custom reports

Abhishek kona發表於
Is this done or intended for Moodle still?

In reply to A. T. Wyatt

Re: Feature for creating custom reports (was Wanted: New feature ideas for GSOC projects)

Bryan Williams發表於
As a service from a Moodle partner company this has already been done (page 2 of PDF) and will be made available on March 23, 2009. And yes, this is GPL.smile
In reply to Bryan Williams

Re: Feature for creating custom reports (was Wanted: New feature ideas for GSOC projects)

Scott Karren發表於

Bryan

When you say that it will be available on March 23rd.  Does that mean available through the Moodle Partner or available to the community as a whole?  I for one would be very interested in installing and configuring this on my Moodle instance.

Scott Karren

In reply to Bryan Williams

Re: Feature for creating custom reports (was Wanted: New feature ideas for GSOC projects)

Scott Karren發表於

Bump.

Brian is this feature going to be made available to the Moodle community or is it only available through hosting with the Moodle partner?

Scott Karren

In reply to A. T. Wyatt

Re: Feature for creating custom reports (was Wanted: New feature ideas for GSOC projects)

kumudu harshani發表於
Hi.....
I was searching for project related to php and I just found this, then. I'm also interested in reporting.
I have done a project using grails and it also had a part for reporting, there I used the Jasper plugin, there it works absolutely fine. Hence, i could gain a more knowledge regarding reporting.
I have heard that 'Pentaho' is a rich tool do reporting and don't you think that 'pentaho ' would help to create this custom reports.

regards
kumudu
In reply to A. T. Wyatt

Re: Feature for creating custom reports (was Wanted: New feature ideas for GSOC projects)

Sehrish Abdul Malik發表於
Hi,
I am looking to work with Custom report generator, i have been using moodle in my university too. Can you plese guide me how i can get to know more about the specifications.
In reply to A. T. Wyatt

Re: Feature for creating custom reports (was Wanted: New feature ideas for GSOC projects)

Su Yuen Chin發表於
Hey guys! I came across this project while browsing around the GSoC project listings. This looks like a fun project I can contribute to as it is very similar to some reporting tools I built during my internship last summer.

I'm new to Moodle and have not seen what data would be frequently requested yet (will check it out soon!) but from the forum posts, if my understanding is right, there should be a web interface where users can filter and customize the data they want, and then have it exported as a CSV file? (along with ability to run cron jobs to generate reports on a regular basis).

Will it be useful if some of these data have visualization functionalities as well to ease the process of determining certain data sets to be exported?

E.g: User generates a chart based on some filters, tracks the trend / identify hot zones (maybe red in colour), clicks on a hot zone and retrieves data related to it, and have the data exported.

I thought it'd be quite fun if the user would be able to analyze data visually and retrieve the detailed data they need from trends / zones they observe in charts and visuals.

In reply to A. T. Wyatt

Re: Feature for creating custom reports (was Wanted: New feature ideas for GSOC projects)

Vikram Vincent發表於
Hi!
I was going through the related mails and issue tracker http://tracker.moodle.org/browse/MDL-18323 but could not find if the project is still open or completed. If it is still open or partially completed I would like to work on it as my University requires this plugin. Pointers would be appreciated. Thanks.
Vincent
In reply to Vikram Vincent

Re: Feature for creating custom reports (was Wanted: New feature ideas for GSOC projects)

Tim Hunt發表於
Core developers的相片 Documentation writers的相片 Particularly helpful Moodlers的相片 Peer reviewers的相片 Plugin developers的相片
This project never happened.

However, I made Custom SQL queries report, which is a good way to make simple reports if you know HTML.
評比平均分數:Useful (1)
In reply to Vikram Vincent

Re: Feature for creating custom reports (was Wanted: New feature ideas for GSOC projects)

Juan Leyva發表於
Core developers的相片 Moodle HQ的相片 Particularly helpful Moodlers的相片 Plugin developers的相片 Testers的相片

I have developed a custom reports block as a "spare time" project.

See this post

評比平均分數:Useful (2)