I've installed the SCORM 2004 3rd Edition Test Suite from adlnet.gov and set the java version to 6 update 34 in order to perform the LMS conformance testing, but the test suite is stuck when trying to start ADL LMS Test Content Package API. No error is displayed.
Test Environment Information:
Operating System: Windows Vista - SP 1
Java Run-Time Environment: 1.4.2_14
I'm using IE10 with compatibility mode set on IE7 and these are the steps that im going:
- Start the SCORM 2004 3rd Edition Conformance Test Suite Version 1.0.2 ST in new tab next to the LMS tab
- Choose "Learning Management System (LMS) Conformance Test" and than "New LMS Conformance Test"
- Enter the LMS name, version and dev.
- Enter usernames and ids of real users from our LMS that are enrolled as students in previously created course named "SCORM 2004 ADL test course"
- Signed in as the first user I entered in the Test Suite and started the ADL LMS Test Content Package API.
- The ADL LMS Test Content Package API was launched in the Test Suite. The last message the Test Suite displayed was "Start ADL LMS Test Content Package API".
I have waited for 10 minutes but nothing happened even if I open the course and start clicking on the first chapter.
Since this scenario didn't work I tried to do the test without prior creating a course. But the result was the same and no course was created (if that was needed).
Note that I'm using the steps described in the readme file provided with the test suite and I've maid all the changes needed in the Java plugin and in the browser.
Also tried in windows XP and 7 with virtualmachine and with live LMS and LMS in my local machine.
The live LMS is hosted on Ubuntu with postgresql and my local is on Windows with mysql.
So I've tried pretty much with everything and I have no idea what am I doing wrong.
Does anyone knows how the SCORM 2004 3rd Edition Test Suite works and what am I missing here?
Hi Aleksandar,
give http://docs.moodle.org/dev/SCORM_Test_Harness#ADL_2004_Tests a read to verify if everything has been correctly setup: from your description above it seems yes.
It's probably an issue with the Java environment since the Test Suite connects to the Course hosted into the LMS - here Moodle - via Java too. You could activate the debugging at the DEVELOPER level as well as the API logging to see if Moodle tools could help in identify where the Suite stops to work.
BTW, Moodle has discontinued the improvements required to fully support SCORM 2004 so expect to see several failure in testing sequencing rules when the suite will run.
HTH,
Matteo
Tnx Matteo, I have activated the debugging mode and API debug mode in scorm module and no errors were found.
I suspect that the LMS is not properly connecting with the Test Suite... The Java Plugin starts but there is no sign that indicates that the Test Suite and the LMS are connected.
When the api package is started, in browser console only shows this error:
SCRIPT438: Object doesn't support property or method 'evalID'
lmsrtefunctions.js, line 200 character 4
btw I've tried with different versions of Java, different versions of IE, Firefox even and different computer and the result is the same.
Hi Aleksandar,
you didn't mention the JS issue before.
Spare time permitted I'll try to replicate it - var result = LMSDriver.evalID( query1 + "!" + query2 ); - : never heard of an issue like yours, I've always used an XP machine for the Suite(s).
HTH,
Matteo
Setting up an environment to run the test suites is a real pain - I've recently blown away the machine I had set up for running the 2004 test packages myself - I'd advise you not to use the files hosted in Mayanks git repo and to get the files directly from ADL. (which is sounds like you have anyway)
I'd also suggest running them under an XP image - I haven't tried running them under Vista (although I did have them running on a Win 2K3 machine at one point.)
The Java version and browser versions are also very important - I'd avoid compatibility mode stuff and use the real browser versions that it supports.
When installing the test suite you should use all default settings - don't move or relocate the files - I'd suggest starting over from scratch with a fresh XP install running an early version of IE - then follow each item in the readme exactly.
I'm also curious - what are your reasons for wanting to get this going? - are you using Moodle or some other LMS?
Tnx for your replies, I solved the problem
Since everything was correctly configured, I've opened Java console and I had this errors:
Exception in thread "Thread-10" java.security.AccessControlException: access denied (java.net.SocketPermission 192.168.131.65:80 connect,resolve)
at java.security.AccessControlContext.checkPermission (Unknown Source)
at java.security.AccessController.checkPermission(Unk nown Source)
at java.lang.SecurityManager.checkPermission(Unknown Source)
at java.lang.SecurityManager.checkConnect(Unknown Source)
at java.net.Socket.connect(Unknown Source)
at sun.net.NetworkClient.doConnect(Unknown Source)
at sun.net.www.http.HttpClient.openServer(Unknown Source)
at sun.net.www.http.HttpClient.openServer(Unknown Source)
at sun.net.www.http.HttpClient.<init>(Unknown Source)
at sun.net.www.http.HttpClient.New(Unknown Source)
at sun.net.www.http.HttpClient.New(Unknown Source)
at sun.net.www.protocol.http.HttpURLConnection.getNew HttpClient(Unknown Source)
at sun.net.www.protocol.http.HttpURLConnection.plainC onnect(Unknown Source)
at sun.net.www.protocol.http.HttpURLConnection.connec t(Unknown Source)
at sun.net.www.protocol.http.HttpURLConnection.getInp utStream(Unknown Source)
at java.net.URL.openStream(Unknown Source)
so I've modified the java.policy file in C:\Program Files\Java\jre6\lib\security by adding:
permission java.security.AllPermission;
after
grant {
and changed
permission java.net.SocketPermission "localhost:1024-", "listen";
to
permission java.net.SocketPermission "localhost:80-", "listen";
restart computer and everything is ok
I needed to get this working because I have some SCORM 2004 packages for my Moodle LMS v2.4 and I noticed that the embedded navigation (not the small moodle popup) isn't working as it should.
So I've managed to get the navigation to work by some point and now I want to test for other related problems, I know that there are many unresolved problems but I'll be happy if I can contribute somehow by resolving some of them.
Hi Aleksandar,
thanks for sharing your solution!
Matteo
yup, no problem, I'm glad if I can help
now after few javascript fixes in the scorm module, some test packages passed, but when I'm testing some autoamated tests like LMSTestPackage MS-01, my browser freezes and in java console im getting this:
Java Plug-in 1.6.0_45
Using JRE version 1.6.0_45-b06 Java HotSpot(TM) Client VM
User home directory = C:\Documents and Settings\Aleksandar
Exception in thread "Thread-11" java.lang.ArrayIndexOutOfBoundsException: 0
at org.adl.testsuite.rte.lms.comm.LMSTestMessageManager.receiveMessage(Unknown Source)
at org.adl.testsuite.rte.lms.util.LMSSocketThread.listen(Unknown Source)
at org.adl.testsuite.rte.lms.comm.LMSServerSocketImpl$Server.run(Unknown Source)
the same happens with:
Java Plug-in 1.5.0_22
Using JRE version 1.5.0_22 Java HotSpot(TM) Client VM
but the thread was "Thread-6", so I updated the java and now I'm getting the error from above
Can you help me?
Hi Aleksandar,
it sounds like an incorrect response from Moodle or a bug in the Test Suite (!): in these cases you should configure the API logging of SCORM Activity so you could be able to find a relation between the error and the response that Moodle gives to an API request.
Configuring debugging at DEVELOPER level will help to find issues in the Moodle code too.
Matteo