There are many things to consider in evaluating existing e-learning course ware.
The following brief outline provides some points to consider based on sound adult and online learning research and practical experience of what works.
You might use this when you are evaluating course samples provided by custom content vendors or perhaps evaluating existing off-the-shelf courses.
Engagement - Does the course gain and maintain the attention of learners?
Why? - The first step in the learning process (based on human memory theory) is attention. Without gaining and maintaining the attention of learners, learners will not process the content and therefore will not recall the content (learn).
Multimedia - Does the course use multiple media types (audio, text, animation etc)?
Why? - While multimedia by itself will not necessarily improve learning it is important to make the most of the delivery medium. Audio, animations, text, images and perhaps video can be used to effectively convey information, assist learning and reduce boredom leading to maximum engagement (above).
Practice - Does the course require the learner to actually practice the key skills?
Why? - A lot of courses include "navigational-type" interactions such as "hover and show" and "click and reveal" etc but this is not requiring the learner to practice the content. Without practice there is no learning.
Linkages - Does the course require the learner to think about their current knowledge, skills and workplace and draw linkages with the course?
Why? - It is all well and good to gain and maintain learners' attention and require learners to practice content but if they can't recall it back on the job, then learning transfer has not occurred and the activity was meaningless. The concept of linkages aids this retrieval process.
Retrieval - Does the course provide tools to assist retrieval when back on the job?
Why? - As above, learners need to be provided with tools or triggers to help them apply the content back on the job.
Personalization - Does the course content look and feel "personal" as opposed to dry and structured?+
Why? - Studies have shown that learners do learn more from personalized courses (human audio vs. computerized audio for example). And this makes sense - people prefer to be dealing with a person than a computer so simulating this as much as possible is a good thing. This is also where the use of characters can be good.
Content - Is there limited text and decorative graphics and more legitimate interaction?
Why? - Decorative graphics serve a design purpose only - they don't help learning. Not to say they should be avoided but legitimate interaction should be maximized. Also consider that people read 30% slower on screen so pages and pages of reading is a strain. Overuse of decorative graphics and lots of text are both indicators of limited practice (as above) and therefore limited learning.
Navigation - Is course navigation simple, intuitive and consistent?
Why? - There is nothing more frustrating than moving through a course that is difficult to navigate. A frustrated learner gets bored, agitated and possibly leaves. There is no learning occurring when this happens.
Motivation - Does the course contain tools to motivate learners?
Why? - Learning without an instructor up the front telling you what to do requires discipline and motivation. Anything the course can do to assist motivation (on screen coaches, rewarding feedback etc) therefore helps maintain attention and increases learning.
Its hard to expect a course to do all of these things and also remember that each course is developed for a particular client filling a particular need. However it is a good idea when looking at a course to review it in a structured manner rather than just have a quick look.