Quality Assessment Framework for E-Learning Systems: A Software Perspective

Dear Sir/Madam,
The development of Quality Assessment Framework for E-learning Systems (Software Aspect)
for the Higher Education Institutions of Pakistan has been discussed in focus groups. As a result
of this discussion an exhausted list of quality factors based on Systematic Literature Review is
formulated.Now it is required to sort out this exhausted list of quality factors by selecting the
best suited factors according to the requirements of Higher Educational Institutions of Pakistani.
You are humbly requested to give your comments based on your experience by marking Not
Crucial (=1)toMost Crucial (=5)mentioning that which quality factor is essential for the said
quality assessment framework for the localized environment of Pakistan. Moreover, if you feel
that any quality factor(s)/characteristic(s)are missing, please feel free to add that factor at the end
of the list. Scale values assigned to each of the five responses areas;
Level of Agreement
Most Crucial (MC)
Crucial(C)
Normal (N)
Least Crucial (LC)
Not Crucial (NC)

Scale Values
5
4
3
2
1

Thanks a lot for your kind attention and time.

ShahidFarid,
Ph.D. Candidate,
Faculty of Computer Science & I.T.,
University of Malaya, Kuala Lumpur,
Malaysia.
HP: +6017-3960540, +92-333-3298877
shahidfarid@bzu.edu.pk

Demographics
Date: _______________
Name (optional)
Imran Afzal

Designation
Asstt: System Programmer

Place: _________________
Organization (optional)
Allama Iqbal Open University
1

_____________________
Gender:
Male
Female

Qualification
Bachelor
Master
Doctorate

Focal Person Data Center

Focal Person Telco Services
Age:

_____________________
Area of expertise:

30 to 40
41 to 50
51 o 60
Over 60

Academia
Research
Software Development
Administration
Experience:
Less than 5 years
5 to 10 years
More than 10 years

List of Quality Characteristics For E-Learning System

1. Educational Perspective

Characteristics
a) Content/Instructional Design
Specifying e-learning modules into learning objects (LOs) with corresponding
instructional strategy.
1
2
3
4
5

b) Delivery
Course delivery to learners by mean of some Learning Management System (LMS)
like blackboard, MOODLE etc.
1
2
3
4
5

c) Evaluation
Ability of the institution to evaluate various aspects of its desired output.
1
2
3
4
5

d) Instructor/Faculty
Faculty feels satisfaction and happiness with teaching online.
1
2
3
4
5

e) Institution
Current situation of the institution/organization to determine its readiness for elearning adoption/implementation.
1
2
3
4
5

f) Administration
Plan and manage the execution of e-learning systems.
1
2
3
4
5

g) Learner
Learners are successful with e-learning and are typically pleased with their
experiences.
1
2
3
4
5

h) Cost
i.
Learners cost-benefit.
ii.
Institutions continuously improve services while reducing cost.
1
2
3
4
5

i) Access
All learners who wish to learn online have the opportunity and can achieve success.
1
2
3
4
5

j) Learning activities
Activities related to pedagogy in an e-learning environment.
1
2
3
4
5

k) Personalization
The capability of the learning platform to accommodate learners settings.
1
2
3
4
5

l) Services
The tools that involve in facilitating and supporting learners during the navigation
through the system.

2. Software Perspective

a) Accessibility

The degree to which an e-learning system is accessible to as many people as possible.

1
2
3
4
5

b) Availability
Is the system ready to carry its tasks when learner needs it to be, i.e. is the system is
available and operational for use to the learners?
1
2
3
4
5

c) Capability
Can the product perform valuable functions like completeness, accuracy etc.?
1
2
3
4
5

d) Conformance
System complies with portability standards.
1
2
3
4
5

e) Charisma/Look and feel

Is the system capability to glue the learners with it? Like uniqueness, attractiveness,
entrancement of the system etc.?
1
2
3
4
5

f) Efficiency
System should fulfill its purpose without wastage of resources.
1
2
3
4
5

g) Modifiability
Ability to change the product according to the requirements of learners.
1
2
3
4
5

h) Functionality
The capability of the software system to provide functions which meets the learners
need.
1
2
3
4
5

i) Maintainability
Can the product maintained and extended at low cost?
1
2
3
4
5

j) Portability
Transferring of system to another environment.
1
2
3
4
5

k) Reliability
Ability of the system not to go failed while running and to work as per requirement.
(Can we trust the system in many and difficult situations?)
1
2
3
4
5

l) Security
Does the e-learning system protect against unwanted access (like authentication,
authorization etc.) while still providing the access to people and/or systems that are
authorized?
1
2
3
4
5

3. Miscellaneous
a) Domain Related

Contents relevancy, granularity, course organization, course depth and breadth etc.
1
2
3
4
5

b) Emotional Intelligence
Emotions or feelings of learner after using the system, e.g a learner is relax, happy or
annoyed (emotions) after interacting with the e-learning system.

1
2
3
4
5

c) Technical Infrastructure
Establishment of technical infrastructure to commensurate with e-learning activities
like bandwidth, speed, cost of internet etc.
1
2
3
4
5

d) IT-ability
Is the e-learning product easy to install, uninstall, deploy and configure?
1
2
3
4
5

e)
1

f)

g)