|
|
International
|
|
||||||||
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
Online instruction n = 18 |
Face-to-face instruction n = 19 |
|
|
M (SD) |
M (SD) |
Proportion
correct answers
|
Multiple choice Case
study |
4.78
(1.44) 4.11 (1.54)* |
4.21 (1.18) 2.68 (1.25) |
Note:
*indicate
t-test significant at .05 level
Figure 4: Online Group Project

Subjective
Evaluations
Table 2 shows the usability evaluation which revealed the perceived usefulness of the content, and the perceived ease of use of the system. In general, students were more satisfied with the course content rather than the tools used. Students used a Likert scale (Excellent (5) to Poor (1) to rate the content items. They rated favorably on the content items. Less than 10% of students rated the Topic Notes and Quality of exercises as poor. A similar rating pattern emerged for the online case studies. In contrast, most students rated the Navigation using bottom and links as Not useful (see also Table 3, comments on question 8). But they rated the Online study help and Online discussion page as quite useful.
Comments from the questionnaire (see Table 3) indicate that students were frustrated by the frequent server failure (see questions 2, 4, 7, 11). Also, comments on question 8 indicates that some students found the design buttoms were not user friendly. For instance, when a student responded to a message, a separate screen would appear in which the original message was no longer in view. This represents a split-attention effect (Tarmizi & Sweller, 1988; Sweller, Chandler, Tierney, & Cooper, 1990) in that students had to switch backward and forward to keep track with the original message while answering the message.
The diary sheets (see Appendix 2) were not analyzed. A number of students filled the diary sheet incorrectly. They indicated the time for doing certain activities when the computer servers were down in the campus. Note that most students lived in university hostels, and they used computers in the campus. Other students filled the type of activities but forget to include the time that they took to complete those activities.
Table 2:
Usability evaluation
|
Content Items |
Percentage Response on Rating |
||||
|
Excellent |
|
Poor |
|||
|
5 |
4 |
3 |
2 |
1 |
|
|
Topic Notes |
0 |
56 |
44 |
0 |
0 |
|
Quality of exercise |
0 |
39 |
44 |
11 |
6 |
|
Online Case Studies |
|
||||
|
1. Conceptual framework |
6 |
44 |
44 |
6 |
0 |
|
2. Design and research method |
6 |
44 |
39 |
6 |
6 |
|
3. Results |
0 |
39 |
61 |
0 |
6 |
|
4. Discussion |
6 |
39 |
39 |
17 |
6 |
|
Tools |
|
||||
|
Very useful |
|
Not useful |
|||
|
5 |
4 |
3 |
2 |
1 |
|
|
Navigation using bottom |
6 |
1 |
44 |
22 |
11 |
|
Links |
6 |
6 |
28 |
56 |
6 |
|
Online study help |
0 |
33 |
44 |
17 |
6 |
|
Online discussion page |
6 |
33 |
44 |
11 |
6 |
Table 3
|
Questions |
% Yes |
% No |
% No response |
Comments’ made |
|
1. Did you find the exercises prepared you the online discussion and the group project? |
66 |
22 |
11 |
Exercise helps understanding |
|
2. Is there sufficient learning activities in helping you to learn? |
55 |
38 |
5 |
Not enough time to do those activities; server down; too much activities |
|
3. Do you think six students in a group project is a good choice? |
83 |
16 |
0 |
We can compare ideas; prefer 4 instead of 6 |
|
4. Did you discuss the online discussion with your friends ( and group project with your group members) first before you post the message? |
61 |
33 |
5 |
No time; sometime; discuss because of server down; discussion enables me to get feedback from friends; |
|
5. Did you read all the message posted? |
77 |
22 |
0 |
I copy the message and read in hostel; can information from the message |
|
6. Did putting the learning materials online motivate the discussion between you and your friends? |
55 |
44 |
0 |
Their comments and contribution lead to more effective learning; it is not the learning materials, it’s the technology and facilities that did not motivate us; it is time consuming; add knowledge when we exchange information |
|
7. Did you download and print out the learning materials? |
72 |
27 |
0 |
To understand better;download some materials; makes my life easier because of server down,;easier for me to refer; |
|
8. Did you find the organization of the different parts of the system (topic notes, exercises, online discussion pages) clear? |
72 |
27 |
0 |
I have to turn page to page; design button is not user friendly; ; but the online discussion needs to be improved |
|
9. Would you recommend this online materials to a friend? |
44 |
44 |
11 |
It is ok if the computer and technology is working; unless UNIMAS has a good server supplier; take a long time; online materials are not user friendly; |
|
10. For you personally, what was the best thing about this online study? |
|
|
|
Online discussion ; need not attend lecture; can discuss with others; do not need to write in paper; the notes and exercises; this new method of study attract students’ interest in study; access anytime if the server is ok |
|
11. For you personally, what was the worst thing about online study? |
|
|
|
Power failure, bad server; server down, failure system |
|
12. Any other comments? |
|
|
|
Put a
user-friendly interface, make the server better; online study is good, but
the server problem make us very stressed; need sufficient time; the online
study is too near to semester examination, feel very stressed |
Table 4 presents conferencing exchanges from 24/02/00 to 02/03/00. With respect to the online case studies, apart from the Conceptual Framework, the other three (Design and Research Method, Results, and Discussion) had slightly less than 50% participants. Most messages posted were original, and the facilitator contributed almost all the replies. On examining the questionnaire (see Table 3, question 2), 77% of the students read all message posted. Table 3 also indicates that power and server failure (Table 3, questions 2, 7, 9, and 11) caused the greatest dissatisfaction among the students. Indirectly, this suggests that students did not engage much in learner-learner interaction due to the difficulty in accessing computers. Nonetheless, students probably benefited from instructor-learner interaction in that the replies provided by the lecturers helped them to compare and correct their answers. As shown in Figure 3, students (indicated by their student no. 2651 and 2436) discussed ISM survey form, and the lecturer (indicated by bhngu) supplied further information concerning the ISM survey form. Regarding the group project, students were active in posting and replying messages (see Figure 4). If computer access did not represent a problem (as mentioned above), this active learner-learner interaction among students might result in a greater number of total messages posted, and a better performance on the group project.
Table 4: Conferencing exchanges on online case studies and group
project from 24/02/00 to 02/03/00)
|
Conference |
Online Case Studies |
Group Project |
|||||
|
Conceptual framework 4 Questions |
Design and Research Method 4 Questions |
Results 2 Questions |
Discussion 2 Questions |
A |
B |
C |
|
|
No. of message posted |
83 |
39 |
23 |
19 |
17 |
18 |
4 |
|
Online Contributors |
62 |
31 |
17 |
14 |
6 |
6 |
3 |
|
% of online participants |
86 |
43 |
47 |
39 |
100 |
100 |
50 |
|
Lecturer contribution |
21 |
7 |
6 |
5 |
0 |
0 |
0 |
|
Original messages |
60 |
27 |
16 |
14 |
2 |
2 |
1 |
|
Replies |
23 |
13 |
7 |
5 |
15 |
16 |
3 |
Figure 3:
Online Discussion

Conclusion
Test results indicate that online group performed slightly better than face-to-face group on case studies only. It seems that the online group was not disadvantaged despite frequent interruptions of power and server failures in the campus. The positive online learning effect may owe to its different types of interactions (learner-content, learner-self, learner-learner and instructor-learner). This various types of learning interaction may foster a more self-oriented and group-oriented learning experience than the face-to-face instruction (Maher, 1998). As a consequence, this self-oriented and group-oriented learning experience promotes learning (especially the online case studies) more than face-to-face instruction.
In contrast, face-to-face class did not provide opportunity for every student to interact with the lecturer when the lecture was conducted. Due to nature of traditional lecture, only some students were given the opportunity to respond to the multiple choice exercises incorporated in the lecture notes. Whereas all students in online group were encouraged to participate the online discussion topics, students in face-to-face group worked in separate groups with each group discussed one tutorial topic only.
However, before UNIMAS embarks on offering online courses, more research needs to be done to ensure the quality of the online course. First, a better user friendly interface, in particular, the eliminating of split attention effect, would enhance the overall design. Second, the use of students’ names (more personalized) instead of student numbers may lead to more active group discussion. Third, if students were given a training session about online discussion forum at the beginning of the semester, this may better prepare them for a serious study later.
Also, a pretest and posttest design would better measure the gain in transfer performance. In addition, online diary sheet rather than paper-based record sheet would facilitate the instructor to monitor students’ progress more systematically. In this design, there was only one lecturer who attended to students’ online discussion, more staff would be required to cater for a larger group of students.
More importantly, technical problems such as server failures and the power failures suggest an institutional implication for online course servers. There is little point in trying to provide online courses relying on faulty delivery servers that are critical to the process. Thus, a backup server is essential to ensure the smooth delivery of the online materials.
Acknowledgement
The author thanks Elaine Guat Lien Khoo (glkhoo@fcs.unimas.my) and Roger Harris for helpful comments on earlier version of this paper.
References
Benson, R., & Rye, O. (1996). Visual reports by video: An evaluation. Distance Education, 17(1), 117-131
Berge, Z. L. (1994). Electronic Discussion Groups. Communication Education, 43(2). 102-111.
Braggett, E., Retallick, J., Tuovinen, J. E., & Wallace, A. (1995). Distance Education Project NATCAP. Report on the establishment of Telematics delivery systems in one priority cluster area in NSW. 1993-94. Wagga Wagga: Charles Sturt University.
Brown, K. M. (1996). The role of internal and external factors in the discontinuation of off-campus students. Distance Education, 17(1), 44-71.
Carr-Chellman, A., & Duchastel, P. (2000). The ideal online course. British Journal of Educational Technology, 31(3), 229-241.
Carr-Chellman, A., & Duchastel, P. (2000). The ideal online course. British Journal of Educational Technology, 31 (3), 229-241.
Catenazzi, N., & Sommaruga, L. (1999). The evaluation of the Hyper Apuntes interactive learning environment. Computers & Education, 32, 35-49
Collin, M. (2000). Comparing web, correspondence and lecture versions of a second-year non-major Biology course. British Journal of Educational Technology, 31 (1), 21-27.
Cullip. P., F. (1999). Learning pedagogical grammar. Centre for language studies, University Malaysia Sarawak.
Fischer, G. and Scharff, E. (1998). Learning technologies in support of self-directed learning. Journal of Interactive Media Education, 98 (4). Retrieved February 10, 2000 from World Wide Wed: wwww-jime.open.ac.uk/98/4.
Joblie, F. (1999). Computer assisted language learning. Centre for language studies. University Malaysia Sarawak.
Kumari, D. S. (2001). Connecting graduate students to virtual guests through asynchronous discussions –analysis of an experience. Journal of Asynchronous Learning Network, 5(2).
Lambert, T., Shepherd, J., Ngu, A., Ho, P., Whale, G., & Geissinger, H. (1996). Bridging the Gap: Computer Science meets Distance Education at UNSW. School of Computer Science and Engineering, University of New South Wales.
Liu, D., Walter, L., & Brooks, D. (1998). Delivering a chemistry course over the Internet. Journal of Chemical Education, 75 (1), 123-125.
Lockee, B. B., Moore, D. M., and Burton, J. K. (2001). Old concerns with new distance education research. Educause Quarterly 24, 2, 60-62.
Maher, E. (1998). Does the Delivery media impact student learning? A case study. Open Learning, November, 27-32
McGill, T. J., Volet, S. E., & Hobbs, V. J. (1997). Studying computer programming externally: Who succeeds? Distance Education, 18(2), 236256
Moore, M. G. (1989). Editorial: three types of interaction. The American Journal of Distance Education, 3(2), 1-6.
Moore, M. G., & Kearsley, G. (1996). Distance education. A system view. Belmont: Wadsworth.
Newton, R., Marcella, R., & Middleton, I. (1998). NetLearning: creation of an online directory of Internet learning resources. British Journal of Educational Technology, 29 (2), 173-176.
NoorShah, M. S. (2001). Overcoming communication issues (Learning from the experience of PKPG Teaching Practice website in UNIMAS). The Internet and Higher Education, Volume 4, Issues 3-4.
Papert, S. (1980). Mindstorms: Children, Computers and Powerful Ideas. New York: Basic Books.
Pearson, J. (1999). Electronic networking in initial teacher education: is a virtual faculty of education possible? Computers & Education 3, 221-238.
Philips, R., Fairholme, E., & Luca, J. (1998). Using email to improve the experience of students doing a group-based project unit. Retrieved February, 21, 2000 from World Wide Wed: http://cowan.edu.au/eddev/98case/phillips.html.
Resnick, M. (1996). Distributed Constructivism. Proc. International Conference of the Learning Sciences, Chicago, IL.
Schutte, J. G. Virtual Teaching in Higher Education: The new intellectual superhighway or just another traffic jam? Retrieved February, 2001 from http://www.csyb.edu/sociology/virexp.htm
Smith, R. C., Taylor, E. F. (1995). Teaching physics online. American Journal of Physics 63(2), 1090-1095.
Soo, S. –K., & Bonk, C. J. (1998). Interaction: What does it mean in online distance education? Paper presented at the EDDMEDIA & ED-TELECOM 98, Freiburg, Germany.
Stephenson, S. D. (1997-98). Distance Mentoring. Journal of Educational Technology System, 26(2), 181-186.
Sweller, J., & Chandler, P., Tierney, P., & Cooper, M. (1990). Cognitive load and selective attention as factors in the structuring of technical materials. Journal of Experimental Psychology: General, 119, 176-192.
Tarmizi, R. A., & Sweller, J. (1988). Guidance during mathematical problem solving. Journal of Educational Psychology, 80, 424-436
Tuovinen, J. E. (1999). Research framework and implications for online multimedia education practice based on cognition research. Paper presented at the Communications and networking in education: Learning in a networked society, Aulanko, Hameenlinna, Finland.
Vogel, D., Genuchten, M., Lou, D., Van Eekhout, M., Verveen, S., Adams, T. (2001). Exporatory research on the role of national and professional cultures in a distributed learning project, IEEE Transactions on Professional Communication, June, forthcoming.
Wang, X. C., Hinn, D. M., & Arvan, L. (2001). Stretching the boundaries: Using ALN to reach on-campus students during an off-campus summer session. Journal of Asynchronous Learning Network, 5(1)
Appendix 1
How
to write research proposals
After studying the purpose of writing a research, you should know:
Why a research proposal is written and to whom the research proposal is targeted.
Learning Activities
Multiple choice exercises
Online discussion (all participate)
Topic Note 1. Purpose of a research proposal
A research proposal is a plan to do research investigation. The first challenge in writing a research proposal is to propose a study that will contribute to theory and research in a particular field. The second challenge is to demonstrate the feasibility of the research investigation. This depends on judgments about the sufficiency of available resources (time, money); and access to population of interest.
Research proposals are written for various purposes. Research proposals are written for theses. This enables supervisors of the theses to offer suggestion for improving the study. Conducting research needs money. Thus, research proposals are written to obtain research grants from government agencies, universities research funds, and private agencies. Occasionally, a research proposal describing a project is required to obtain permission to collect data.
Exercise
Please tick the correct statements
The general purpose of any proposal is:
· To persuade a committee of scholars to fund a research project
· To implement a program that you would like to launch
· To convince your supervisor that the research project is feasible in terms of resources (time, sample and etc.)
·
The research project can provide a new insight to a particular
field of study
Appendix 2: Diary Entry
Name of the student
|
How much time do you spend in: |
Day 1 |
Day 2 |
Day 3 |
Day 4 |
Day 5 |
Day 6 |
Day 7 |
|
24/02 |
25/02 |
26/02 |
28/02 |
29/02 |
01/03 |
02/03 |
|
|
Reading topic notes and trying exercises from notes |
|
|
|
|
|
|
|
|
Taking part in online discussion (e.g., posting message, reading message, and contributing messages) |
|
|
|
|
|
|
|
|
Taking part in group project (e.g., posting message, reading message, and contributing messages) |
|
|
|
|
|
|
|
|
Searching the web for the writing research proposals materials |
|
|
|
|
|
|
|
|
Downloading relevant reading material |
|
|
|
|
|
|
|
|
Looking at the computer screen |
|
|
|
|
|
|
|
|
Any other activities (please specify) 1. 2. |
|
|
|
|
|
|
|
Author Note
Correspondence concerning this paper should be sent to Dr. Bing H. NGU, Faculty of Cognitive Sciences and Human Development, Universiti Malaysia Sarawak, Malaysia. Electronic mail may be sent via Internet to bhngu@fcs.unimas.my
IJET Homepage | Article Submissions | Editors | Issues
Copyright © 2002. All rights reserved.
Last Updated on 20 June 2002