Empirical Research Last Updated: Apr 20, 2010 - 3:52:13 PM


A Technologically Based Approach to Providing Quality Feedback to Students: A Paradigm Shift for the 21st Century
By Rick Lumadue, Wade Fish
Volume 8 - Issue 1
Feb 5, 2010 - 1:53:39 PM

Email this article
 Printer friendly page

Introduction

The purpose of this article is to provide busy professors, teaching in the 21st century a technologically based approach to providing quality feedback to students. This innovative and effective, yet relatively simple option will result in a pedagogical paradigm shift for the 21st Century. Technology is ubiquitous in higher education. Students use technology to apply to a university or college, enroll in courses, sign up for a campus email address, apply for financial aid, purchase books, and pay tuition and fees. Likewise, professors use technology to submit the schedule of courses they will be teaching in the upcoming semester, correspond with colleagues and students via email, receive direct deposit. This technology based pragmatic paradigm shift by students and professors has resulted in a much faster, simpler and more efficient process of the mundane functions of institutions of higher education. In the same manner, a technology based pedagogical paradigm shift for professors providing quality feedback to students will result in a much faster, simpler and more efficient process.

As revealed in the next section of this article, a review of the literature has demonstrated the importance of providing timely, constructive and detailed feedback to students on their assignments.

Importance of Quality Feedback

 

This article will begin with a focus on the importance of providing quality feedback. Faculty providing constructive and detailed feedback serves as an important component for effective student learning and is beneficial towards student achievement (Debuse, Lawley, & Shibl, 2007; Higgins, Hartley, & Skelton, 2002). According to Wolsey (2008), the desired outcome of feedback is to provide communication between instructor and student, which promotes learning. Quality feedback is defined as providing students with clear assessment criteria that is not only timely, but encourages further learning (Brown & Glover, 2006).

Poulos and Mahoney (2007) found that feedback served as the most significant component for first-year university students in enhancing their understanding of required standards. Wolsey (2008) further concluded that quality feedback serves as an important instructional factor toward promoting better written work. Sufficient feedback is necessary in order for students to monitor their learning progress and performance (Debuse et al., 2007), further enhancing their understanding of their strengths and weaknesses. Without feedback from instructors, students are likely to become less motivated towards learning (Pepper & Pathak, 2008). Furthermore, increasing feedback explicitness and frequency facilitates the perception among students that grading procedures are fair and consistent. Instructors who have difficulty dealing with the subjective nature of grading further benefit from the feedback that they offer to their students. Students that are provided with insufficient feedback and minimal interaction from instructors are less likely to encounter opportunities for further intellectual growth (Summerville & Johnson, 2006).

Students value and appreciate quality feedback due to the interaction that they potentially receive from their instructors (Wolsey, 2008). While feedback plays an important role towards learning, students are often unsatisfied with the quality of feedback that they receive from instructors (Holmes & Papageourgiou, 2009). Holmes and Papageorgiou concluded from interviewing tourism management students that the quality of feedback received by instructors was rated lower than any other aspect of their educational experiences. According to the United Kingdom’s 2007 National Student Satisfaction Survey (NSSS), feedback was ranked satisfactory by only 62% of students from all subject areas (Higher Education Funding Council for England, 2007; as cited in Holmes & Papageorgiou). Practices must be improved (Holmes & Papageorgiou), as instructional feedback is often vague, non-specific (Debuse et al., 2007; Higgins et al., 2002), inconsistent and infrequent (Holmes & Smith, 2003). The ability for faculty within higher education to provide quality feedback in a timely manner has become a challenge due to larger class sizes and increased workloads (Debuse et al.), which has resulted in many instructors reducing the frequency of assignments (Gibbs & Simpson, 2004).

 

Feedback should positively impact student achievement (Higgins et al., 2002; Debuse et al., 2007). Feedback should further reveal to students how to gage discrepancies between current and expected performance (Wolsey, 2008) by providing them with clear assessment criteria (Brown & Glover; as cited in Holmes & Papageourgiou, 2009). Furthermore, feedback should be scheduled to where students have sufficient time to ask for clarification in order to understand their mistakes and improve upon their performance (Holmes & Papageorgiou). Simply providing generic feedback is not beneficial to students as dialogue should be personalized (Debuse et al., 2007), informative and detailed (James, McInnis & Delvin, 2002). Instructors should provide feedback to students that clearly links input to specific criteria in a positive manner rather than simply highlighting errors through general and ambiguous dialogue (Wolsey, 2008).

 

Feedback is most effective when delivered frequently (Dennen, 2005) and in a timely manner (Debuse, Lawley, & Shibi, 2007; Holmes & Papageorgiou, 2009; Pepper & Pathak, 2008; Wosley, 2008). Holmes and Papageorgiou concluded that the frequency of providing feedback is actually more important than the quality of feedback. Frequent feedback also enhances the ability of students to re-assess their performance and study patterns (Pepper & Pathak) as well as to provide opportunities to resubmit work (Black, Harrison, Lee, Marshall, & William, 2003). Butler, Pyzdrowski, Goodykoontz, & Walker (2008) concluded from measuring the impact of feedback toward pre-calculus university students that those who received immediate feedback obtained higher grades compared to individuals who did not receive immediate feedback.

 

Providing feedback in a timely manner allows students to utilize information for future assignments and to focus on content to be learned rather than just grades (Holmes & Papageorgiou, 2009; MacLellan, 2001). Ramsden (2003) further concluded that grades often distract students from focusing on the content of instructor feedback. According to Butler (1988), providing assignment feedback through quality comments only, absence of grades, is the most effective way to for instructors to provide feedback.

Students prefer feedback that supports learning (Dennen, 2005) and is embedded throughout the body of their work (Wolsey, 2004). Additionally, understanding the criteria for receiving feedback is also valued by students (O’Donovan, Price, & Rust, 2004). Brown and Glover (2006) concluded that students found feedback to be most beneficial in written form, which allowed them to more effectively comprehend input from their instructors.

 

Traditionally, students have received interaction and feedback in the form of returned handwritten instructor comments, telephone calls, face-to-face meetings and emails. The paradigm shift towards online instruction has created new avenues towards providing feedback to students. Student experiences in taking online courses, which includes their sense of connectedness, are likely enhanced through the quality of feedback provided by their instructor (Wolsey, 2008). Due to asynchronous nature of many online learning environments, instructors must increase their efforts in making feedback beneficial to students. Teaching online requires a faculty member to think differently about teaching and to learn a host of new technological skills, which include innovative approaches toward delivering feedback (Fish & Wickersham, 2009). Most online environments provide student asynchronous feedback through threaded discussion board forums and through the utilization of Microsoft Word track changes.

Introducting Jing

Although professors are considered to be content experts, most are not technology experts. This technology gap poses a problem for professors who want to provide quality feedback to their 21st century students who expect their teachers to be using the latest technology (Finkelstein, 2006). For this reason a meaningful solution must be provided to help instructors bridge the technological gap. One such solution is the software technology program named Jing. Jing is a user friendly, good quality, well-supported software technology. Jing allows instructors to provide both audio and visual feedback to assignments electronically through screen capture. This type of feedback is especially effective for instructors teaching an online or web-enhanced course. However, those teaching in a traditional classroom may also find this to be an effective approach.

The most valuable component of Jing is that it has a low learning curve. Jing is free and can be downloaded at http://www.jingproject.com/. Both Windows and Mac versions are available and download rather quickly and are easy to install. Helpful tutorials are also provided on the website. Jing allows instructors to record both screen captures and full-motion videos from a computer screen. This process is very intuitive and after a little practice can be mastered. When files are saved in Jing, the default format is Shockwave format (SWF). An SWF file is considerably smaller than a Moving Pictures Expert Group (MP4) file. SWF files are viewed using adobe flash player, which is built into most Internet web browsers, so instructors and students do no need to download a program to view these files. The Jing Pro version allows users to save files as MP4. An MP4 file is better for capturing streaming images on a computer screen, such as movie clips and images captured with a web cam. The reason for this is because MP4 files do not drop frames, unlike the SWF format. An MP4 file is much larger than an SWF file. So the rule of thumb is when you perform a screen capture without streaming video, select the SWF video format in the preferences section of Jing. On the other hand, select the MP4 video format in the preferences section of Jing when you wish to capture streaming video on your computer screen. Please note the MP4 video format is only an option with the Jing Pro version. Once a video has been captured in Jing Pro using the MP4 video format instructors are given the choice to upload their full-motion video captures straight to their YouTube account. These MP4 files may also be uploaded to other Internet sharing sites or embedded in presentations such as PowerPoint or Keynote. Jing Pro also provides instructors the option to reduce video file sizes for faster sharing. The Jing logos and links can be stripped from videos for a more professional looking presentation. Professors who use Mac computers have the option of giving personality to their videos by providing a video introduction to their presentation.

Incorporating Technology through Jing

How does all of this discussion concerning SWF and MP4 video format apply to providing quality feedback to students? A solid understanding of the purposes of these two video formats provides the instructor with the knowledge of the most appropriate format to use for the desired purpose. For the purpose of providing feedback on student assignments, the SWF video format is the best option. SWF files are usually small enough to be attached to an email message or posted in an online course dropbox. The size of the SWF file depends on the size of the screen being captured. Jing provides the user with the ability to size and resize the screen capture. After the size of the screen capture has been determined the user has two options in Jing.

The first option is to simply capture an image of the screen as a picture. For example, an instructor may capture an image of a page of a student’s document on which to make some comments or highlight a section for emphasis. The image is captured and opens up in a Jing editor. The Jing editor has some limited, but useful applications for marking up a screen capture to draw the attention of the reader to a specific section. A text comment box is one of the applications where comments or suggestions can be made on the screen capture image. Arrows and highlight boxes with choice of color from a color palette are two of the other very useful applications. The screen capture image should be saved with a unique name and saved in a folder so that it may be easily retrieved for insertion as an email attachment or pasted into a presentation document, such Microsoft PowerPoint of Keynote for the Mac. The default file extension of Jing image captures is Portable Networks Graphics (PNG). The PNG format is a reliable and compatible file format that can be opened on Windows and Mac computers without an additional software purchase. Once the student receives the file as an attachment the student should be able to open the attachment to view the instructor comments and/or highlighted features.

The second option available for the instructor to select after the screen size has been determined using Jing is to capture the screen image as a video with the SWF format. The video capture feature has a five- minute time limit. The five-minute time limit has not been an issue for the authors of this paper. Most of the comments that need to be made can be done in that time. When a longer video needs to be made a second video (i.e.; which could be referred to as a chapter) may be captured. Likewise, subsequent videos (i.e.; chapters) may be captured. When considering the issue of the five-minute video length, consider the student on the receiving end sitting and watching and listening to your comments. Students typically have a short attention span, especially the millennial generation who are now entering colleges and universities. According to Jensen (1998) “genuine, external attention can be sustained at a high and constant level for only a short time, generally about 10 minutes or less.”

An appropriate method for capturing a video of a student’s paper using Jing is to have the paper open in a word processor (i.e.; MS Word). The instructor then has all of the capabilities of a word processor at his/her disposal (i.e.; highlighting, editing, formatting, etc.). Highlighting, editing and formatting should be made ahead of time by the professor before starting the Jing program. This will save the instructor time and keep him/her focused on making the comments on the student’s paper. However, additional highlights and edits can be made during the recording session. The recording session has a pause feature allowing the user to pause the recording and make additional highlights and edits before turning the recording back on.

Once the video capture button is clicked in Jing the user is given a three second countdown to prepare to begin making audio comments on the video. A five-minute timer is displayed notifying the user of how much time is remaining to record. The timer turns red at the four-minute mark alerting the user the recording is close to ending. A good quality headset microphone is recommended for this process. A better quality headset microphone does not pick up background noise and also does a better job of recording your voice.

When the recording is complete, the user is prompted to save the file. The user has a couple of options. One option is to save the file to the user’s computer. The file can be attached to an email, posted to a student’s inbox on a course website, etc. The file will have an SWF extension (i.e; lumadue.swf). Once a student receives an SWF file with an instructor’s recorded comments the student should be directed to open the attachment with an Internet web browser like Mozilla Firefox or Mac’s Safari. As stated above, these web browsers have flash player built into them. After the file opens the student needs to click the play button to start the video playback. The student then has the option to pause, rewind, fast forward or stop the video playback. These files can also be saved to the student’s computer and be viewed again.

A second option is to send the SWF file to the Screencast website. Users of Jing are given 2 GB of space free of charge on the Screencast website to host Jing files. Screencast is the parent company of Jing and the better-known software programs Snagit and Camtasia. After uploading a file to Screencast, the user is given a URL address. This URL address may be copied and pasted into an email or other feature of an online course where students receive grades. The student will be taken to the Screencast website where the SWF file can be viewed and listened to. Screencast offers a password feature for uploaded files. A professor may assign a password to an uploaded file on Screencast and share the password with the student who will then be able to view the files and listen to the personal comments.

The MP4 screen capture format, available only for Jing Pro subscribers, may be used by an instructor to provide feedback or an announcement with a webcam to provide a more personal touch to students. MP4 files may also be embedded into an online course website for a class or an individual student. These announcements may also be posted with a link to a host website such as a personal website, blog or YouTube.

Correspondences from students demonstrate an appreciation of this type of feedback. For example one student commented,

Thanks for the helpful comments on my paper and for following up with me. I was traveling out of town all week for work and just had an opportunity to listen to the comments. I am extremely impressed with the technology. It is very helpful to be able to hear your explanation of the comments in relation to the text. Thanks again.

Another enthusiastic student expressed the following to her professor;

Wow! Thanks for the audio feedback on reflection #1. When I was in college twenty years ago, I had no idea that one day I would be listening to my professor on the computer providing feedback on my assignment.Times have changed!I appreciate the time you take to review and provide feedback on assignments. Thanks

This article has advocated for a technologically based approach to providing quality feedback to students resulting in a paradigm shift for the 21st century. Busy professors, teaching in the 21st century have been provided an innovative and effective, yet relatively simple option for providing quality feedback on the assignments of their students. The software program Jing was analyzed. Careful consideration needs to be given regarding the format of video screen captures desired by the instructor. An SWF format should be used for most video screen captures. While an MP4 format should be used for video screen captures where streaming video or steaming webcam video needs to be captured. The benefits of providing this type of feedback include time saved by making audible comments rather than typing comments, a more personal touch to students through listening to an instructors comments and a quality technological format.


 

References

Black, P., Harrison, C., Lee, C., Marshall, B., & William, D. (2003). Assessment for learning: Putting it into practice. Maidenhead, England: Open University Press.

Butler, M., Pyzdrowski, L., Goodykoontz, A., & Walker, V. (2008). The effects of feedback on online quizzes. The International Journal for Technology in Mathematics Education, 15(4), 131-136.

Debuse, J., Lawley, M., & Shibl, R. (2007). The implementation of an automated assessment feedback and quality assurance system for ICT courses. Journal of Information Systems Education, 18(4), 491-502.

Dennen, V. P. (2005). From message posting to learning dialogues: Factors affecting learner participation in asynchronous discussion. Distance Education, 26(1), 127-148.

Finkelstein, Jonathan. (2006). Learning in Real Time. San Francisco, CA: Josey-Bass.

Fish, W. W., & Wickersham, L. E. (2009). Best practices for online instructors . Quarterly Review of Distance Education, 10(3) .

Gibbs, G., & Simpson, C. (2004). Does your assessment support your students’ learning? London: Centre for Higher Education Practice, Open University Press.

Higgins, R., Hartley, P., & Skelton, A. (2002). The conscientious consumer. Reconsidering the role of assessment feedback in student learning. Studies in Higher Education, 27(1), 53-64.

Holmes, K., & Papageorgiou, G. (2009). Good, bad and insufficient: Students’ expectations, perceptions and uses of feedback. Journal of Hospitality, Leisure, Sport & Tourism Education, 8(1), 85-96.

Holmes, L. E., & Smith, L. J. (2003). Student evaluations of faculty grading methods. Journal of Education for Business, 78(6), 318.

Jensen, Eric. (1998). Teaching with the brain in mind. Alexandria, VA: Association for

Supervision and Curriculum Development.

O’Donovan, B., Price, M., & Rust, C. (2004). Know what I mean? Enhancing student understanding of assessment standards and criteria. Teaching in Higher Education, 9, 325-335.

Poulos, A., & Mahoney, M. J. (2007). Effectiveness of feedback: The students’ perspective. Assessment and Evaluation in Higher Education, 33, 143-154.

Pepper, M. B., & Pathak, S. (2008). Classroom contribution: What do students perceive as fair assessment. Journal of Education for Business, 83(6), 360-367.

Ramsden, P. (2003). Learning to teach in higher education (2nd ed.). London: Routledge-Falmer.

Summerville, J., & Johnson, C. S. (2006). Rural creativity: A study of district mandated online professional development. Journal of Technology and Teacher Education, 14(2), 347-361.

Wolsey, T. D. (2008). Efficacy of instructor feedback on written work in an online program. International Journal on ELearning, 7(2), 311-329.

 

 



© Copyright 2010 by Academic Leadership

Top of Page

Empirical Research
Latest Headlines
Resident Block-rotation in Clinical Teaching Improves Student Learning
Full-day Kindergarten: Ontario
Kolb’s experiential learning as a critical frame for reflective practice
No Child Left Behind: School Processes Associated with Positive Changes, Collaborative Partnership, and Principal Leadership
Leadership in Tunisian Higher Education from the Perspective of the EFQM Excellence Model
Teachers Identify and Support At-Risk Gifted Students
Language and Care: Tensions for Japanese Teachers and Foreign Students in Japanese Schools
Paying students for grades: Is it sustainable and should it be?
CONSISTENCY OF OCCUPATIONAL CHOICE BETWEEN COUNSELLED AND UNCOUNSELLED SENIOR SECONDARY SCHOOL STUDENTS IN NORTHERN CROSS RIVER STATE
GLOBALISATION, GOOD GOVERNANCE AND DEMOCRACY: THE INTERFACE