Tag
Marking
Mark with a Text Only (feedback) Rubric
A Text Only Rubric has no points associated with criterion and levels. Unlike a Custom Points Rubric, this type of Rubric will NOT calculate a score or Overall Level for you. You must select a level of achievement against each criterion, then specify and Overall Level.
Please note that the ‘look’ of a Rubric may change depending on whether you are marking from an Assignment Submission Folder or from a Grade Item. We have represented this by providing two screen shots for each instruction: the view from an Assignment Submission Folder is always presented in the first image; the view from a Grade Item is always presented in the second image.
Please note that these instructions do not explain how to access a Rubric. You can see how to access a Rubric from an Assignment Submission Folder here, or from a Grade item here.
Choose a level for each criterion
Choose a level for each criterion by clicking on it. When marking a Rubric from an Assignment Submission Folder, you will notice that the selected level is highlighted by a selected radio button (see first image). When marking from a Grade Item the selected level will be highlighted, and a small check mark will appear in the bottom right corner (see second image). To change the level, simply click on a different level.
Edit the feedback associated with a level
If you wish to provide a student with feedback in relation to a particular criterion, first select the level. You will notice that an editing icon appears. When marking from an Assignment Submission Folder, this icon will appear in the far right column (see top image). When marking from a Grade Item, you will need to select the + FEEDBACK link that appears in the far left column (see bottom image).
The editing views are slightly different. If you are marking from an Assignment Submission Folder, a new dialogue box will open. Here, you can record feedback if required (see top image). If you are marking from a Grade Item, you will see a Criterion Feedback field open at the bottom of the selected level. Type in your feedback, then select DONE to save it and keep marking.
From time to time, remember to click the Save button to save your work (appears underneath the Rubric).
Choose an Overall Level
Once you have chosen levels against each criteria, you will need to select an Overall Level. To do this, select one of the level fields in the bottom row of the Rubric.
Save the Rubric
- If you’re marking from an Assignment Submission Folder, uncheck the Transfer rubric feedback to general feedback for the assignment option (this option is not very useful).
- Finally, select the Save & Record button.
The overall score from the Rubric will not be reflected in the Evaluation Score field in an Assignment Submission Folder (see first image) or in the Grade field in a Grade Item (see second image). You will need to record the score manually. Remember to Save your work after recording the score.
Access a Rubric from a Grade Item
You may need to mark directly into a Grade Item in the Grades tool. This generally happens when the ‘product’ that students will be assessed on cannot be submitted to an Assignment Submission Folder. For example, you may be assessing student participation or a presentation delivered face-to-face. A Grade Item is often also used to mark contributions to online Discussions. These instructions will show you how to access a Rubric when marking a Grade Item.
Step 1
Open the Grades tool by selecting it from the MyLO toolbar.
Go to the “Enter Grades” tab.
Locate the Grade Item that you wish to mark. You may need to scroll sideways to find it. Select the arrowhead to the right of the Grade Item name, then select Grade All from the menu.
Step 2
The Grade Item page will open. Scroll down until you see the list of student names. TIP: You can filter the names you see by searching for a specific student name OR selecting a specific Group of students. Next to each student’s name, you will see several cells. The first is the Grade cell, where you can record the student’s grade (as a score). The fourth is for Feedback. Clicking on the speech bubble icon in this cell will allow you to add general text feedback for the student to read. The fifth cell, Assessment, contains an icon that will launch the associated Rubric. Click on the icon to launch the Rubric.
Remember to SAVE on each page!!
Instructions showing how to mark with a Custom Points Rubric (generates a score) are available here. Instructions showing how to mark with a Text Only Rubric (for feedback only) are available here.
Mark Using Rubric from an Assignment Submission Folder submission
Step 1
Go to the Assignments tool from the toolbar.
Click on the assignment you wish to mark.
Step 2
A new page will load. Scroll down until you see a list of student submissions. The student’s names will appear, followed by the files they have submitted. You can view an individual file by clicking on the file name (this is usually the quickest option, especially if students have submitted cover sheets which you do not have to mark).
A preview of the student’s work will load, as the screenshot below shows the content of the assignment will appear to the left, the “Evaluation” area to the right.
Step 3
Click on the name of the rubric to load it up – it will appear in a new window. You may need to resize the window to see the whole rubric. The example below shows a “Custom Points” rubric, this being the most commonly used rubric.
You will see the list of criteria and levels arranged somewhat like above (yours is likely to have more text than this example). To “choose” a level just click the radio button. It is more important to choose the option that contains the most relevant feedback for your student – the default score can be altered.
To alter the score click the Pencil icon – over on the right of the rubric – then enter an alternate score and/or optional feedback text. When you do this you’ll notice a small icon (see above, the second criteria shows as red shaded and an icon in the ‘Score and Feedback’ area indicating that a ‘custom’ score was entered for this criteria.
To have the rubric fully calculate a score you MUST choose an option for EVERY criteria.
When you have completed the rubric choose “Save and Record” to send the score to the ‘Score’ field of the assignment (which then is sent to grades).
(The option you see in the screenshot ‘Transfer rubric feedback’ relates to any text you have typed that gets transferred to the “Feedback” area, this option is on by default but is optional).
When you click Save and Record you will see the score appear in the ‘Score’ field. If none appears it may mean there is a score missing for one of the criteria. You can click on the rubric at any time to edit/alter the mark – just remember to hit save and record each time.
As you can see from the above screenshot the rubric score that was calculated – when I click ‘Save and Record’ – is sent to the ‘Score’ field. You can always alter the score here too if you want.
Remember if you are marking and do not want to release the score to students YET – click ‘Save Draft’.
Instructions showing how to mark with a Text Only Rubric (for feedback only) are available here.
Taking it online: A comparison of online assessment tools
There are a variety of online tools and software applications that you can use to help students create or perform items for assessment, and submit online. Here, we review some of the tools supported by UTAS.
Tool | Suitable for… | Submission | Marking and feedback | Considerations |
Microsoft Office | Creation of a range of documents, from Word Documents, to PowerPoints and Excel spreadsheets. Skype for Business (Lync) can be used to communicate with group members. | Files can be submitted to an Individual or Group Submission Folder. Alternatively, they can be shared with other via a Discussion Topic. | Word documents can be checked for plagiarism/collusion via Turnitin (e.g. Word Documents). Word documents can be ‘marked’ using GradeMark/Feedback Studio. |
|
Assignment Submission Folder (individual) | Submission of files, including documents, images and videos. | Several files can be submitted at once. | Can be connected to Turnitin for detection of plagiarism/collusion, but only text documents will generate a report. Mark in the Evaluate Submission area. An electronic Rubric can be attached to the Folder and used for marking and feedback. GradeMark/Feedback Studio can be used to make comments on the students’ work. |
|
Assignment Submission Folder (group) | Submission of files, including documents, images and videos. | Several files can be submitted at once. Only one member of the group needs to submit, but any member can submit if need be. | Can be connected to Turnitin for detection of plagiarism/collusion, but only text documents will generate a report. Mark in the Evaluate Submission area: the feedback and results will be made available to all students in the group. Individual marks can be altered in the Grades tool. An electronic Rubric can be attached to the Folder and used for marking and feedback. GradeMark/Feedback Studio can be used to make comments on the students’ work. |
|
Quiz | Low-stakes quizzes/tests and Just In Time Teaching (JITT). Best used as a means of helping students check their progress, especially when feedback is integrated and responsive to students’ answers. Thus, best used during semester, not near the end (unless used to aid exams revision). Generally not suitable as a means of demonstrating higher order thinking. | Students must click Submit at the end of the Quiz. Otherwise, their Quiz will be flagged as ‘Attempt in Progress‘ (you can force submission afterwards if need be). Some questions can be automarked, whilst others require manual marking. Marks can easily be published to the Grades tool. Feedback can be delivered immediately, or released from a specific date and time. | It is possible to incorporate feedback according to answer choice OR general feedback related to a question. The feedback can be released immediately, or at a later date. You can mark individual questions if needed (e.g. long answer questions), and alter marks for questions manually if need be. Statistics from the Quiz can used when discussing the Quiz questions with students, and are especially useful for identifying areas of difficulty. |
|
ePortfolio | Students can generate a Presentation (effectively a website) consisting of reflections, uploaded documents and so forth compiled over a semester. Best for assessments completed over a long period, for example, reflective journals and portfolios. | Submission must be made to an Assignment Submission Folder. Submission can take a while to process and tends to generate a fairly large file. | Mark in the Evaluate Submission area, however, does involve an extra click to open the submission (preferably in a new tab/window). Can be problematic in some browsers. An electronic Rubric can be attached to the Folder and used for marking and feedback. Cannot be procesed through Turnitin, and Grademark/Feedback Studio cannot be used. |
|
Discussions | Suitable for tasks in which students are required to discuss an issue/come to a consensus and produce something concrete (e.g. a list, with choices justified). Also suitable as a means of supporting collaborative learning. Can be used to support peer review, question and answer, and feedback. For example, students could post a video of their presentation. Other students can view and post questions. | Encourage timely contributions by using staged deadlines. For example, first post due by x, responses due by y. You could also include timeliness of contributions as a criteria in a Rubric. Setting up a Checklist with due dates for each task could help facilitate this. | Provide general feedback and encouragement at a midpoint in the discussion, as well as towards the end and after deadline. We recommend providing feedback in the Discussion itself by posting to the group and weaving/summarising. For marking, use a standalone Grade Item (on a different window/tab). You can attach a Rubric to the Grade Item. |
|
Blackboard Collaborate Ultra | Groups can meet live online to discuss projects, or to deliver and record a presentation or discussion for assessment. Alternatively, students can deliver a presentation live, online, to you and other students. You can record the presentation as evidence for assessment. Voice, as well as any objects presented on screen, are captured in the recording. | Student groups will need a room created for them. Once they have recorded their session/sessions, they can submit them (with supporting documentation) to a Group Assignment Submission Folder. Live presentations can be assessed live. You can return to the recordings any time. In all cases, we recommend getting students to submit some kind of support material to an Assignment Submission Folder (group or individual), and add the link to a recording to their Comments field. This allows you to use the full features of the Evaluate Submission area to grade and provide feedback. | We recommend using the Evaluate Submission area (associated with an Assignment Submission Folder to grade and provide feedback for groups or individuals. Students will need to submit some sort of supporting documentation, as well as link to a recorded session (if required) to support this. |
|
Video | Students can capture video of themselves (e.g. talking head) for assessment using a range of tools, including MyLO’s VideoNote, their own smartphone or camera. Useful when you want to: assess students’ individual presentation skills; provide an alternative to written reflection. | Students will need to submit their video to an individual Assignment Submission Folder. If videos are shorter than 3 minutes duration, they can use the VideoNote tool included in the submission window. If you want students to share their videos in some way, it may be advisable to put them up to their Echo360 ALP Library and share a link to/embed the video in a post (rather than getting students to attach a large file to a Discussion post). | Mark and provide feedback using the Evaluate Submission feature. Note that you will not be able to utilise Turnitin or GradeMark/Feedback Studio (as you can’t mark up video files). |
|
Taking it online: In-class tests
If used for formative assessment, in-class tests can be a useful means of helping students check their progress throughout the semester (as long as feedback is provided following the test). The tests can also provide you with rapid feedback about the class’ progress so that you can adapt your teaching focus accordingly. Getting all students – regardless of study mode – to use the same procedure will ensure equity and simplify marking and grades management procedures.
What am I really assessing?
Depending on the nature of the questions, in-class tests tend to assess whether students can remember, comprehend and/or apply what they have learned. As they tend to be fairly short, these tests generally don’t provide a valid assessment of students’ ability to analyse, synthesise or evaluate what they have learned.
Adapting for blended learning and electronic submission
- Online Quizzes
- Use randomised questions and answer options to make collusion difficult.
- Make the most of auto-marked questions (where questions have a definite answer). Long answer questions must be marked manually but can certainly help elicit evidence of higher order thinking from students. It is possible to combine different forms of questions.
- Scores can be transferred to the Grades tool easily.
- Get both cohorts to complete the Quiz online, and get feedback issued at the same time (either via the Quiz tool or via the instructor).
- Statistics for each question can be used as the basis for teaching points (e.g for discussion in online or face-to-face sessions, or in Announcements).
- Scan and submit
- Create an instruction document clearly indicating what students will do and when. This will need to be made available to students as far in advance as possible (preferably a minimum of one week prior).
- Make a ‘test’ document, containing the questions, available on MyLO at a specified date and time (you can use the Special Access feature to release the sheet to students at different times if need be).
- Students complete the test and must submit their work to an Assignment Submission Folder within a given time period (you can set an open and close time for the Folder, and use the Special Access feature to release at different times if need be). Students could submit a Word document or, where ‘workings’ need to be demonstrated, a clear scan of their written work (as a PDF or JPEG).
- If collusion is a concern, create three different papers with slightly different questions (e.g. different amounts, business names etc). Break students into three groups (this can be done automatically with the MyLO Groups tool). One of the three tests is released to each group.
- Mark and provide feedback using the Evaluate Submission area.
Setting up Turnitin and Grademark/Feedback Studio
Turnitin is a text matching service used to compare student-submitted work to the existing literature, as well as student work already stored on its database. Turnitin highlights text matches, allowing you to rapidly detect possible areas of plagiarism or collusion in a student’s writing.
Grademark/Feedback Studio, which is available when a student’s work is submitted through Turnitin, allows you to leave comments on a student’s work electronically. Click here for more information about providing feedback with Grademark/Feedback Studio.
To use Turnitin and/or Grademark/Feedback Studio, you must enable Turnitin when setting up a Assignment Submission Folder (to collect student submissions) in MyLO. Ensure that you do this BEFORE students start submitting their work. Here’s how.
PART 1: Set an End Date for your Assignment Submission Folder
To work effectively, Turnitin requires that you set an End Date in the Assignment Submission Folder’s Restrictions tab.
If you have already created an Assignment Submission Folder, you will need to choose to edit it. Do this by selecting the arrowhead to the right of the Folder name, then select the Edit Folder option. Alternatively, when viewing the Submission Folder, click on the Edit Submission Folder button. If you’re already in the midst of creating a Submission Folder, read on.
By default, the Properties tab will be open. Select the Restrictions tab.
Scroll down until you see Has End Date. Check the Has End Date option then record a date and time. We recommend that you set the End Date to a few days after final results are released for the semester.
Scroll to the bottom of the page and select the Save button.
PART 2: Connect the Assignment Submission Folder to Turnitin
Click on the Turnitin tab (note that you will need to have given the Folder a name before you do this).
Check the box next to the Allow Turnitin for this folder option. Wait a moment while the connection is initiated.
PART 2: Choose the right settings – VERY IMPORTANT!
The following settings are the key to making Turnitin and Grademark/Feedback Studio work the way that you want it to. Do not skip these steps!!!
Leave the Allow learners to see Turnitin similarity scores in their submission folder setting (under Display) unchecked. Under Frequency ensure that you have the Automatic originality checking on all submissions options checked. If the Identify individual submissions option is checked instead, you will need to manually click on each file submitted by students to process them through Turnitin. Not fun!
Scroll down and you should see the Grademark available to learners setting. The date recorded here is the date from which students can see the link to access their Grademark/Feedback Studio feedback. We recommend setting this date about one month following the Assignment Submission Folder due date, to avoid any students accidentally seeing their feedback as you’re marking. If you wish to release the feedback earlier, you can always come and alter this date accordingly.
Back to towards the top of the screen, you should see a More Options in Turnitin button. Click on it.
A new window will open. Locate the Allow submission of any file type option. We select you choose Yes. This is especially important if you want to mark files, such as PDFs or some image files, in Grademark/Feedback Studio, even if an Originality Report cannot be generated.
Now click on the Optional Settings option that appears towards the bottom of the screen.
You should now see more settings. Scroll down until you see the Originality Report generation and resubmissions button. Make sure that the Generate reports immediately (resubmissions are allowed until due date) option is selected. If you do not select this option, you may find that students who submit more than one file (very common) only have the first file processed through Turnitin.
Scroll down until you see the Submit button. If you can’t see it, expand the window to full screen. You should be able to see it then.
How to set up your Grades tool
MyLO’s Grades tool is flexible and offers many options for recording, tracking and calculating student grades.
This page is designed to link you to useful resources related to the Grades tool.
If you are new to Grades… |
|
If you want to set up your Grades tool to maximise efficiency of grades management and marking… |
|
If you need to identify solutions to meet your grading needs, and set up your Grades tool… |
|
If you are approaching the end of your unit… |
Grading Solution: Students submit the same assessment task at different times
This solution would suit scenarios like this:
Students must deliver a presentation for one assessment task. The task is worth 20% of the unit assessment. Students may deliver their presentation at a nominated tutorial time between weeks 5 and 10 of semester. You decide to make students submit their presentation plan/slides to a Dropbox the day prior to their scheduled presentation session. You will provide feedback to students and record their mark via the Dropbox folder. The issue you need to resolve here is different due dates for different students.
Options
You have three options in this scenario:
- Create a Dropbox with no Start, Due or End Date restrictions and link it to a single Grade Item (see Grade a single assessment task comprising one item). A date will be recorded against each student’s submission, but overdue submissions will not be flagged as late.
- Place students in presentation groups (based on their presentation delivery date) using the Groups tool. Create one Dropbox and associate a Grade Item (see Grade a single assessment task comprising one item). Use the Dropbox Restrictions to add a Special Access condition for each presentation group that specifies a Due date unique to that group. Students will see the due date specified by their Special Access condition. Their submission will be flagged as late if the fail to submit before the due date set as their Special Access condition.
- This is the most complex option. Place students in presentation groups (based on their submission date) using the Groups tool. Create a unique Dropbox folder for each presentation group. You will also need to create a new Grade Item to attach to each Dropbox. You may wish to restrict access to each Dropbox and Grade Item according to Group membership using Release Conditions.
The remainder of this section assumes that you have chosen option 3. If you have chosen options 1 or 2, refer to the instructions for Grade a single assessment task comprising one item.
Grading system and other requirements
This method requires the use of a weighted grading system and the use of a special marking method (refer to When Marking section below).
You will need:
- Create one Category to represent the assessment task and use the options suggested here.
- Create one Grade Item per Dropbox and use the options suggested here. You must link each Grade Item to the Category that you have created.
- Create one Dropbox for each presentation group. You must link each Dropbox with one of the Grade Items that you have created.
To see an example of what this solution might look like in the Grades tool, download this PDF.
When marking:
You will need to do the following:
- Record marks only for those Grade Items that the student needs to complete. Leave the other Grade Items unmarked. For example, if Tam needs to deliver only one presentation, and delivers it during Week 6, record a mark for her only in the Week 6 Grade Item.
- If a student fails to submit an item that they are expected to complete, record a 0 as their grade. For example, View Student failed to deliver their presentation for Week 5 and has therefore received 0 for this assessment task.
Grading Solution: Distance students and face-to-face students complete different items as part of the same assessment task
This solution would suit scenarios like this:
Students will deliver a presentation and then respond to questions from teachers and peers for an Assessment Task worth 35 marks. Face-to-face (F2F) students deliver their presentation and respond to questions in class. You will use a standalone Grade Item to provide F2F students with a grade and feedback. Distance students will pre-record a presentation. They will submit a copy to a Dropbox (worth 70%). You make the presentations available for viewing by linking to them to Discussion Topic. You will mark the Discussion Topic to assess how students respond to questions about their presentation (worth 30%).
Grading system and other requirements
This method requires the use of a weighted grading system. See also the instructions for marking un-submitted and irrelevant items below.
You will need to:
- Create one Category to represent the assessment task and use the options described here.
- Create one Grade Item per assessment item and use the options described here. You must link each Grade Item to the Category that you have created.
- Link each Dropbox/Discussion/Quiz with one of your new Grade Items. If students perform a task in class and do not need to submit items electronically, you can skip this step.
To see an example of what this solution might look like in the Grades tool, download this PDF.
When marking:
- Do not record a mark for items that a student does not need to submit.
- If a student fails to submit an item that they are expected to complete, record a 0 as their grade.
In the example below, Tam is studying F2F, while View Student is studying by Distance. Tam has received a mark of 67/100 for the presentation she delivered in class. No marks need to be recorded for the other tasks, as the F2F Presentation is worth 100% of Assessment 3 (A3) for F2F students.
View Student, on the other hand, failed to participate in the Distance Q&A required of Distance students. To account for this, a 0 mark was recorded for this task, bringing down the student’s overall mark (Subtotal) for the assessment task accordingly.
Grading Solution: Grade a single assessment task comprising one item
This solution would suit scenarios like this:
- Students submit their work to a MyLO Dropbox. Their submission is worth 100% of Assessment Task 1.
- Students contribute to one Discussion Topic. Their contributions to the topic are worth 100% of Assessment Task 1.
- Students complete a Quiz. The Quiz is worth 100% of Assessment Task 1.
- Students complete a presentation in class. It is worth 100% of the Assessment Task. As no files will be submitted, you will use a Standalone Grade Item.
You will need to:
- Create one Grade Item and use the options described here.
- Link a Dropbox/Discussion/Quiz with your new Grade Item. If students perform their task in class and do not need to submit something electronically, you can skip this step.
To see an example of what this solution might look like in the Grades tool, download this PDF.