Review and Improve is where Scribo helps the most

Reviewing texts, giving feedback, tracking students at risk, coaching, mentoring and generally teaching across multiple students and classes is a huge job.

When it comes to helping teachers manage workloads, save time and improve student connections, Scribo does everything in one-click journeys through Live Monitoring.

Review and Improve integrates a range of communication features, functions and feedback loops to support pedagogy

Single Intent – Save time with better information

The Writing Panel Report creates insights and lesson plans for teachers, students and class collaboration – in minutes

Scribo builds a body of knowledge for teachers to share with students

Save time, reduce workloads, see better information

Cohort – Writing/Panel Reporting can be integrated into classroom collaboration in 2 ways

1. Upload Student Texts

Scribo lets teachers quickly load in texts received from students. This feature is used by many teachers every day.

From New Activity – Select

2. Select Panel Report from Live Monitoring

As texts are being written by students, they can be processed into a Work in Progress Writing/Panel report. This way, the Panel report can be run as many times as you like across the writing activity.

1. Go to Live Monitoring

2. Click the 3-dot command centre

3. There must be at least 2 students with text to compare. Do ensure that there are over say 150 words in each text so the analysis is worth you looking at.

4. Click Generate / Regenerate Writing Report.

5. Scribo will tell you when the texts have been fully analysed.

6. When the report is ready (usually in 2-3 minutes) you will get an onscreen message and an email.

7. Launch the Writing Report from the Activity in Progress list or the menu in Live Monitoring.

3. Launch Panel Report from In Progress

PEER REVIEW IN SCRIBO

It’s a 2020 Christmas and our gift to you this year is Peer Review. We have been working most of the year with assessment and pedagogy experts at the NIE of Singapore, looking at how we can further support authentic assessment and assessment for learning around writing. Peer Review was part of the puzzle that we wanted to solve. It’s now done and ready to go!

AFL is a bit harder when you are dealing with multiple students and long format text but that’s the challenge we took on and conquered. Peer review plays a key part of AFL. I actually prefer to call Peer Review, Feedback in the Moment. This style of feedback is like a renewable energy in a classroom that amplifies stories across learners.

We also looked into the latest feedback research coming from Hattie and Clarke to make sure we were triangulated with current meta research on feedback. It's been a busy cycle of development but one we are very happy with. Our thanks also go to the literacy leaders and school improvement leaders in the Wollongong Diocese in NSW for their generous feedback on the journey.

Research is compelling.

What we discovered from the research is that feedback is one of the most powerful influences on student learning,improving student writing skills and building confidence. That statement comes with a classic however...

Hattie and Clarke ( Visible Learning - Feedback 2019) found that while feedback is the most powerful influencer on learning , it is also the most variable. These are their conclusions.

• About ⅓ of feedback doesn't work - it’s negative

• Feedback for one child does not work for another

• The feedback you give today - doesn't work for tomorrow

Catering for less variable feedback that potentially can be negative, tailoring feedback for each student and continually re-working the feedback each time a student needs more feedback are the three key components to Scribo that cover off the limitations Hattie and Clarke found.

Feedback needs to be in the writing moment, made available closer to the writing event. Feedback needs to avoid being negative and critical, change per student and change as needed in a continuum of feedback, kind of like a continual assessment against a rubric. This all sounds great but practically teachers don't have the time to do all this, all the time. Feedback at three levels is hard time consuming work. It’s time for AI to help teachers and students.

Hattie and Clarke say there are two important parts to feedback that need to be understood.

1. Feedback is the answer to 1 of 3 questions

   1. Where am I going

   2. How am I going

   3. Where should I go to next

‘Where I should go next’ is the critical piece of feedback that is most time consuming for a teacher. Thirty plus essays all needing personalised feedback is a massive time challenge and workload.

The most interesting finding is that If students don't get where to next feedback, they say they never got any feedback. I remember this happening in our house when my boys came home with lots of correction ink but very little connected advice that directed ‘where to next’ feedback about their writing. Hard work became a paper basket shot into the bin.

1. The second finding was that It's often not about the feedback you give, it’s about the feedback you hear and see.

How do students and teachers hear and see the feedback from what is happening in classrooms? These are the invaluable stories that need to be seen and heard.

The classroom is where in person teaching and learning happens, it's the colosseum of collaboration. Writing practice is supposed to amplify the learning and practice new skills. Often writing and feedback are very disconnected from the momentum of the classroom reducing the opportunity of immediate reinforcement and guidance.

Although teachers move around the classroom asking questions and giving feedback, when they are not explaining at the front, the last twenty years have been the subject of finding more efficient ways to ensure all students get feedback, from the teacher, and their peers while they are in the process of learning.

The very essence of formative assessment or feedback is the ability to react to the learning during the learning so it can be enhanced before it is too late. (Hattie and Clarke, 2020 , Visible Learning - Feedback)

With our new functional Peer review capability, teachers and students can see and listen to feedback in a 360 degree mode, learning every step of the way. Critically this happens seamlessly, live and without adding more work for anyone. Less friction, more stories, more learning! What is the downside of that ! ABSOLUTELY NOTHING!

Welcome to Peer Review or what I like to call - Feedback in the moment

1. Setup Peer Review

Peer Review is an option for all teachers to use, activated on demand through Live Monitoring options. Click Options , Click Peer Review.

2. Establish Student Pairings

By default, Scribo will Pair your students at random. Any odd numbers of students without a Pair will be shown. You can quickly assign a review partner.

Change Pairings manually at any time

Select One student and click Mutual Review to reverse the pairing or manually assign a Review partner.

On the top right , click Progress .

4. Remind Students with email

5. Students access Peer Review

The link in the email will take students directly to the Peer Review document.

If the options we set to Anonymous there will be no names seen by either Student. Only teachers know who reviewed work.

If Students have a Per Review to do, the Peer Review menu item will show.

6. Students Rubric Grade Peer texts

Students select Rubric Grade if they have been asked to score the Peer text against a rubric.

Simple click and select across the Rubric levels.

Once the rubric is scored across all levels, the Grade will be shown.

7. Peer Review Text Check and display

Click the Report option

The default display shows all commentary and comments from Students in pairs.

Search for specific students at any time.

If you want to delete a comment for being inappropriate, click the red X

If you would like to show comments on the white board or projector - click hide names.

8. Peer Review Rubric Summary of Student assessments

As students assess peers using Rubrics, Scribo records the scores and presents a summary of where the class sits. The numbers represent the number of students.

Click on the Rubric cell and see the students linked below.

Enjoy Peer review as much as we do.

Live Monitoring connects Teachers to Students for all Writing Activities

Live Monitoring is launched from In Progress

1. Each Activity per class is listed. Change Class to find specific activities.

2. All Options are available for each Activity in progress – see below for details.

3. Open an Activity by clicking Monitor.

Live Monitor Activity Options

The Live Monitoring Capability

Live Monitoring functionality is delivered in one control screen, in one click to get to where you need to be.

Live Monitoring – Student Text Review

Students are rated per core element

Each element rates students across the Cohort in order

1. Click on any element in the wheel. The Panel will refresh

2. Pick Cohesives

3. Pick Paragraphs

4. Student performance is rated with a key metric. Cohesives are rated Common to Advanced

5. Students needing the most help with Cohesives are rated top to bottom

Drill into each student's individual panel report

1. Hover on student name

2. Select tick for marking

3. Person icon for panel report

4. Pen to edit student text if there were errors in the text submitted

Hyperlinks are all over the Panel

Click to see live examples extracted from student texts – anonymous of course

All over the Panel Report, live context examples are shown. This is how Scribo cuts down on lesson preparation time.

The Writing Report delivers multiple outcomes – on demand

Six Levels of Analysis + 1 (Overview)

Scribo uses a very generic 6 levels of analysis that easily maps to US 6+1 Writing Rubric (with the exception of Presentation). This level of analysis is not a particular rubric analysis. The levels that Scribo creates are relative to the Cohort and based on four quartiles of analysis. The whole idea of the Panel Target Board is to give teachers a heads up on where Scribo finds high, medium and low levels of core performance across the six core elements of writing.

These levels are generic and easily map to other well-accepted structures like the Common Core 6+1 Writing Rubric.

Analysis Overview

When a section is clicked on, Scribo takes teachers to that section of the report. There are four zones, coloured in Red, Orange, Yellow and Green. These are the 4 quartiles of student performance.

In one eyeshot, Scribo shows where teaching time could be focused. In this case and student cohort, Topic, Vocabulary and Sentences are the main issues needing teacher attention.

Analysis breakdowns to note – highlights of analysis 6 + 1 (Overview)

1. Overview contains target and general information that looks into a range of elements like

   1. Feedback – once feedback starts flowing from teachers

   2. Targets for writing – keywords, paragraphs, words

2. Topic

   1. Overall writing grade levels

   2. Prevalent keyword usage

   3. Identification of core topics written about

   4. Sentiment Analysis

3. Cohesives

   1. Full analysis of types, examples and usage

   2. Common, Advanced, Multi-word

   3. Cohesives Explorer

4. Paragraphs

   1. A breakdown by paragraphs across word and sentence counts

   2. Word Choices and variety per paragraph

   3. Sentence counts

   4. Extracted examples of good paragraphs and not so good paragraphs

5. Vocabulary

   1. Breakdown of word choices – word clouds

   2. Advanced, common, intermediate and academic word analysis

   3. Word clouds per type

   4. Least frequently used words

   5. Multi-syllable words

   6. Examples of all words in context of student usage

6. Sentences

   1. Breakdown across all sentence types and examples from student texts

   2. Long sentences with examples across all types

   3. Analysis of sentence length across all sentences

   4. Sentences with most syllable words, plus examples

7. Spelling and Grammar

   1. Syllable analysis of all words

   2. Common errors, examples and classifications of errors

   3. Commonly misspelt words

Add a Group feedback comment with 1 click

One click on group comment and feedback goes to the whole cohort. As you review the Panel Report you can add a group comment about any issues you see.

Click on the Student icon and go into Student mode

This puts you in the class – in anonymous mode – ready to talk to the screen

With student names hidden, teachers are ready to project the panel and collaborate with the class.

No names are shown until you click the student icon again.

Z Scores show where skills and students are placed

Looking across a Cohort for where the biggest impact needs to be made, this shows a distribution of students above and below the mean of the cohort.

Student Reports – never consign your feedback to a paper ball in the bottom of a bag ever again!

Send Writing Reports to students

1. Make sure you are ready to release writing reports. If you are grading in Scribo, complete that first.

2. You can send reports to all or some students.

3. You can choose what you want to include in the report.

4. Scribo normally has the student email on file. You can overwrite the email address to send the report to a parent or other teachers if you wish.

5. Writing Reports are available to students from the student login.