top of page
Writing Assessment
Writing in itself can be a transformative process that can improve the world around us.  From the countless practical emails that professionals send to each other to the cathartic experience of poetic composition, writing inherently finds a way into our lives in some shape or form.  As an educator, teaching writing is one of the most important services I provide to my students.  Thus, it is imperative that I understand how best to guide students’ growth in writing in the classroom.  To do this, I engaged in research that sought to understand the effects of writing assessment on instruction and students’ overall improvement in their writing.  Early into my research, it was clear that when writing assessment was aligned with instruction, students growth in writing improved (Spence, 2010, 345). Due to this notion, I was curious if different types of assessment, such as analytic and holistic, impacted more than the final outcome of students writing efforts, but also the instruction that teachers use to help their students grow as writers. The following page walks through my inquiry into this area and provides my findings to the following question:
The Impact of Holistic Assessment on Instruction
What were the effects of my instructional alignment with holistic assessment in terms of student writing?

 

These lessons differed from the lessons that were taught for the analytic essay assessments. Due to the holistic assessment, the lessons prior to the essay were aligned to the rubric and the focus of the task.  For example, eight days were provided for instruction to incorporate the “process” model, in which students engaged in pre-writing brainstorming, inquiry, source analysis, outlining, a mini-draft, self-revision, peer-revision, and reflection.  These lessons emphasized the larger points of the holistic assessment such as incorporating specific evidence, addressing an alternative argument, or creating a relevant introduction.  Furthermore, these lessons were designed to not explicitly teach grammar, vocabulary, or specific writing components, but rather embrace writing as a “process,” being mindful of the task at hand, reflection, etc.  After the final pre-essay lesson, students had two days of in-class writing to create and submit their essay.  This was done to limit outside influence and variables from their actual writing.

 

Analytic v. Holistic
The research on holistic assessment and it’s effect on writing is comprehensive.  Educator-researchers Murphy & Yancey in 2008 and more recently in 2010, Rezaei, studied the reliability and validity of various writing assessments, including holistic.  One of the conclusions that these studies made is that assessment, both analytic and holistic, affects teachers’ biases when grading and planning for instruction (Murphy & Yancey, 454-457, Rezaei, 27-39).  This may suggest that when teachers assess and plan writing, they may never be impartial and thus, the assessment they use will impact how their students grow as writers.  Moreover, as assessment drives many educator’s instruction, choosing a writing assessment deeply matters.  In 2008, the NCTE (National Council of Teachers of English) published an educational piece that expounded on the idea of assessment and it’s impact on instruction.  They recommended that holistic assessment be used to teach writing because it allowed educators to see “writing as a multidirectional and multifaceted activity” and best accomplished teaching “the many disparate aspects of writing in a connected fashion” (NCTE, 3-4).  They put forth a range of strategies that holistic assessment allowed for and that teachers could use to help their students learn: teaching writing as a process, limiting exclusive grammar lessons, making writing authentic, etc.  These ideas were driven by the holistic assessment approach, which again focused the educator and student on the larger components of writing (purpose, organization, elaboration, etc.), rather than becoming mired in the minute and many aspects of writing that analytical assessment emphasized.  Furthermore, these writing strategies were backed up by additional research, such as in 2002 by De La Paz and Graham or Fidalgo et. al. in 2008 (De La Paz, Graham, 687-697, Fidalgo, 687-688).  In addition, when writing was made to be authentic, meaning relevant and engaging for students, which the NCTE proposed, students were more successful in their argumentative writing (Smith et. al., 2012, 37-47).  Together, much of the research proposed that holistic assessment in writing could have a direct and positive impact on students, if aligned with instructional strategies.  However, it is important to note that holistic assessment is not the be-all-end-all assessment, as analytical assessment can still be used in many cases to help students grow as writers. 
Although assessment drove much of my instruction already, my experience mainly centered around analytical assessment. Analytical assessment within writing, separated the various components of writing in distinct sections, which were then scaffolded down in each respected component by skill level. Despite some of the positives that the research showed with the use of analytical assessment in student writing (teacher accountability, writer skill identification, etc.), the research also posed many positive implications in the use of holistic assessment with student writing (improvement in key/larger writing concepts, limiting grammatical and convention bias, etc.) (De La Paz, Graham, 2002, 695-697).  As opposed to analytical, holistic assessment evaluated a piece of work based on the total impression.  This limited the separation of writing components and instead, emphasized broader writing skills, while outlining the specifics that made up those larger skills. Due to my lack of practice with holistic assessment (I had mainly used analytical rubrics due to a social studies department-wide decision) and some of the positive implactions that the research espoused on holistic assessment, I decided to focus my research on alignment with holistic assessment in terms of argumentative writing.
The bolded sections in this SmarterBalanced writing rubric were adopted and merged together to create a holistic criteria that represented an overall holistic score.  These criteria and assessment helped guide instruction prior to students writing their argumentative essay.
Scholarly Research on Holistic Assessment and Instruction
Methods

- 90 Middle School Social Studies students

              - Range of writing abilities

              - Regularly met with all students five times a week

- Previous argumentative essay experience

              - Assessed with Analytical Rubric - Scale of 4-1

                - Writing lessons prior to these essays tailored to analytic rubric, incorporated some reflection

- Construct an Essay on the Civil War: What Caused the American Civil War

              - Previous content knowledge on subject from class

- Holistic assessment directed instruction

              - Holistic criteria merged from two sections: “Purpose/Organization” and 

                "Evidence/Elaboration.

                - Score 4-1: 4 represents highest level, 1 represents lowest level

- Instruction adjusted to Holistic Assessment in Writing

 

 

This is a sample lesson that was designed because of the holistic assessment's impact on instruction.  This lesson focused on the process of writing and reflection. 
Results

The holistic assessment on the American Civil War, which incorporated adjusted writing instruction prior to the essay increased students scores as compared to the two analytic assessments averaged together.  For example, in the holistic assessment, 74% of students achieved the ranges of 4-3, while 26% of students achieved the ranges of 2-1.  Compared to the analytic assessments, 60% of students achieved the ranges of 4-3, while 40% of students achieved the ranges of 2-1.  

Anecdotally, the instructional period prior to the essay was engaging for the students.  I had worried that they may have be apathetic towards the essay or writing due to the two weeks of “writing prep” that we did.  However, students seemed more motivated about the essay than they usually were.  Specifically, during the inquiry lesson, where students were allowed to ask questions about the topic and delve into their own research, students were focused and cooperative, digging up interesting information they may not have known before.  Many then digitally shared the information they found with each other.  In addition, the self and peer revision sessions went extremely well.  Students used the self and peer checklists (which were molded to fit the holistic assessment) to guide their writing and adjust their initial introduction and body paragraph drafts. They seemed pleased to have control over their own writing and then, the ability to share their expertise or their thoughts with one another.  However, the brainstorming lesson was not as engaging as the others, which may be a product of the lack of practice in implementing this type of lesson. Yet, my anecdotal evidence of the instructional period noted that overall, students seemed to be attentive and encouraged throughout the process.​

Results of Tailored Holistic Instruction
Essay Reflection Results

 87% of students said that they did believe they improved their writing.

“Do you feel that you improved your writing in this essay: yes or no?”

The students who believed that they improved cited the self and peer revisions as being helpful because they “became the teacher”when sharing with a partner, which in turn, helped them better their own writing.  Many of the students who believed they did not improve, cited outside variables as being a problem with this essay, such as sports being too busy or that they had not received enough sleep.​

"Why?"
Discussion

Based off of the quantitive improvement in students’ writing scores, anecdotal observation evidence, and student reflections, my instructional alignment with holistic assessment helped students grow as writers. 

However it should be noted that the improvement in scores could be because of the time between essays and work done in other classrooms.  Furthermore, the students may have felt stronger about the content area than the past content areas of the analytic assessment essays.  However, based on the anecdotal observations during the lessons and the student reflections afterwards, a strong conclusion can be made that reflects improved writing engagement and growth due to the instructional alignment with holistic assessment. 

 

This holistic re-structuring allowed students to own their writing more and become engaged in the many parts of writing without becoming bogged down by the nuts-and-bolts of it.  This happened for many reasons.  First and foremost, holistic assessment drove me to realign my lessons around the central premise of the ability to “convey information” rather than specific writing components.  This came from the holistic assessment criteria, in which elaboration, conventions, etc. were intertwined under the umbrella of the ability to communicate an effective argument.  

 

 

This engagement contributed to student writing improvement, most notedly in their elaboration. More specifically, most students improved their use and analysis of specific evidence.  This had already been a point of emphasis throughout the year, however, many students acknowledged that after they wrote their initial pre-writing draft (only an introduction and first body paragraph), self revision and peer revision allowed them to go back an add to these parts even more.  Many noticed that they had not explained how the evidence supported their thesis, but when another student pointed it out to them, they both were able to work through it and build their explanation.  Also, many students improved in their essay organization. This may have been because grammar was not as heavily emphasized in the rubric, however some students did acknowledge that they were able to go back during the revision lessons and fix up many minor conventional components.  I anecdotally saw this across many essays, as the frequent spelling errors that I had grown accustomed to or the use of first or second person were less apparent.

 

In addition, the holistic alignment helped me as an educator teach the larger components that I believed to most essential to their writing.  These were mirrored in the SmarterBalanced holistic rubric, such as in using specific evidence or creating a relevant introduction.  Despite me teaching these things before (with the analytic assessment structure), I felt the need to direct grammar or other smaller components simultaneously, which may have distracted me from creating a “process” oriented classroom or even teaching the components well in general.   Furthermore, the holistic rubric seemed to make more sense to the students because it was simpler and not as mathematical. The big ideas for each category were able to be easily transferred to lessons or onto worksheets, such as in the revision checklists.

 

Finally, using the holistic assessment impacted and will continue to impact my teaching because it did not diminish students because they made use of a different lexicon in their writing.  At times, the analytic assessment approach confined and limited students to certain grammar and conventions.  Much of the grammar was necessary for students to grow, however at times the analytic structure and rubric seemed to penalize students who had not learned to incorporate the expected grammar and language into their writing.  However, the holistic structure and rubric allowed me as the assessor to look at the ability of a writer to convey a message, rather than how a writer did in their growth per writing component, such as grammar.  Due to this approach, I was better able to understand what the writer was trying to do with their message and how well they were doing it, instead of looking at their writing categorically. This holistic outlook will undoubtedly impact my approach as a teacher in how, I teach writing (in the ability to convey a message) but also in other elements of my teacher: how I pose class discussion questions or even how I grade other assignments beyond argumentative writing.

 

Although there is a place for analytical rubrics, such as in helping to specifically diagnosis a students writing ability per component, holistic assessment will affect my approach in argumentative and most other styles of writing because of how it can drive instruction;  it places increased emphasis on lessons that have a larger scope in writing, that adopt a growth-process mindset, and that push to create authentic writing experiences.  This was evident in the lessons I created prior to the essay in which I attempted to convey the importance of what the students were doing by relating their experience to the world that they live in (Appendix II).  I focused on initiations or closure activities that spoke to real-world scenarios, their lives, or the essential questions that get to the “why should we care.”  I hope to incorporate this into more of my lessons, whether they have to do with writing or not, because it makes the content and skills relevant for students so that they can better understand it.  Moreover, the writing as a “process” approach was vital in the students’ growth with their writing because of the atmosphere it created, but also the skills that inherently it helped teach.  It allowed students to focus on the “bigger-things” while still using the minor, yet important things to get them there.  With lessons that incorporate holistic assessment components, this type of approach can help students become better writers and learners in any classroom. 

 

Yet, this can be done without using holistic assessment; a teacher may adjust their instruction as they see fit. However, holistic assessment in writing can guide teachers towards this instructional process, which may produce improved writing for their students. Overall, aligning argumentative writing instruction with holistic assessment will help students build reflective skills that may allow them to improve their writing and grow into the life-long learners that educators help inspire them to be.

This helped build a classroom, as the NCTE and others proposed, based on viewing writing as a “process.” This helped enhance writing because it became a reflective and authentic task for the students.  For example, during the inquiry lesson, students were able to individually ask questions that were of most need or interest to them.  This allowed each student to explore at their own pace and based off of their own understanding.  This helped improve each students’ engagement level.  Moreover, the self-revision and peer revision (Appendix I) created a team-like atmosphere which charged students to understand certain writing components.  Students enjoyed helping each other grow, which stemmed from the process model and the idea that writers are not born perfect: they research, draft, revise, and learn from their mistakes.  This atmosphere was different than the instruction prior to the analytic assessments, in which students were asked to essentially show what they know.  Although there was some reflection involved in this analytic process too, students did not fully embrace the mentality of growing through writing because the lessons were not aligned to help them get there.

 

 

The self-check worksheet that was designed due to instructional alignment with holisitc assessment and writing as a "process."

References

 

 

De La Paz, S., & Graham, S. (2002). “Explicitly teaching strategies, skills, and knowledge:

Writing instruction in middle school classrooms.” Journal of Educational

Psychology, 94(4), 687-698.

 

Fidalgo, R., Torrance, M., & García, J. N. (2008). “The long-term effects of strategy

focussed writing instruction for grade six students.” Contemporary Educational

Psychology. 33. 672-693.

 

Murphy, S. & Yancey, K. (2008). “Construct and consequence: validity in writing assessment. “

Handbook of Research on Writing. Charles Bazerman. University of

California. Santa Barbara  448-473.

 

National Council of Teachers of English.  (2008).”Writing now: a policy research brief

produced by the national council of teachers of english.” NCTE. 1-8.

 

Smarter Balanced. (2014). Smarter balanced scoring guide. Smarter Balanced Assessment

Consortium. 1-161.

 

Rezaei,  Ali. (2010). “Reliability and validity of rubrics for assessment through writing.”

ScienceDirect. Elsevier. Vol 15. Issue 1. 18-39.

 

Smith et. al. (2012). “Oh yeah?! putting argument to work both inside school and out.” 

Heinemann. Portsmouth. 1-163.

 

Spence, L. (2010). Discerning writing assessment: insight into an analytical rubric. National

Council of Teachers of English. Vol. 87. 337-352.

Appendix

 

Click on PDF's below to open sample self or peer revision worksheets or process lessons.

 

 

 

Self Revision Lesson
Peer Revision Lesson
Draft Reflection Lesson
Appendix II
Appendix I
Self Revision Worksheet
Peer Revision Worksheet
Click PDF for full research paper
bottom of page