Thursday, August 23, 2018

Context for SOL scores from Spring 2018

As many of you have noticed, the Virginia Department of Education (VDOE) released SOL scores for the 2017-2018 testing period. The State and local results may seem to contradict recent news that for the first time in five years, all Shenandoah County Public Schools (SCPS) will be accredited this year based on SOL results. Those accreditation results will be released later in September. A fundamental belief of SCPS, is that "continuous growth and improvement is expected for everyone."

The accreditation system now includes student growth and improvement in a school's performance. For example, WW Robinson Elementary School was not accredited last school year. However, their SOL performance this year, when including the number of students at the school who performed better on SOL testing last spring, increased quite substantially. The data released on August 22 by VDOE was raw data. It did not include adjustments that are made each year to account for such things as but not limited to: exclusion of results from English Learners who have not had 11 semesters to learn enough English to be able to pass a test in English; adjustments for growth; students who receive remediation and then go on to pass a test; etc.

Another consideration when trying to make sense of raw data, is that there is typically a lack of context, i.e., is the score good or bad? Note that good or bad are terms that are used to compare values. For example, many of us might have taken a test in our past where we earned a score we felt was "bad". However, we may have later found out that our score was among the best in the class. This was the basis for what many of us may remember from our school and perhaps college days as "grading on a curve." The point is, to tell if a score is good or bad, one has to have a point of comparison or context.

More and more SOL testing in Virginia is Computer Adapted Testing (CAT). This means that as students answer questions correctly, the subsequent questions are more difficult. If a student misses items, the items become easier. Whether or not this is a factor in test results, SOL scores in Virginia dropped during the 2017-18 school year. Because Virginia SOL scores include all the scores in the Commonwealth, the change was buffered by the large number of students in the sample. Small divisions in the Commonwealth experience greater fluctuation in scores since their sample size is small. Note that Virginia puts the minimum group size at 30. Here is an example that further explains this point:

Number of students who pass  = Pass Rate;      25 students pass = 83%; 24 students pass = 80%
Number of tests given                                        30 tests taken                  30 tests taken

You can see from this example, that for the State, if the bottom number is 100,000 and the top number changes by one, there is no noticeable difference. However, as the number of tests taken decreases, a swing of just one score can change the pass rate substantially.

When we analyze SCPS scores from last spring, like the state, we experienced a drop. However, our drop was not as large as other surrounding divisions to SCPS and nearly mirrored the drop seen in Frederick County, Virginia. We outperformed Page, Warren, and Rockingham in this regard. While we recognize the need for improvement, when the accreditation results are released, you will observe that SCPS schools had marked improvement, the most substantial of which was in our schools that were not accredited last year or were accredited with warning (WW Robinson, North Fork, and Peter Muhlenberg).

SCPS also experienced tremendous gains among our students who are English Learners (EL) (formerly referred to as ESL), and students who receive special education services. Just looking at raw scores, our EL students experienced gains, on average, of 11 percentage points across all SOL tested subjects. That compares to a Virginia decline for this same group of 2.4 percentage points. In fact, our EL improvements were the highest among the eight divisions we consider comparable, competitive divisions. Another very bright spot for SCPS is among our students who receive special education services. That group, across SCPS, increased their 2017-18 performance by, on average, 5 percentage points across each of the tested areas. This was 2nd in our region (the highest gains were from Augusta County, which saw a 6 percentage point increase for this group) and well ahead of the Virginia performance by this group which FELL by 0.6 percentage points, on average, across all tests.

In conclusion, we have room for improvement. However, in context, we achieved gains on three of our neighboring divisions for all students. We held steady with one. Of the three neighboring divisions that outperformed us, two were divisions that traditionally score lower than we do so they had more room for improvement. We also achieved gains on all of our neighboring divisions for our English Learners and on all but one division for our students who receive special education services. That one division had an average increase of 6 points across each of the SOL tested subjects while the next lower division to SCPS had gains of only 1.6 percentage points. Note that our students receiving special education services increased, on average, 5 percentage points.

Tuesday, February 13, 2018

Steps to Increase Safe Transportation of Students


Shenandoah County Public Schools transports approximately 4,500 students each school day with the support of nearly 110 drivers. As with any major transportation system, the operations are monitored to identify areas in need of improvement. One such area that has been the subject of recent community discussions and some press reports, is the need to ensure that drivers are able to focus on driving and not on distracting or inappropriate student behaviors. To put this in perspective, with nearly 110 vehicles hitting the roads at least twice each day with nearly 4,500 students each time, it is important to note that one or two incidents per week is not an indictment that our transportation system is broken. Do we have room for improvement? Sure we do. But is our system broken? It is not.

To become a driver requires a Commercial Driver License (CDL) Class B for Bus. In addition to behind-the-wheel training and practice, drivers must pass a rigorous exam. The behind-the-wheel experience is facilitated by designated certified trainers in Shenandoah County Public Schools. Drivers must maintain driving records that enable them to maintain their license. They are subjected to random drug testing.

However, not surprisingly, few drivers come to the profession with explicit training in managing the behavior of students, particularly when students fail to see the bus as an extension of school and therefore, exhibit behaviors they would never entertain in a classroom. To set expectations for students, the school division has a very clear set of rules which is included in the student handbook. Parents are asked to review and acknowledge their awareness of these rules each year.

Because continuous improvement is a fundamental belief of the School Division, recent incidents have caused us to re-examine at our policies, practices, procedures, and regulations. In doing so, a group of drivers and administrators was convened to make recommendations to me to reduce infractions. As a result, the Division is taking the following steps:
  • Better aligning School Board Policy to the Student Code of Conduct for bus behavior to include responses to infractions. The School Board reviewed a copy of the revised Policy on February 8 and is scheduled to vote on the revisions on March 15.
  • Providing coaching opportunities to drivers to assist them in managing bus behaviors as necessary and when and how to engage school administrators for serious infractions. This is similar to our teacher mentoring and coaching programs.
  • Reminding administrators to continue to be present at buses at school dismissal when disciplinary issues are most likely to exhibit so that student conduct is orderly before buses leave the school.
  • Producing educational videos employing our own students as actors to demonstrate to their peers our expectations that the bus is an extension of school and behaviors that are expected in school are also expected on our buses and vehicles.
  • Reaffirming that disciplinary infractions have consequences and will be dealt with swiftly. While we provide transportation to all students, it is not a right, and can be suspended or even revoked.
  • Engaging courts, Child Protective Services, and other agencies if a parent fails to comply with compulsory attendance laws when a student is removed from a bus for disciplinary reasons.

In announcing these steps, it is important to acknowledge that our drivers are an extremely important part of our school division. They safely transport thousands of students to school each day. These changes affirm the value and importance of our drivers and set the expectation that our buses and other vehicles are an extension of our schools. Also, given the complexity and scope of our transportation system, the only county-wide transportation system in Shenandoah County, it’s important to keep individual incidents in perspective.

Though the timeline for these changes is immediate some aspects such as production of training videos will require additional time.

Monday, January 8, 2018

Small and Rural Schools Coalition

In my previous blog entry I shared insights into the operational budget that allows Shenandoah County Public Schools to meet key educational outcomes for our students and community. This entry provides a perspective on some issues that challenge traditional budgeting.

Over time, and perhaps reaching a critical point last year while preparing budgets for the current FY18 fiscal year (school year 2017-18), a number of Virginia public school divisions, largely in the rural and mountainous southwest area of the state, joined forces to confront issues arising from traditional funding procedures from Virginia. Calling themselves the "Coalfields Coalition" these divisions were rural, had declining enrollment, had high rates of unemployment and resulting poverty,  and were reliant on higher percentages of state funding for their local budgets than more affluent areas. Because funding by the state is formula driven, none of these variables were working in favor of addressing the challenges these divisions were facing. Several Virginia "city" divisions similarly coalesced to have a larger voice.

The result was passage by the Virginia legislature, and signed by the Governor, approval of additional state funding to help address some of the negative effects of reductions in state funding.

More recently, the small and rural school divisions around the state have once again  coalesced.  Calling themselves the "Small and Rural Schools Coalition" the group of approximately 64 school divisions is emerging as a vocal group advocating to identify ways in which state funding can be used to build sustainable and equitable foundations to help stressed divisions adapt to changing conditions. While 64 divisions have expressed interest in being a part of the coalition, approximately 80 of the 132 Virginia public school divisions would qualify.

While not every district is identical, generally characteristics of the small and rural divisions include, but are not limited to the following:

  • high rates of poverty with the percentage of students qualifying for free and/or reduced price lunch at 50% or higher;
  • declining enrollments;
  • higher percentages of state funding for local operational budgets and declining state funding;
  • over reliance on local property taxes to fund the local share of operational budgets; and
  • high rates of teacher turnover. 
A review of data thus far, shows the following more specific discrepancies when comparing the the small and rural schools to the more affluent areas, such as northern Virginia:

Affluent Schools: increase in per pupil funding of 4.7%
Rural Schools: decrease of 11.3% in per pupil funding. 

Affluent Schools: decreased proportion of local funding for public education
Rural Schools: increased proportion of local funding for public education

Affluent Schools: higher dropout rates than rural schools

On Thursday, January 11, 2018, the Shenandoah County School Board is slated to approve a resolution supporting the creation of the Small and Rural Schools Coalition. Once the approval occurs, stay tuned for additional updates as to the success of efforts of the group to bring attention to equity of state funding in Virginia. 

Friday, January 5, 2018

Development of the Shenandoah County Public Schools Budget

As we move into the FY19 Budget season (budget for the 2018-19 school year), the following provides insights into the budget process in Virginia and in Shenandoah County. 

The Code of Virginia mandates that the Superintendent develop a needs-based annual budget. Per Virginia Code § 22.1-92, "It shall be the duty of each division superintendent to prepare, with the approval of the school board, and submit to the governing body or bodies appropriating funds for the school division...the estimate of the amount of money deemed to be needed during the next fiscal year for the support of the public schools of the school division."

It is important to understand that any budget is an estimate. For example, while we can estimate with some certainty how many students will show up for school next year since we know, for example, how many grade five students will be moving to grade six, how many seniors will be graduating, etc., we are never certain of exactly how many new kindergartners will arrive to take the place of the graduating seniors or how many families will move out of or into our school division. We also don't know if students with special needs might move in such as a student who is deaf and needs sign language support adding to our per-pupil costs. Estimating too many students inflates our revenue projections from the state and estimating too few students can cause the need for additional teachers or supplies that were unbudgeted. We have a reasonably good track record of accurate projections. 

The majority of school funding in Shenandoah County comes from Virginia. The next highest amount of funding comes from local funding. This is not the case everywhere. In some school divisions in Virginia, local funding exceeds state funding.  The determination of the balance between the state and local share of funding is calculated using a complex formula referred to as the Local Composite Index (LCI) which calculates the ability of the locality to fund public education to meet the minimum standard known as the Virginia Standards of Quality (SOQ). It is important to note that divisions that enhance their instructional programs beyond the minimum SOQ, must receive revenue to fund those enhancements. 

The LCI formula depends on such variables as average daily membership in the division, property values, sales, and incomes and in Virginia, is calculated every two years to coincide with the state's biennial budget cycle. For example, in Shenandoah County, our current LCI is .3663 which means that for every dollar of funding for public education, the locality should provide a minimum of $.3363. The LCI in Virginia ranges from a low of .20 to a high of .80 with wealthier communities at the .80 level. The calculation for LCI for the next biennium for Shenandoah County is proposed to be .3821, an approximate 4.5% increase over the current level. While the increase in the LCI is a positive indicator of the increased vibrancy of our local economy (higher property values, higher incomes, etc.) it means that if such things as enrollment remain constant, Shenandoah County Public Schools will see a reduction of approximately $615,000 in state funding from Virginia starting July 1, 2018. 

This last section describes the procedures for how the local share of funding for public education in Shenandoah County and throughout Virginia occurs.

Because local school boards do not have taxing authority in Virginia, school divisions are dependent on the local government's approval of their share of the local funding as required by Virginia Code. The local transfer from the governing board is only part of the local funding since other revenues such as student tuition for dual enrollment courses, grant funds, endowments, etc., are considered local but are not funded by tax dollars from the local governing body. The local governing board is not permitted to allocate or withhold funds for specific purposes as this authority is granted to the local school board, which in Shenandoah County is an elected board in their own right. This is just one reason why a good, collaborative, trusting and a respectful working relationship between the local governing board and local school board is so important.

The next blog post will highlight a new Virginia initiative that may challenge the current structures in school funding with respect to state revenues that support public education. 



Thursday, August 17, 2017

SCPS Teacher Salaries Fall Behind

The following was a topic of a great deal of discussion and concern at the August 11, 2017 SCPS School Board Strategic Planning meeting.

The Shenandoah County Public Schools Compensation Policy sets as an overall goal, "...to attract, reward and retain qualified employees who can help Shenandoah County Public Schools achieve its mission. The Policy further states that in"...support of this broad goal, the program is designed to maintain the salary structures at market competitive rates through periodic benchmarking of salaries of no less than once every five years." In addition, a draft 2017-18 Division Goal, slated for Board approval at its September 14, 2017 meeting states: Attract, retain, develop, and support high quality and diverse staff to reach organizational excellence.

The target range for our salaries is the median of our comparable, competitive divisions. Median means the middle--not lowest, not highest, but the middle, with half the divisions higher and half lower. By policy, these Divisions are identified as Augusta, Clarke, Frederick, Page, Rockingham, and Warren Counties and Harrisonburg and Winchester City Public Schools.

In developing the budget for FY18 (School Year 2017-18), funding was not sufficient to provide salary improvements for Shenandoah County Public Schools employees. The only other division among these benchmark divisions that did not provide salary adjustments was Page County Public Schools.  Therefore, our progress in reaching median for teachers stalled.

What are the results? In one word, devastating! Our variance from median has increased sharply in the wrong direction, placing teachers thousands of dollars behind their colleagues in our competitive divisions. For example, a ten year teacher in SCPS earns $44,028. The median for our comparable divisions is $46,156, a difference of over $2,000. (Note that teaching requires a college or university degree, obtaining and maintaining state licensure with its own set of additional requirements, and satisfactory or better job performance.) If this salary inequity continues not to be addressed, and if everything remains equal, which it is not, this is $2,000 per year for every year a teacher works in SCPS past ten years. With retirement an option after thirty years, that's $60,000 in earnings over twenty years.  By year thirty, the difference in salary of a teacher to the median of our competitors grows to nearly $4,000. This is unacceptable and will require investment!

While our turnover rate held steady at 15%, we are losing our experienced teachers in whom we have invested greatly through training, onboarding, etc., and who have established priceless relationships with our students, their families, and our community. Furthermore, research links the loss of high quality teachers to student achievement challenges. Put more simply, while it is not the only reason, the loss of our high quality teachers is linked directly to student performance and for the first time ever in SCPS, the loss of accreditation for two of our nine schools. While we've been able to recruit new, high quality teachers, many are in their first year(s) of teaching and will need time to learn and develop into highly skilled teachers and to develop those all so powerful relationships.

The following data show our challenges and require no further explanation.

These include:

  • Our teacher turnover rate for the past three years compared to our competitors listed above. (Of note is that while Winchester's turnover, at 20% exceeded that in SCPS, 9% of our teachers who left went to fill the empty slots in Winchester!)
  • Graphic showing how we are losing teachers to our competitors
  • The benchmark teacher salary data
  • Reasons given by teachers who leave and their voluntary responses to exit interviews and survey responses
  • School accreditation for 2017-18






Sticks and Stones...

I have been privy to inquiries and articles regarding changing names of public buildings in response to recent events in Charlottesville. The following represents my perspective on the topic. 

Many Americans have been troubled about the recent unrest in Charlottesville, as well as the observation that the trending in this direction is not an overnight phenomenon, but has been gradually transitioning over the past decades to today's more uncivil, intolerant society.

However, we have a history in the US that we here today did not create. Because history repeats itself, it is important to remember our history, to include all of the good and the bad, the very words which are value judgments. In fact, here in Virginia, our history courses deal with our past better than other states, providing an accurate study of events. I believe it is incumbent on us, as public educators, to teach our students, as well as model for them, that it is not the names of buildings, streets, or other public or private entities, but the environments within that define us as a nation and a community. Our policies and our actions as a school community reiterate this, communicating and holding ourselves accountable to no tolerance for harassment, bigotry, or incivility and taking swift action when it is reported and founded. 

We will remain vigilant in upholding these principles and values as a public school division and community. Changing a name does not accomplish these values other than serve as a lightning rod to divert attention away from the actions that truly matter. 

Friday, July 14, 2017

Continuous Improvement in Shenandoah County Public Schools

INTRODUCTION

While Spring 2017 Standards of Learning (SOL) testing data is still preliminary, results for Shenandoah County Public Schools (SCPS) so far appear to be mixed. While there is much good news to be celebrated, a fundamental belief of SCPS is that continuous growth and improvement is expected for everyone. Of greatest concern to me, is that in many of our schools, our reading scores are below the average reading scores for Virginia’s students. We must not only acknowledge our challenges, we must also acknowledge that we can do better! While it may be obvious, just in case it’s not, to improve we must address those challenges over which we can exhibit control. And as frequently noted, many of these challenges have been discussed throughout our needs-based budget development process over the past several years.

CHALLENGES

The single most important variable affecting student achievement, over which one can exercise control, is the quality of the teacher (OECD, 2005). A major factor that affects our performance is the turnover rate for teachers which last year reached 15%. While we are still in the midst of this year’s hiring season, we anticipate we will once again reach a rate close to or slightly higher than 15%. Over the past four years, more than 288 teachers have left the division which is a turnover rate approaching 60%.

Not only are experienced teachers leaving, they are being replaced with teachers just beginning their careers. While our teachers work very hard and care deeply about children, how many professionals are at the top of their craft in their first or even second year? Why should public schools be any different than successful companies that strive to train, develop, and retain a skilled workforce? Salary and benefits continue to be major causes for our turnover. While this is something that can be addressed, recall that last year budget resources were so severely limited that no salary increases were provided even though surrounding divisions to which we lose experienced teachers, increased salaries. This put us even further behind in ensuring our salaries are at median of comparable, competitive divisions.

Another important factor is that Virginia, like most states, has an accreditation system that rewards schools with higher numbers of students of affluence. A recent blog entry by Matt DiCarlo (July13, 2017) notes that the majority of states have accreditation systems that rely “…heavily on simple proficiency rates to grade schools, and so the overall grades still strongly ‘favor’ schools with more advantaged students, regardless of the growth measures used.” While the Virginia Board of Education is attempting to change the accreditation system, we unfortunately continue under the old system for the coming year. To read about the rationale behind the changing Virginia accreditation system, read the editorial in the Richmond Times Dispatch (July 12, 2017) by Diane T. Atkinson, Chairman of the Virginia Board of Education’s Committee on School and Division Accountability. While the changes described by Ms. Atkinson mark a more comprehensive accountability system, it still relies on SOL testing to measure student growth.  

ACTIONS

As we look to the 2017 Opening of School, which for students begins on August 7, we will be seeing a number of positive changes that are targeted to improvement efforts. I will describe just a few of those.

New Instructional Calendar

Our new calendar will provide additional instructional time prior to Virginia testing. For example, Virginia test administration dates are set each year by the Department of Education. By having students start school prior to Labor Day, as the large majority of divisions already do, students will have additional instructional time prior to testing. Also, the breaks in the instructional calendar better align with holidays so that they are more natural and conducive to the flow of the calendar.

Personnel

Though resources were not sufficient to provide salary increases for staff, the Division was able to make several staffing changes. One such change directly related to support for reading instruction was the addition of an English Language Arts (ELA) Specialist position. This position will provide specific curriculum and instructional support for Reading, and while serving in a K-12 capacity, is targeted to support for K-8 reading. The new ELA Specialist has been busily working with summer planning teams to ensure the smooth opening of school and maximize her support to teachers and principals.

Monitoring

Previously the division has used various data sources to provide feedback on student growth and development throughout the year so that struggling students would be identified and provided additional specific supports. Such data are commonly referred to as formative data since they inform instruction. Challenges with formative assessment include the extent to which such data is truly predictive of ultimate performance (also known as summative performance) as well as the identification of specific instructional materials and activities personalized to student need. This year, the division has redirected formative assessment funding to a new personalized assessment product, i-Ready, for K-8 Reading and K-5 Mathematics. Not only does i-Ready provide access to student growth data over time, it is predictive of summative SOL performance and includes instructional materials personalized to student need.

Framework for Improvement

Finally, SCPS will be implementing a more structured improvement framework to our continuous improvement efforts. More formally referred to as Improvement Science the framework consists of six “Core Principles” that include identifying the problem of practice, measurement, analysis of data variability, actions to improve performance, all in the context of an improvement community of stakeholders. Based on the work of Deming in the business world, Improvement Science out of the Carnegie Foundation for the Advancement of Teaching is more specific to the needs and realities of K-12 public education.  

EXPECTATIONS FOR ACCREDITATION OF SCPS SCHOOLS AS OF JULY 14, 2017

It is expected that six of the Division’s nine schools will be fully accredited. This is an increase of one from last year.

SCPS Schools expected to be fully accredited are:

Ashby Lee Elementary
Central High
Sandy Hook Elementary
Signal Knob Middle
Stonewall Jackson High
Strasburg High

It appears that Signal Knob, which had been Partially Accredited Improving last year, will be fully accredited this year.

Peter Muhlenberg Middle, North Fork Middle, and WW Robinson Elementary do not appear to have reached the Virginia benchmark scores to be fully accredited this year.

It appears that Peter Muhlenberg will be conditionally accredited and receive the label “Accredited with Warning” due to not having reached the Virginia benchmark in reading. This will be the third consecutive year that Peter Muhlenberg has missed the Virginia benchmark.

Scores at North Fork increased in three of four areas (reading, science, and social studies) with three areas exceeding the Virginia benchmark for accreditation (mathematics, science, and social studies). However, reading did not increase enough to meet the Virginia benchmark. Because this was the fourth consecutive year the Virginia reading benchmark was not met, it is expected that North Fork will not be accredited in 2017-18.

It appears that WW Robinson will not reach the Virginia benchmark for reading for a fourth consecutive year. Because of this, it is expected that WW Robinson will not be accredited. It also appears that WW Robinson will not reach the benchmarks for mathematics and science. 

CONCLUSION

While we don’t yet have Virginia data for Spring 2017, for the 2016-17 school year 173 schools throughout Virginia’s 132 divisions received either Accreditation Denied or Partially Accredited Reconstituted status. This is the first year in SCPS history that we have the potential to have any schools in either of these two categories. 

We believe we have a solid plan moving forward to take on the challenges accreditation presents for our schools. While we have a solid plan to lead substantial improvements as noted above, it’s also important to underscore what we will NOT be doing. The drive for scores has caused many schools throughout Virginia and the nation to stop offering students music, performing and visual arts, and physical education instruction. Because these subjects are such a vital aspect of the experiences that enrich the lives of children, we will not decrease our offerings in these critical areas. Although tests are important, we realize there is more to a child’s experience than passing a test. We are therefore committed not to become a “test-prep” factory model of education. We will continue to expand opportunities for authentic experiences so that students are engaged in and take ownership of their learning. If anything, our expectations for both staff and students are increased in this regard since we know that these skills will enable lifelong learners and there will be pressure to move to test prep strategies and approaches.


Being true to our fundamental belief that we know we always have room for improvement, we are ready to take on the challenges accreditation presents to our staff and students.