91直播

Federal

Ed. Dept. Issues Inaugural Guide For Evaluating Online Learning

By Andrew Trotter 鈥 July 11, 2008 4 min read
  • Save to favorites
  • Print
Email Copy URL

The U.S. Department of Education has released its first to the evaluation of K-12 online-learning programs, which have grown rapidly in recent years while evaluation methods for such education have lagged far behind.

The evaluations highlighted in the guide, which range from internal assessments to external scientific studies, demonstrate how program leaders and evaluators have successfully implemented strong evaluation practices despite challenges that seem inherent to learning in an online environment, according to the guide.

鈥淲hile online-learning programs that deliver courses have been around for about a decade, this report is the first to fully address the issues in evaluating online programs in K-12 education,鈥 said Susan D. Patrick, the president and chief executive officer of the North American Council for Online Learning, or NACOL, which released its own standards for online programs earlier this year. (鈥淰oluntary Online-Teaching Standards Come Amid Concerns Over Quality,鈥 March 5, 2008)

School districts are turning to online courses, Web-based diploma-granting programs, and online instructional resources to address missions ranging from offering Advanced Placement courses or specialized instruction to more students, to 鈥渃redit recovery鈥 and alternative education, to providing supplementary resources to teachers and students in regular classrooms. Individual students and private and charter schools are also using more online learning, often with public funding.

The U.S. Department of Education, in its latest survey on distance learning, released last month, found that while the share of school districts with students who were enrolled in technology-based distance learning courses rose only slightly from 36 percent in the 2002-03 school year to 37 percent in 2004-05, the number of course enrollments vaulted from an estimated 317,000 to 507,000 for those years.

New Evaluations Needed

But evaluation methods have lagged far behind the swift growth, varied application, and complex nature of online learning.

鈥淥nline [education] adds a number of unique elements鈥攊n some cases, we need to build new [evaluation] instruments,鈥 Timothy J. Magner, the director of the Education Department鈥檚 office of technology, said in an interview.

Mr. Magner spoke on a panel about evaluation issues at the National Educational Computing Conference in San Antonio on July 2, the day the report was issued.

In the interview, he noted that an online course that has students at many different locations raises questions about the best types of data collection for measuring a program鈥檚 effectiveness. The research contractor that prepared the report, San Francisco-based WestEd, analyzed seven recent evaluations that were seen to be models of the types of studies needed for online programs and instructional resources.

The evaluations were of Alabama Connecting Classrooms, Educators, & Students Statewide Distance Learning; Algebra 1 Online; Appleton eSchool; the Arizona Virtual Academy; the Chicago Public Schools Virtual Academy; Digital Learning Commons; and Thinkport.

Descriptions and lessons from those evaluations form the heart of the 68-page report.

鈥淭he standards for evaluating online resources are different than the more comprehensive criteria that is needed to evaluate an online program, such as a virtual school within a state or district that offers a full course and provides a highly qualified teacher through online teaching,鈥 said Ms. Patrick of NACOL, based in Vienna, Va.

Emphasizing Results

Ms. Patrick, who was Mr. Magner鈥檚 predecessor as the adviser on educational technology to U.S. Secretary of Education Margaret Spellings, said she made suggestions for the report based on a draft of it. She said she urged the department to separate the evaluation issues pertaining to complete online courses and online supplementary resources.

The report shows that the department 鈥渋s focused on research to inform practice, and supports the growth of the important innovation of online learning in K-12 schools,鈥 Ms. Patrick said. She added that she hopes the department will publish the evaluation instruments used in the research, to make the report 鈥渟calable鈥 for other school districts.

Saul Rockman, a researcher and program evaluator, said that the ideas in the federal report are 鈥済eneric,鈥 but that it still 鈥減uts vendors on notice that their customers want to know the range of impacts they are likely to see from a distance-learning course or program.鈥

Mr. Rockman, the president of Rockman et al., based in San Francisco, added that 鈥渆valuation doesn鈥檛 have to be cost-prohibitive.鈥 Where extensive studies are not practical, simple measures of student participation and engagement in the academic subject can 鈥渁llow you to talk more knowledgeably about issues important to the school community and that have value for kids,鈥 he said.

A version of this article appeared in the July 16, 2008 edition of 91直播 as Ed. Dept. Issues Inaugural Guide For Evaluating Online Learning

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of 91直播's editorial staff.
Sponsor
Student Well-Being Webinar
Improve School Culture and Engage Students: Archery鈥檚 Critical Role in Education
Changing lives one arrow at a time. Find out why administrators and principals are raving about archery in their schools.
Content provided by 
School Climate & Safety Webinar Engaging Every Student: How to Address Absenteeism and Build Belonging
Gain valuable insights and practical solutions to address absenteeism and build a more welcoming and supportive school environment.
Student Well-Being K-12 Essentials Forum Social-Emotional Learning 2025: Examining Priorities and Practices
Join this free virtual event to learn about SEL strategies, skills, and to hear from experts on the use and expansion of SEL programs.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide 鈥 elementary, middle, high school and more.
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.

Read Next

Federal Trump Threatens Funds to Schools That Let Trans Athletes Compete on Girls' Teams
The sweeping order is a reversal from the Biden administration, and continues efforts from Trump to roll back protections for transgender youth and adults.
4 min read
President Donald Trump speaks before signing an executive order barring transgender female athletes from competing in women's or girls' sporting events, in the East Room of the White House, Wednesday, Feb. 5, 2025, in Washington.
President Donald Trump speaks before signing an executive order barring transgender female athletes from competing in women's or girls' sporting events, in the East Room of the White House, Wednesday, Feb. 5, 2025, in Washington.
Alex Brandon/AP
Federal Can Trump Ax the Education Department Without Congress?
Trump has been flexing his power through executive orders, and there's the potential for one targeting the Education Department.
7 min read
The U.S. Department of Education in Washington, D.C., is pictured on Feb. 21, 2021.
The U.S. Department of Education in Washington, D.C., is pictured on Feb. 21, 2021. President Donald Trump could issue an executive order to downsize the department. It would have limitations.
Graeme Sloan/Sipa USA via AP
Federal Top House Lawmaker Supports Trump's Bid to 'Depower' Education Department
The House education committee chairman believes "even the best-meaning bureaucrat" can't understand what's happening in local schools.
5 min read
Rep. Tim Walberg, R-Mich., speaks during an event at the COP28 U.N. Climate Summit on Dec. 9, 2023, in Dubai, United Arab Emirates.
Rep. Tim Walberg, R-Mich., speaks at the U.N. Climate Summit on Dec. 9, 2023, in Dubai. Walberg, the newly minted chair of the U.S. House's education and workforce committee, said at a Tuesday event that he wouldn't stand in the way of President Donald Trump's efforts to diminish or close the U.S. Department of Education.
Joshua A. Bickel/AP
Federal Title IX, School Choice, 鈥業ndoctrination鈥欌擧ow Trump Took on Schools in Week 2
It was a week in which the newly inaugurated president began wholeheartedly to act on his agenda for schools.
8 min read
Republican presidential nominee former President Donald Trump arrives at an election night watch party at the Palm Beach Convention Center on Nov. 6, 2024, in West Palm Beach, Fla.
Donald Trump arrives at an election night watch party at the Palm Beach Convention Center on Nov. 6, 2024, in West Palm Beach, Fla. Trump's second week in the White House featured his first direct foray into policymaking aimed directly at schools.
Evan Vucci/AP