Infolit and Assessment

Measurable Goals:

Gaining Skill in Using Technology as a Tool for Interpersonal Learning

by Ferdi Serim (ferdi@oii.org)

Much of the ambivalence which surrounds public discussion of public education has its source in the lack of solid information about what's being accomplished as a result of billions of dollars and trillions of hours. We can't know how to improve until we have ways of measuring what's being done. I recommend that everyone read Mike Schmoker's book Results: the key to continuous school improvement (ASCD) for an insightful treatment of this vital topic. Before we can evaluate (judge to be good or bad) we must be able to assess (state clearly what did and didn't happen).

I decided to accept Mike's challenge and design all of my networked activities in a way that could be measured. We often hear goals like "preparing students for the 21st Century" or "helping students become lifelong learners", which are nearly impossible to verify through observation. Here are some alternative ways of formulating goals that do lend themselves to measurement:

Objectives

Measurable Goals *

Technology

Students will learn how to use various forms of technology to improve their performance.

Cooperative Learning

Students will learn how to operate in  groups, and their achievement and attitudes will reflect the skills  learned.

Language Arts

Students will acquire a positive attitude  toward reading, read with better comprehension, and write more creatively  and analytically.

Technology: I can tell which forms of technology students have learned, and can measure whether these new skills lead to improved performance in their abilities to read, write and think. My Intranet keeps track of each user's activities on the network, so I can tell how often and how long each student spent doing word-processing, researching on the Internet, creating web pages, and more.

Cooperative Learning: I can see, by reviewing the conferences (collaborative workspaces) I've created for each group who has made contributions, the quality of these contributions, and the level of feedback students exchange with each other, their teachers and any telementors who may be assisting them.

Language Arts: I can review the reading logs that I've set up as a database which students access over the web, to find out who is reading what, how they enjoy what they read, and their use of language in convincing others to try their favorites. We have an "official" approved reading list, for each grade. Many of my favorite books weren't on the list when I was an eighth grader (strangely enough many of these are now considered "modern classics"), and my students love the opportunity to lobby for their "excluded" books to be added by the "powers that be". I've explained to the students that their testimony, via the database, will be considered for nominations of additional books as the list is reviewed each year. They're pretty careful about their use of language in these reviews!

I can also gauge improvements in their use of language to construct meaning from the vast amounts of data their Internet research returns, by comparing projects students complete at the beginning of the year with those they produce at the end of the year. Our Intranet allows me to review materials students save in their "electronic portfolios" as exemplifying their best work.

Getting Results:

The Relationship of Measurable Goals to Information Literacy Standards

When Janet Murray first showed me the AASL Information Literacy Standards, I realized that the objectives for students formed the most compelling reason I'd found for the use of education technology. If technology could help students learn to do these things, they'd really be prepared for the 21st Century and their new roles as lifelong learners!

Information Literacy

Independent Learning

Social Responsibility

Accesses information efficiently and  effectively

Pursues information related to personal interests

Recognizes the importance of information to a democratic society

Evaluates information critically and competently

Appreciates literature and other creative expressions of information

Practices ethical behavior in regard to  information and information technology

Uses information effectively and  creatively

Strives for excellence in information  seeking and knowledge generation

Participates effectively in groups to  pursue and generate information

The trick was this: how could I develop activities with measurable objectives that demonstrated mastery of these standards? The results of my first attempt, which guided my work with students in Princeton, turned out like this:

Information Literacy

Accesses information efficiently and  effectively

Evaluates information critically and competently

Uses information effectively and  creatively

Technology

Finds required information from a variety  of sources

Validates sources, organizes and retains  discovered sources

Can present as text, graphics, multi-media  or hypermedia as needed

Cooperative Learning

Contributes to team research

Reviews team discovered sources

Contributes to and reviews team presentations for effectiveness

Language Arts

Follows and provides clear  instructions

Reviews and contributions are clearly  communicated

Reviews and contributions are clearly  communicated

In terms of the three information literacy goals, I found that these objectives could be measured for their technology, cooperative learning and language arts dimensions on the basis of what I observed in my computer lab, what the network user logs captured, what students posted to collaborative workspaces, and what was observable in the final product. The assessment showed what did or did not happen with respect to each of these activities. Because peer review was built in to the activities, students themselves got a sense of what constituted a great project and what represented a shoddy effort.

The goal of information literacy leads to the next level, where these skills are independently applied. Our Intranet made this level of assessment possible as well.

Independent Learning

Pursues information related to personal  interests

Appreciates literature and other  creative expressions of information

Strives for excellence in information seeking and knowledge generation

Technology

Uses technology to create personal  portfolio

Uses technology to experience and discuss all artforms

Reviews of electronic sources are clear and  complete

Cooperative Learning

Contributes resources to others, based on  their interests

Reviews team members' cultural favorites (books, movies, music, etc.)

Reviews are clearly communicated, and  receive commentary from others

Language Arts

Personal portfolio invites and receives commentary

Rubric rating comments are constructive and clear

Rubric ratings of project materials are  uniformly validated

 

Finally, the level of social responsibility comes into play. Knowledge building is a group sport, not an isolated pursuit. Students need practice in honing these skills, and technology provides avenues for collaboration that are unprecedented in human history. Our Intranet provides the capabilities for these collaborations, as well as a means of observing what students have done with these opportunities.

Social Responsibility

Recognizes the importance of information  to a democratic society

Practices ethical behavior in regard to  information and information technology

Participates effectively in groups to pursue and generate information

Technology

Portfolio contains clear personal statement on information & society

Observes netiquette, fair use and other accepted norms

Regularly contributes to online  discussions

Cooperative Learning

Group contributes regularly and reliably to project and school discussions

Guides team members toward responsible use of technology

Regularly adds to team and school databases

Language Arts

Language is clear, constructive, and  responsible

Communications respect privacy and  truthfulness

Uses language to encourage group  achievement

© Ferdi Serim 2000
last update: 11/1/00

[BACK]

[Home] [People] [About] [Cybrary] [Workshops]

© 2006 Online Internet Institute.
Last updated 3/21/06