Rebekah Nix
The University of Texas at Dallas
Richardson, TX
Remark Office OMR®
Background:
As a lecturer, Rebekah teaches educational technology courses, mainly to pre-service teachers seeking certification. As a researcher, she teams with experts to evaluate the impact of professional development programs, primarily for practicing science teachers. Her challenge is to measure this impact the programs have on her university student teachers and their respective classroom students.The Challenge:
Before using Remark, Rebekah was processing her forms by placing a transparent answer key over hardcopy instruments, then recording the values onto a cassette recorder. She would then play the tape back and key the data into a Microsoft Excel® spreadsheet. Ultimately, that was imported in SPSS for detailed analysis. She says, “I considered using the university’s Scantron® services, but that was too formal and costly.”
The Solution:
After researching products on the internet, Rebekah attended the AERA conference in San Diego, where she stopped by the Remark Products Group’s booth and looked at Remark Office OMR. “Flexibility was the main reason I chose Remark Office OMR. I wanted a full-fl edged solution that would not only serve my currently diverse needs, but also to help me formulate creative possibilities for alternative assessment options.”
Cost and ease-of-use were also very important to her. Manual data entry was not an option. “At the recommended $10/hour rate, just the data entry would cost over $1000 per project, plus my supervision time. Even if our projects had supported assistants, this phase of the research was too important to trust to anyone less vested in, or familiar with the work. I am confident in (Remark’s) output and comfortable with assigning the data processing tasks to student workers.”
Her largest project to date was an external evaluation of high school student perceptions of the classroom learning environment, and correlating their attitudes on science to district-supplied achievement data and program activities. This 4 year study included a whopping 269,250 fields of data. Before having Remark Office OMR, “I could neither ensure the integrity of that much manually scored and entered data, nor survive the physical stress of meeting important end-of-year reporting deadlines.” On this project, she was able to get the information to the right people in plenty of time. Remark “enables virtually immediate feedback to the lead evaluator, project principals, and participating teachers. All it took was the Remark software and a scanner!”
She goes on to say, “The harsh reality is that our research on the public/private school classroom impact of these university-based programs would never have happened without Remark Office OMR. Happily, I simply can’t put a dollar figure on what it’s been worth to report our results – and to spend more time with my friends and family instead of my beloved transparent keys and cassette recorder.”
Scantron is a registered trademark of Scantron Corporation. Microsoft Excel is a registered trademark of the Microsoft Corporation.
Institutional Research - Check out how Savannah College of Art and Design handles an internally developed survey given annually for 2500 respondents using Remark Office OMR and Remark Web Survey.
Institutional Effectiveness - Find out how Susan Evans was able to collect over 2000 responses and analyze data over a 9 day period using Remark Office OMR and Remark Web Survey.
Quality Assurance Program - St. Patrick’s College was undergoing an important quality assurance program involving both internal and external evaluators. Learn how they used Remark Office OMR to process their data.
Using Remark Office OMR for Course and Instructor Evaluations- Find out how Tiffany Martinez at the University of New Haven uses Remark Office OMR to process course evaluations in a timely, cost-effective manner.
Croatian University Uses Remark to Grade Thousands of Tests - Find out how the University of Rjeka corrects 50,000 tests every three weeks using Remark Office OMR.
Evaluate Impact of Professional Development Programs - Learn how Rebekah Nix was able to replace using transparent answer keys and reduce costs with Remark Office OMR.
Grading Biology Exams at a Large State University - See how Michael Wagenheim used Remark Office OMR to scan over 12,000 multiple choice biology tests per year and save money.
No such thing as a perfect form - Margaret Rutherford at Victoria ISD using Remark Office OMR to collect data for a grant.
Grading Assessments for Title IIB Grants - Learn how Capital Area Intermediate Assessments using Remark Office OMR to collect and analyze data from a variety of assessments, surveys, and evaluations under very tight deadlines.
Collect and Analyze Test Data for Title I - See how Tom Hays reduced the amount of time to collect data for Title I using Remark Office OMR.
Remarkable Changes to Instruction - After Tom Hays proved the feasibility and usability of Remark Office OMR for collecting data, his next challenge was to improve instruction in the elementary schools.
Remarkable Addition to Data Collection - Tom Hays discusses the remarkable addition to the data collection efforts: Evaluation of the kindergarten program through two assessments.
The Beginning of a Remarkable Relationship - The beginning of Tom Hays with Remark Office OMR.
Scanning Technology Conquers Common Testing Dilemmas - See how Dr. Bill Palya, Professor of Psychology at Jacksonville State University used Remark Classic OMR to enhance teaching and learning by enabling more frequent testing, improving test result analysis, and decreasing a student's ability to cheat.
How a Leading Hospital Uses Remark Office OMR® for Regulatory Compliance - Stephanie P provides overall management for the Patient Care Services Performance Improvement program that includes seven Quality Indicators. Patient data is analyzed and benchmarked against other hospitals. Reports are then provided to internal management and outside regulatory agencies.
Gravic's Contribution to Volunteerism - The challenge was to collect data from thousands of evaluation forms completed by participants in the Presidential Summit on Volunteerism held in Philadelphia.
Little League Assessments - Creating fair and balanced little league teams is a very complex process. Glenmoore Eagle Little League strives to create teams with a 50/50 win-to-loss ratio, making the season enjoyable for all the children and parents. In the past this goal was achieved by manually entering talent ratings of every child into a spreadsheet. This was a painstakingly slow process, so three years ago they started using Remark Office OMR® to scan and process player evaluation forms saving an enormous amount of time and effort for the volunteers who perform these functions.
Football Pool - The End Zone Bar & Grill is a sports bar that runs both a weekly and an annual NFL football pool. Employees had to manually check the weekly sheets, then sort and enter data from these sheets to keep a tally for the yearly pool. This process was enormously time-consuming, as there were 500-600 sheets per week to be processed.
