By Mary Bigelow
Posted on 2010-03-31
Our school recently received grant funds to upgrade the technology in our science labs next year, and the funding organization requires an annual report. This is a new endeavor for us. Do you have some suggestions on what to include in the report?
—Patricia, Philadelphia, PA
Congratulation on your grant! It’s a lot of effort (and stress) to apply for funds, but in many respects your work has only begun. When you receive funds from government agencies or private foundations, the funders want to know how their money was used to accomplish the purpose of the project. However, the evaluation and reporting component is often an afterthought when schools receive grants. If you wait until the project ends, you might overlook some critical data documenting the success of your efforts. You’re very wise to think about evaluation before implementation.
Revisit your proposal to determine how your school described the project evaluation beyond documentation of expenditures. Find out if the funding agency has a template or rubric for the required report or if the website has example reports you could use as a model. Depending on the scope of the project, you could enlist assistance from your district office or contract with an external evaluator to design an evaluation plan and determine the scope of data to be collected.
Whether you’re evaluating a grant-funded project, a new curriculum effort, or a professional development program, most evaluation plans address several basic questions:
What progress are you making in implementing your project? This is the “what happened” part of your evaluation. Create a project calendar or timeline to document when key events happened and who the participants were. Be sure the events are related to the goals and objectives of the project.
To what level are you achieving the expected results or outcomes? This is the “so what” part and is often overlooked. Describe observable effects on teaching and learning and to what extent the goals and objectives of the project are being met.
Collecting, organizing, and analyzing data from many sources provides the basis for documenting the implementation and impact of your project. You need to decide what kind of data should be collected, when it should be collected, how it should be organized, and who will be responsible for the data. Unless your project is a formal research study, you probably will not need more than a basic knowledge of statistics.
Having an evaluation plan ahead of time and collecting data as you move forward will help keep the project focused on the intended outcomes. But if something is not working as planned, be sure to document the unanticipated events (e.g., a key teacher leaving partway through the project or a delay in installing equipment).
In addition to meeting the requirements of the funding agency, well-organized data could be the basis of a needs assessment for future funding. There are many opportunities to share what you learned from the project through NSTA journals, NSTA Reports, and presenting at the national and area conferences. We’ll look forward to hearing more about your project!
Resource:
User-Friendly Handbook for Project Evaluation (National Science Foundation)
Photo: http://farm3.static.flickr.com/2796/4333770330_61e3640dc1.jpg
Our school recently received grant funds to upgrade the technology in our science labs next year, and the funding organization requires an annual report. This is a new endeavor for us. Do you have some suggestions on what to include in the report?
—Patricia, Philadelphia, PA
By Howard Wahlberg
Posted on 2010-03-30
One of Chapter Leaders called me this morning to ask about the NSTA Communities. I wanted to share the highlights of our conversation with the CAG Blog.
To join this forum of science educators, visit www.nsta.org/communities. You will be asked to log in to the website and create a short profile. It only takes a couple of minutes. Once you have created your profile, you will be matched with other like-minded professionals and you can join the groups you want or create a new one!
Please keep the great ideas coming. Post a comment below or e-mail me at aodonnell@nsta.org and share with your fellow leaders. Remember, the success of this blog is dependent on your participation!
One of Chapter Leaders called me this morning to ask about the NSTA Communities. I wanted to share the highlights of our conversation with the CAG Blog.
By Mary Bigelow
Posted on 2010-03-28
As an NSTA member, did you know that you have electronic access to each of the journals, in addition to the print copy you receive? In the monthly SciLinks blog for each issue (and on the NSTA home page, there are links to browse the table of contents of the three K–12 journals. (And you can also access the quarterly Journal of College Science Teaching.)
In addition to the themed articles, NSTA journals have regular features that appear in each issue. Each journal has different features, but they are valuable resources for any grade level. Keep reading to see what monthly features are available online from the March issues:
Science and Children The Every Day Science Calendar, subtitled “Facts and challenges for the science explorer,” highlights facts, historic events in science, or suggestions for reading, or interesting questions. It’s a nice addition to the bulletin board or for bell-ringer ideas. In Teaching Through Trade Books, Christine Royce highlights books related to the month’s theme and provides lesson suggestions for investigations. This month, for example, the theme relates to STEM, and the trade books are about inventors and inventions. The two activities help students to develop their skills in design and problem solving.
Science Scope In his Scope on Safety column, Key Roy discusses issues that are timely and informative, regardless of what grade level you teach. For example, this month the topic is “Battery safety basics.” Scope on the Skies takes a monthly look at topics in astronomy. This month’s column discusses the language of mathematics and how to take advantage of opportunities to integrate the subjects. The topics would also be appropriate for high school classes. Speaking of astronomy, look at the article Exploring Galileo’s Telescope in which students looked at the work of Galileo from a historical perspective and built simple telescopes.
The Science Teacher Even though this journal is targeted to high school teachers, the monthly features are appropriate to all grade levels. In this month’s The Prepared Practitioner, Alan Colburn summarizes information on the concept of “Universal Design.” Discussing his one-pagers could be the focus of a department meeting. Ken Roy provides additional best practices and safety suggestions in Safer Science. I know teachers who keep copies of both of his columns in a folder on their computers! Science 2.0 is a recently added feature that looks at new web tools to support learning in science. (this month features probeware and digital sensors). Career of the Month by Megan Sullivan (which is based on interviews with science-using professionals) and Health Wise (a new questions every month) by Meg Streker are meant to be shared with your students, whether you cut them out of your print journal or access an online version.
It’s hard to find time to keep up with everything, but these features are worth a look!
As an NSTA member, did you know that you have electronic access to each of the journals, in addition to the print copy you receive? In the monthly SciLinks blog for each issue (and on the NSTA home page, there are links to browse the table of contents of the three K–12 journals.
By Howard Wahlberg
Posted on 2010-03-26
As the dust settles from NSTA’s Annual Conference, my thoughts return to a conversation I had with a new NSTA member during the conference. I was grateful to have the opportunity to say “thanks!” for being a member of NSTA and “thanks” for coming to the conference!
I want to thank all of you too. Thank you for your continued membership. Thank you for attending the conference. Thanks for your great ideas and input. And thank you for the time that you devote to promoting excellence and innovation in science teaching and learning for all.
Please keep the great ideas coming. Post a comment below or e-mail me at aodonnell@nsta.org and share with your fellow leaders. Remember, the success of this blog is dependent on your participation!
As the dust settles from NSTA’s Annual Conference, my thoughts return to a conversation I had with a new NSTA member during the conference. I was grateful to have the opportunity to say “thanks!” for being a member of NSTA and “thanks” for coming to the conference!
I want to thank all of you too. Thank you for your continued membership. Thank you for attending the conference. Thanks for your great ideas and input. And thank you for the time that you devote to promoting excellence and innovation in science teaching and learning for all.
By Mary Bigelow
Posted on 2010-03-25
By Claire Reinburg
Posted on 2010-03-25
Thermodynamics and atomic bonding and quantum mechanics, oh my! Bill Robertson tackles these, and other chemistry themes, in More Chemistry Basics, the ninth book in the bestselling Stop Faking It! series. In this follow up to Chemistry Basics, Robertson employs his engaging writing style and unique brand of humor to make tough chemistry concepts more palatable and, fortunately for you, easier to teach. In his preface, Robertson maintains that, “it is empowering to know more than you will ever need to teach the students. It gives you a comfort level and just might affect how you address certain topics. Teaching is more fun when you are secure in the depth of your understanding.” Bill’s refreshing outlook on science teaching, coupled with illustrator Brian Diskin’s clever visuals, makes for an enjoyable read—even for those of you most wary of chemistry!
—Amy America
Thermodynamics and atomic bonding and quantum mechanics, oh my! Bill Robertson tackles these, and other chemistry themes, in More Chemistry Basics, the ninth book in the bestselling Stop Faking It! series.
By Mary Bigelow
Posted on 2010-03-23
I’m looking for information regarding student comprehension and/or performance when given basic, succinct instructions versus long, detailed lab instructions. I have heard convincing arguments for both, but I’d like to find out what the research says.
—Brandi, Oklahoma City, Oklahoma
Following directions is highly valued skill in many classes. I once heard a teacher say to a lab group whose results were different from the others, “You got the wrong answer because you didn’t follow my directions.” He missed a teachable moment to discuss how or why different results were obtained.
Your question implies that knowing how to design procedures for lab investigations also would be a skill worth developing. I’m not familiar with any formal research on the complexity of lab directions, so I’m hoping someone who knows of any will share the references. In the meantime, this sounds like an opportunity for your own action research in the classroom.
Action research is inquiry or research focused on efforts to improve student learning. Typically it is designed and conducted by teachers or teams of teachers who analyze the data from their own classrooms to improve their practice. Action research gives teachers opportunities to reflect on their teaching, explore and test new strategies, assess the effectiveness of the new strategies, and make decisions about which ones to use. Action research models generally have several components, which I’ve annotated with some thoughts:
Identify a focus area or research question. You already have a general idea (the effectiveness of lab directions) to reflect on. What do you want your students to learn from lab activities? What did you observe that prompted your question? A detailed set of directions (often called a “cookbook” lab) would seem to be foolproof: students who follow the directions would be more likely to get the “correct” results. How important is it for all students to get the same results and come to the same conclusions? What happens if they do not? Depending on the amount of directions, how would you expect the students’ thought processes to be different? Once students are familiar with a procedure or instrument, is it necessary to repeat the directions? What is the teacher’s role if the directions are not detailed? Do students think a long, detailed set of directions looks more rigorous and scientific?
Collect data. If you have more than one section, you could use detailed directions in one class and basic ones in another. You may need to try this with several activities. You’ll need to document the impact of providing different amounts of directions: the accuracy or consistency of data students collected during the activity, how students analyzed their results, the content and quality of the discussions between members of the lab group, and the procedures designed by the students. As the students proceed, listen to their conversations. Ask questions about their understanding of the purpose of the activity and how they decided on a procedure. Observe which students become frustrated with the minimal directions or which students display confidence and creativity. You could use photographs or videos to document the process. Examine what they are writing in their lab notebooks.
Analyze and interpret the data. Review the students’ procedures and their results using a rubric based on your vision of what a successful lab “looks like.” Look at the quality of their reports. Debrief them on their understanding of the procedures they designed and of the results. Discuss any frustrations or other feelings about the change in expectations.
Develop an action plan. Depending on your results and the experience level of your students, you may decide that some modeling and scaffolding will be necessary as they take on more responsibility for their work. Decide if it is acceptable for students to design the procedure as they go along or whether you want them to outline a procedure before they start the hands-on work. Consider if there are times when detailed directions would be appropriate (perhaps if you’re introducing a new lab technique or new instrumentation, if there are safety concerns, or if your students are novices at organizing data). If implementing your action plan leads to more questions, the action research cycle continues.
Action research is a systematic way to apply inquiry to your own teaching practices, and in many schools it is used as a professional development option. The results of action research are often published in the NSTA journals. You can examine these articles for ideas. I hope you will share your findings with us!
Resources:
Action Research
Action Research for Teachers
Photo source: http://farm4.static.flickr.com/3072/3110638201_0b7e66a19a.jpg
I’m looking for information regarding student comprehension and/or performance when given basic, succinct instructions versus long, detailed lab instructions. I have heard convincing arguments for both, but I’d like to find out what the research says.
—Brandi, Oklahoma City, Oklahoma
By Debra Shapiro
Posted on 2010-03-23
By NSTA Web Director
Posted on 2010-03-23
Governor Edward G. Rendell of Pennsylvania addressed the “Science Matters” Town Hall Meeting in Philadelphia on Friday, March 19. In addition to describing the success of Pennsylvania’s STEM education programs and reeling off some facts and figures (e.g., Pennsylvania is the only state, according to Gov. Rendell, that has increased education spending during this recession), he listed the three things other places invariably get wrong when they try to make a Philly cheesesteak sandwich. You can watch his 25-minute talk on YouTube (that’s where the complete playlist is—below is part 1).
[youtube]http://www.youtube.com/watch?v=9FnHr_hjgNU[/youtube]
Governor Edward G. Rendell of Pennsylvania addressed the “Science Matters” Town Hall Meeting in Philadelphia on Friday, March 19. In addition to describing the success of Pennsylvania’s STEM education programs and reeling off some facts and figures (e.g., Pennsylvania is the only state, according to Gov.
By Peggy Ashbrook
Posted on 2010-03-22
Thanks go to all the children who made it possible for their parents to attend the NSTA national conference by coming along with them! In addition to being a reminder of why we were there, these children often added to our experience by modeling activities in the presentations. This one even got his hands dirty helping Lisa Green (presenting with Candace Lutzow-Felling, Robin Coutts, and Emily M. Ford) classify a soil at the Outside the Classroom Walls: Creating a Backpack Lesson to Expand Student Learning session. The presenters are from the University of Virginia, State Arboretum of Virgina, Blandy Experimental Farm, and urged us to come see the backpack model in action.
Peggy