Does the use of an online homework system such as WebAssign in an introductory astronomy course affect student performance? Four sections of introductory astronomy were compared in various homework situations, from no graded homework to graded homework online. Results show that there are no significant differences in conceptual understanding or test scores. Students did report spending more time studying course materials outside of class when online homework was graded.