This is a playlist I use when I am in the mood to rate songs. I set a smart playlist with the following properties:

Setting the rating to 0 allows the song to disapear for the playlist once it is rated. Make sure to have "Live Updating" checked.