Batting or not batting?

I am making a baby quilt and I am going to back it with fleece. Do I need to put batting inside? I just want a thin quilt, and I do have thing batting, but do I need to put batting if I have fleece for a backing? I guess it would just depend on preference, but I've never used fleece for a backing before. What would you do?