Leigh, you pose an interesting question - one I've never really thought about before. I suppose you could use felt - however it would depend upon whether or not you ever had to launder the topper. I think all the table toppers I've 'purchased' have had batting in them but can understand why you wouldn't want to use it and why you wouldn't just want plain fabric.

Hopefully someone with experience in table toppers will chime in. I personally would give it a try. After all - it's not as if you are going to be throwing the topper in the laundry every week.