Check Nancy's Notions. She had a couple of books.
I have a pattern that goes the other way. You make a small quilt using flannel for batting, lay out a sweatshirt pattern and sew it. I have 2 quilted and one embroidered. You can use ribbing for cuffs, neck and waist.