If it is only the glue left, a piece of Scotch tape might work. If you put it firmly on the glued part and then take it off, some of the glue should stick to the Scotch tape. Repeat until nothing is left on the fabric. This works at least for glue residues on smooth surfaces.