I always move my herbs into the sunniest window in my house in the winter, after drying a bunch in case I run out.
Most herbs are annuals, make sure you don't let them go to seed if you want to bring them in. I winter indoors, Sage, Oregano, Thyme, Rosemary, Parsley, and Chives.
I have not had much luck with keeping Basil over the winter indoors.