Experts and BHG readers answer.
The problem with trying to grow herbs indoors is that most herbs like a lot more light than you get indoors. So it's ideal to grow your herbs in a west- or south-facing window, or 12 inches or so under a grow light.
If you have low-light conditions like you do, I'm afraid to say your best bet may be to consider the herbs short-term indoor plants and grow a new crop several times over the winter.
For more information about growing herbs, check out: http://www.bhg.com/gardening/vegetable/herbs/