Experts and BHG readers answer.
Thanks for writing. There are alkaloid compounds that taste very bitter (and can have an ill effect on your health if you consume too many of them) on the green skin of potatoes. So yes, it is best not to eat them.
---Justin, Senior Garden Editor, BHG.com