Thanks for writing. This sounds like a seed pod. You can either leave it on the plant to develop or remove it. Removing it will give the plant more energy to bloom better, but letting it go to seed will give you a host of seeds you can use to make more of the plant.
---Justin, Senior GArden Editor, BHG.com