I am not sure whether you are eating Ginkgo nut or the leaves. The nut are toxic and should not be eaten unless cooked or prepared correctly.
Gingko (nut or leaves) and any kind of Ginseng is not something I would recommend eaten daily.
There are also different kinds of Ginseng. The Chinese or Korean Ginseng can create hyperactivity if eaten too much or in the wrong season. You can actually feel super warm and uncomfortable. If you want to be safe just stick with American Ginseng but still in very small amounts if daily.
Thanks!