Tomatoes and potatoes are both from nightshade family. Tomatoes were considered poisonous because they did poison people, either by belladonna being mistaken for tomato or the lead silverware leeching, it’s relation to the family happened to take the fall for these poisonings.