Usually there is an exemption. I looked into this in TN too make a bit more on the side. I can do it without an inspection as long as the sales aren't more than 10% (I think that's the right figure) of my annual sales.
For things like eggs, you are exempt of you have less than 1,000 birds. For butchering chickens it is similar.
Check to see if there is an exemption.
Every state is different. I called our State (Texas) and they said food starts did NOT require a horticulture license. (about $125). But selling an ornamental plant or cut flowers did. Georgiana White, not sure who told you that, but I spoke to head of agency and wrote down his name.