Is Ditch Weed invasive? The Marijuana plant?

It keeps popping up all over our yard. I have a wild flower part and then I'll notice the Marijuana plant. It's also down by the river and on our easement that we have no control over. I mow the gr obviously, but once in a while one of those guys will pop their head up. I'm not a pot grower. But I think I might have a market if I just let it all go. So should I let it go in parts that I don't mow? Or make an effort to pull it. Also, can I get into trouble for it?