Orgman123, velvetleaf has an allelopathic effect on other plants, preventing their growth. It releases allelopathic chemicals from leaves that slow the germination and growth of other plants. That explains why nothing else will grow there. You need to get rid of it and fast if you want a garden there.
Velvetleaf weed control is a long-term project because one plant creates thousands of seeds, which remain viable in the soil for an incredible 50 to 60 years. Mow the plants while they’re small to prevent them from going to seed. and/or pull them by hand before the plant goes to seed. Use a shovel as pieces of roots that remain in the soil will sprout new weeds. I would try glyphosate if the area is too large to control by hand.
Whatever you do, get after it now! Do not allow it to go to seed.