Asters....Invasive?

Hi, have a rock garden that I have 2 invasive plants in. Thus, I'm a tad paranoid about what I plant. One of the articles on Asters mentioned them taking over. Has anyone ever had this problem? Is it specific ones? I have one but it is in an area I wasn't able to amend and the soil is dry and clay. If I plant a few other varieties in more moist or amended soil, am I going to regret it?

There is a non-native species that is very invasive.

There's a native species that is over the top in small garden beds.
I don't plant aster because I think they are too aggressive.