tiny ants everywhere

I have raised beds for my vege garden. I incorporated greensand and compost to the soil. Also put down red covering (supposed to increase tomato and pepper yield). My peppers are being eaten by something. Noticed tons of little ants. Wondering if the compost (from a garden center, not commercial compost) could have had the ants in it. What can I do to stop this if it is the ants eating the peppers? Want to keep organic.

What do the leaves look like that are being eaten? Except for leafcutter ants, they don't generally damage plants so my guess is it's something else that's eating them.

They are being chewed on and there are some holes in the leaves, also turning brown and the buds are shriveling up and dying.