Rust in my compost - help!

Our compost pile is heavy on oak and maple leaves. Although when we put it together we used grass clippings, steer manure and we regularly add coffee grounds and green kitchen scraps.
It sat over winter, all the usual stuff, rain snow and freezing temps. This spring we turned the pile and from the bottom we took some of the mulch and worked it into our new rose beds.
At that time I noticed something yellowish/orange on the leaves.... I thought it was corn gluten meal. (didn't have my glasses on)
Well yesterday as I was working in the garden I turned up some of the leaves from the compost pile and realized to my horror that the yellow/orange stuff is rust!!!
It's all mixed in and the roses are planted, there is no way I can get the infected leaves/compost out of the beds... ugh.
Is there any way I can treat this?
Any way I can keep it from spreading to my roses?

I have healthy fat worms in my beds and I want to keep my soil alive so anything chemical is simply out of the question
Do you have any suggestions?

Dove

bump