caterpillars usually stay on whatever they are eating - so if it was that, I would expect to see them on the rose leaves. Usually near the cut edges.
If it is the leaf cutter bees- they take circles of leaf or petals to make a cocoon(?) for their larvae to develop in.
Maybe they have a nest site nearby, that would be exciting!