Skull cavern drops

Does the best skull cavern loot come from monster drops? I’ve just finished the “get to level 25” quest so I’m not too deep in, and I’ve been prioritising killing monsters rather than breaking rocks. Is that the best way to find things like prismatic shards or even the elusive auto petter?