Wild Parsnip (pastinaca sativa): This looks like Wild Parsnip. The flowers resemble Queen Anne's Lace except the umbels of flowers are usually yellow. If it is, wear protective gloves and clothing and get rid of it or cut off the flower heads before they re-seed; the sap causes severe skin irritations (blisters or sores) when exposed to sunlight. Suggest you show this photo to a horticulturist at a local garden center for confirmation of its identity.
Rue (Ruta graveolens) subshrub up to tall. This herb plant has a nice mounding habit and small, pungent evergreen leaves. Tiny yellow flowers grow above the attractive foliage. Rue will work nicely in an herb garden as well as a rock garden.