@simon Just to confirm the command line flag does disable this extension e.g.

open -a "Google Chrome Canary" --args --disable-component-extensions-with-background-pages

One screenshot is with the flag, one as default

(Core Web Vitals Visualiser is an extension I installed rather than one that's bundled with Chrome)