AI summarization is a useful feature but, in my opinion, opens up a can of worms on the implementation side e.g. where does the model sit, is there any local processing, does Orion implement a subscription model to cover the costs of running AI models for the users etc.
I believe the most straighforward way that keeps the problem somewhat compartmentalized feature-wise is adding an option to provide an OpenAPI API Key (or Gemini, Claude etc.) and only focus on having the browser send the appropriate contents, metadata, images etc. to the 3rd party API endpoint and parsing whatever response comes back.
There is naturally the question of privacy in all of this but by only having the browser act as a proxy between the webpage and a third party system, the burden of accepting the privacy risks is on the user. I would argue that it also prevents polluting Orion's perception as a privacy-conscious browser, since AI is synonymous with lack of privacy in many circles.
