Composum AI - Supporting the AEM content author with large language models
AI has a huge impact on image creation already. Now the increasing power of large language models makes them ever more valuable to create, rewrite and analyze text. The free open source Composum AI integrates text creation with state-of-the-art language models like OpenAI's GPT series as additional functionality into the AEM site editor for pages and experience fragments, as well as into the free Composum Pages CMS. The new functionality supports the content author in content creation, translation, summarization, categorization, text revision and text suggestion generation, featuring a customizable library of basic prompts that are modifiable and free prompting.
My talk discusses specifics of our approach to the integration:
- how to conceptually structure the dialogs to best support the content author
- how to integrate the AI into the AEM editor so that it is mostly independent of the actual components and site implementation
- how to provide source content to the AI as a basis for content transformations
- how to structure the communication with the underlying AI service (OpenAI chat completion or similar)
- our usage of LLM for translation featuring a transparent customizable integration into the rollout process of live copies, translating one page in one piece.
Beo
Will you port to Universal Editor as well?đ
Hans-Peter Störr
Hopefully. :-) I talked to the people from the UI editor talk, an there are still some needed things missing.
Hans-Peter Störr
You can go into the page properties and call the content creation assistant from the SEO description and apply a prompt to the page content. There is a prompt suggestion in the default prompt library, which you are invited to customize.
Peter Pötsch
Can it also used in the DAM for generating alt texts? even in a bulk process for multiple images e.g.
Nilesh Mali
<env>/etc/importers/bulkeditor.html This might be helpful here.
Dennis Fisch
Well according to the docs, this has been deprecated since 6.4: CAUTION With the deprecation of the Classic UI in AEM 6.4, the Bulk Editor has also been deprecated and thus Adobe does not plan to further enhance the Bulk Editor. https://experienceleague.adobe.com/en/docs/experience-manager-65/content/sites/administering/operations/bulk-editor
Hans-Peter Störr
There currently is no build in mechanism to do that, though it could be used nicely as a platform to support generation of such texts. There is, however, the aspect that it's currently advisable to manually check all of that - though compromising on something like alt texts seems conceivable.
Hans-Peter Störr
The Composum AI has a somewhat different focus. , 've tested that with AEM down to 6.5 sp 7 on Java 8 - so you can use it on platforms Adobe perhaps won't offer AI features for. It's not a big integrated product like what Adobe offers, but you can easily introduce it into existing projects without changing anything in the project itself except deploying Composum AI and setting some configurations.
Vugar Aghayev
When you use live copy instead of language copy then you have to detach every single page from blueprint/master to make sure that content does not get overridden during rollout/sync? How you handle this?
Hans-Peter Störr
Richt, dealing with preexisting content is an interesting problem there. Depending on your site there might be several solutions: - It's easiest if you do that during a relaunch where you refresh most things, of course. - Detach all existing pages you don't want to be changed, as you suggested. That can be done manually or via groovy magic. - If you just have a new part of your site auto-translated, you could just make that a live copy - it doesn't have to be the whole site. Perhaps use a "news" folder, blog or similar as a test balloon?
Jelle Bouwmans - AmeXio
The Composum AI is open source and publicly available with a MIT license - compare the list of releases and the documentation site. To test it, you can deploy the package for AEM on your AEMaaCS server or AEM 6.5.x. Since ChatGPT is used as a backend, you need an OpenAI API key. The API key can be set as an environment variable OPENAI_API_KEY, or there are various other configuration options.