Back to the blog

Nextcloud Hub 26 Summer: skills, memories and recurring tasks for the Assistant

· By Bee Flow · 4 min read

Nextcloud 35 gives the Assistant on-demand memories, reusable skills, agents in Mail, Deck, Talk and Tables, web search, OCR, subtitles and scheduled tasks. Each change in Nextcloud's own words, and three things a small team can set up in its first week.

A card index box with one checklist card lifted out, a wall clock at eight o'clock, a coffee cup and a summer sun

Nextcloud released Hub 26 Summer on 16 September. On the maintenance and release schedule that is server version 35. The release post gives the Assistant a section of its own, under a heading that sums it up: "improved memory, performance and input".

Below is each Assistant change in Nextcloud's own words, with the manual page where there is one, and three things a small team could set up in its first week on 35.

Input: images, OCR and audio

"Drop an image into the chat and ask questions about it or translate the text," the post says, "while the OCR tool effectively extracts text from photos, for example documents, receipts and even hand-written notes." The feature list adds "OCR+Translation in one go". On your own hardware this runs through the ocr_paddle app, which the manual describes as running "only open source models" and doing so "entirely on-premises". It reads PDFs as well.

Audio got more commands too. In Nextcloud's words: "When you upload a recording, it can generate subtitles and break the transcript into readable paragraphs instead of plain text."

Memories and skills

"With new on-demand memories, the Nextcloud Assistant agent retains what you told it across conversations." The Context Agent changelog calls these "on-demand memory storage and recall tools". They sit next to the Remember this toggle for a whole conversation that the user manual describes.

Skills are the change we expect admins to enjoy most. The release post puts it plainly: "you can create a skill to teach it multi-step procedures and then apply them with a single phrase the next time", with "meeting prep" and "release notes formatting" as examples. The skills section of the user manual explains how it works. A skill is a folder with a SKILL.md file under Assistant/Context Agent/Skills/ in your Files, opening with a short YAML block for its name and description. You can write one by hand or ask the agent to create it, and you do not need to call it by name: "The agent reads all available skill descriptions and applies the relevant ones based on the context of your conversation." Administrators can set a global skills folder for the whole instance, and a personal skill with the same name takes precedence. Skills need Context Agent 2.8.0 and Assistant 3.5.0 or later. Because a skill is a Markdown file in Files, a team can share, version and improve it like any other document.

Agents in Mail, Deck, Talk and Tables

"We also added more AI agents, in apps like Nextcloud Mail, Deck, Talk, and Tables, giving it reach across your whole workspace. It can even search the web and read articles for you." The Context Agent admin page lists the tools per app with an example prompt for each, from Deck cards and Talk polls to sending through Nextcloud Mail. A DuckDuckGo search is listed among the miscellaneous tools, and the changelog names a web_fetch tool for reading a page. An admin can switch each tool group on and off in the AI admin settings, and the same page notes that the model has to support tool calling, which the default llm2 model does.

For supported models you can now "assess the Assistant's reasoning, to judge whether the result is well-founded enough for you", and answers stream into the chat as they are generated.

Recurring tasks

"Finally, you can now schedule tasks: let the Assistant compile and send a recurring briefing message at 8 AM while you finish your coffee." You set one up by asking in the chat. The scheduled task tool in Context Agent's source takes a prompt and a repeat rule in the iCalendar (RFC 5545) format, and each run starts in a new chat session. If you want tasks picked up right away, the AI overview in the admin manual describes background job workers that process AI tasks as soon as they are scheduled.

Three things to set up in the first week

These are made-up examples for a team of about ten.

A meeting prep skill. Take Nextcloud's own example and write it down for your team. When someone says "meeting prep", the agent looks up the meeting in Calendar, opens the files that belong to it, lists the open cards on the project's Deck board and writes a half-page brief with the open questions at the top. Put it in the global skills folder so everyone gets the same format.

A Monday briefing in Talk. One person asks the Assistant for a weekly task at 8:00 on Mondays: list the Deck cards due this week and the rows added to the team's planning table in Tables, then post a short summary in the team's Talk conversation. Let it post to a test conversation in the first week.

A receipts skill. Write down what should happen to a photo of a receipt: read the date, supplier and amount, ask for the cost centre when it is missing, and add a row to an Expenses table in Tables. Whoever does the books checks the table on Friday.

Where Bee Flow fits

Some work reaches past Nextcloud. The same Monday briefing may also need a Gmail or Outlook inbox, a GitHub or YouTrack project, or answers from a knowledge base that cite the document they came from. Bee Flow is a self-hosted AI workspace that runs next to your Nextcloud through its connector, an ExApp under the AGPL that AppAPI deploys. People use it with their Nextcloud session, and it works in Files, Mail, Calendar, Deck and Talk with their own permissions. Its automations can start on a Nextcloud event such as a new file or a new row in Tables, carry on in other systems, and pause at an approval step where a person should look first. The Nextcloud page shows how the two fit together, and you can get in touch to try it on your own instance.

#nextcloud #ai-at-work