How does OpenKB handle updates when a document is modified?

[joshikavita01]

How does OpenKB handle updates when a document is modified?

[KylinMountain]

@joshikavita01 I will investigate this question, basically it will re-compile it if document is modified. Maybe there's better way to reduce llm call.

[wooogy-dev]

@joshikavita01 @KylinMountain

I happened to come across this discussion and wanted to share an idea, since I’ve been thinking about the same problem.

A source chunk can feed several wiki pages, and each page may use multiple sources. We could track these links, send only changed chunks to the LLM, and rebuild the affected pages. If the impact is unclear or broad, we can expand the scope or fall back to a full rebuild.

For example, if only 2 of 200 stable chunks change, the pipeline can reuse the outputs for the other 198 and reprocess only those 2 plus the pages that depend on them. Broad or ambiguous changes can still fall back to a full rebuild.
The exact savings would depend on the pipeline, but this should reduce LLM cost, update latency, and unnecessary changes to unrelated pages.

It might be worth exploring CocoIndex for change tracking, caching, and stale-output cleanup.