Observe, Structure,
and Assemble your Knowledge Graph.

Sayou Fabric is a data-centric framework for deterministic Knowledge Graph construction — every stage explicit, traceable, and replaceable.

Get Started GitHub

1. Philosophy

Sayou Fabric is a framework for Deterministic Knowledge Graph Construction.

We focus on transforming unstructured data into structured assets by analyzing their intrinsic topology—syntax trees, file hierarchies, and metadata. This approach ensures that the constructed Knowledge Graph is precise, reproducible, and structurally sound, strictly following the data's native organization.

1.1. Structure-First Architecture

We prioritize the native structure of data to build a solid skeleton before processing the content.

• Code: Parsed via AST to deterministically link Classes, Methods, and Import dependencies.
• Media: Structured via Temporal Timeline and Semantic Segmentation.
• Docs: Hierarchically organized by Headers, Tables, and Layout Coordinates.

1.2. The 3-Tier Design Pattern

Inspired by robust enterprise architectures, every component adheres to a strict hierarchy to ensure stability at scale:

• Tier 1 (Interface): The immutable contract defining behavior.
• Tier 2 (Template): Standardized logic for ETL pipelines (Battery-included).
• Tier 3 (Plugin): Vendor-specific implementations (e.g., YouTube, GitHub, Notion).

graph TD
    %% 노드 정의
    Brain[Sayou Brain
    < Orchestrator >]:::brain

    subgraph Libs [Data Libraries]
        direction LR
        Conn[Connector]
        Doc[Document]
        Ref[Refinery]
        Chunk[Chunking]
        Wrap[Wrapper]
        Assem[Assembler]
    end

    Core[Sayou Core
    < Ontology & Schema >]:::core

    %% 연결
    Brain --> Libs
    Libs --> Core

    %% 정렬 힌트 (Libs 내부)
    Conn ~~~ Doc ~~~ Ref ~~~ Chunk ~~~ Wrap ~~~ Assem

    %% 스타일 적용
    class Conn,Doc,Ref,Chunk,Wrap,Assem modules

---

2. The Ecosystem

Sayou Fabric consists of independent, loosely coupled libraries that work together seamlessly.

Package	Version	Description
sayou-core		Foundational layer defining Schemas, Ontology, and base components.
sayou-brain		Manages the entire lifecycle of data processing pipelines.
sayou-connector		Universal ingestor with auto-source detection and streaming support.
sayou-document		Parses documents while preserving layout, styles, and spatial coordinates.
sayou-refinery		Normalizes data formats and removes noise or PII.
sayou-chunking		Splits text intelligently based on context (Code, Markdown, Time).
sayou-wrapper		Maps raw data to the Sayou Ontology and creates standardized Nodes.
sayou-assembler		Constructs semantic relationships (Edges) between Nodes.
sayou-loader		Exports the constructed Knowledge Graph to Databases or Files.
sayou-extractor		Retrieves context using Hybrid Search (Vector + Graph).
sayou-llm		A unified adapter interface for various LLM providers.
sayou-visualizer		Visualizes the pipeline flow and renders 3D Knowledge Graphs.

---

3. Installation

You can install the entire suite via the orchestrator package:

Bash

pip install sayou-brain

Or install individual components as needed for a lightweight setup:

Bash

pip install sayou-chunking sayou-document

Bash

pip install sayou-visualizer

---

Full installation guide →

Visualizer Showcase

Observability is crucial for data engineering. Sayou Fabric provides built-in rendering tools to inspect your data topology and pipeline flow.

📊 Pipeline Telemetry (DAG Tracer)

Monitor the execution flow. Visualize which plugins are activated and verify how data transforms across the pipeline.

🌌 Holographic Knowledge Graph

Transform raw data into an interactive KG city.

• Analytics Knowledge View: Inspect strict node properties and relationships for debugging.

• Showcase Knowledge View: Visualize the cluster and semantic density of your knowledge base.

---

Apache 2.0 License · Maintained by Sayouzone