Topological Preference Optimization (TPO)

A novel training strategy for conversational AI that leverages conversation topology and spatial-temporal coordinates to generate preference datasets. TPO represents a paradigm shift in preference learning for conversational AI. Instead of relying on human annotations, TPO extracts preference signals directly from the structural properties of conversation graphs, incorporating hindsight knowledge and topological awareness to create more accurate and contextually informed training data. > **Conversation topology encodes preference signals**: Linear conversation paths represent more effective communication than branching paths, as they indicate confident, purposeful progression rather than uncertain exploration. ### 1. Divergent Language Matrix (DLM) Integration TPO builds upon the DLM algorithm to generate 5-dimensional coordinates `[X, Y, Z, T, N]` for each message: - **X (depth_x)**: Hierarchical level/depth - **Y (sibling_y)**: Order among siblings - **Z (sibling_count_z)**: Homogeneity based on sibling count and similarity - **T (time_t)**: Temporal position with dynamic weighting - **N (n_parts)**: Content segmentation count Where: - `L(P)`: Linearity score (prefers straight-line conversations) - `T(P)`: Terminal quality (endpoint assessment) - `S(P)`: Semantic coherence (consistency along path) - `C(P)`: Completion quality (accounts for backtracks)