mirror of
https://github.com/ruvnet/RuView
synced 2026-07-25 17:51:48 +00:00
ruv
bfb3fdee13
Implements Phases 1-3 of the ADR-096 roadmap: Phase 1: workspace integration - Add `ruvllm_sparse_attention` as a path-vendored workspace dep against `vendor/ruvector/crates/ruvllm_sparse_attention`, default-features=false, features=["fp16"]. Mirrors the no_std posture ADR-095 will need on the firmware side so both consumers share a single feature set. - Register `wifi-densepose-temporal` as workspace member. Phase 2: AETHER temporal head - `AetherTemporalHead` facade dispatches to a `SparseGqa` backend wrapping `SubquadraticSparseAttention`. Selection rule from ADR-096 §4.4 enforced at forward(): MHA branch when q_heads == kv_heads, GQA branch otherwise. - `Dense` backend reserved (returns typed `DenseBackendNotImplemented`) so config-time validation fails loudly instead of at forward(). - `TemporalHeadConfig::default_aether()` matches the AETHER training default per ADR-096 §3.1 (window=32, block=16, q=4, kv=1 → MQA). - Token 0 always wired as a global anchor — preserves AETHER's contrastive "session-start reference" role per ADR-024. Phase 3: smoke tests (5/5 passing) - forward at AETHER default config, both MHA and GQA dispatch paths, rejected dense backend, rejected non-divisible GQA ratio, and the long-window roadmap target (N=1000, the 10s @ 100Hz case from ADR-096 §3.1 — proves the kernel runs at lengths where dense MHA costs 10⁶ edge ops vs sparse 10⁴). Streaming `step()` deferred — KvCache lifecycle ties to PoseTrack per ADR-096 §8.5 and lands when the firmware-side ABI does (Phase 4+). Co-Authored-By: claude-flow <ruv@ruv.net>
20 lines
534 B
Rust
20 lines
534 B
Rust
use thiserror::Error;
|
|
|
|
#[derive(Debug, Error)]
|
|
pub enum TemporalError {
|
|
#[error("temporal head config invalid: {0}")]
|
|
InvalidConfig(&'static str),
|
|
|
|
#[error("dense MHA backend not implemented yet (ADR-096 §4.4 follow-up)")]
|
|
DenseBackendNotImplemented,
|
|
|
|
#[error("sparse attention kernel error: {0}")]
|
|
Kernel(String),
|
|
}
|
|
|
|
impl From<ruvllm_sparse_attention::AttentionError> for TemporalError {
|
|
fn from(e: ruvllm_sparse_attention::AttentionError) -> Self {
|
|
TemporalError::Kernel(format!("{e}"))
|
|
}
|
|
}
|