mirror of
https://github.com/ruvnet/RuView
synced 2026-07-23 17:33:20 +00:00
0f405213d3
ADR-185 §4.2 pytest-benchmark micro-benchmarks + runnable examples +
README extras table for the aether/meridian/mat bindings.
- python/bench/test_bench_{aether,meridian,mat}.py — follow the existing
test_bench_vitals.py pattern (skipped by default; --benchmark-only).
- python/examples/{reid_from_csi,cross_room_calibrate,mat_triage}.py —
typed, runnable, mypy --strict clean.
- python/README.md — SOTA extras table + example links.
Measured on a RELEASE wheel (maturin develop --release --features sota),
reference machine per ADR-117 §10:
AETHER embed() mean ~150 us/window (target <2 ms) PASS
batch scaling 1/8/64: 140 / 1091 / 8509 us (linear, no O(n^2)) PASS
MERIDIAN normalize() mean ~2.2 us/frame (target <200 us) PASS
MERIDIAN encode() mean ~6.9 us (target <200 us) PASS
MAT ingest+scan_once() mean ~40 ms/256-frame (< 500 ms interval) PASS
Acceptance self-verification (ADR-185 §6), all run just now:
§6.1 default wheel 279 KB (<=5 MB); build_features has no p6-* feature PASS
§6.2 pytest tests/test_aether.py 9/9 PASS
§6.3 pytest tests/test_meridian.py 13/13 PASS
§6.4 pytest tests/test_mat.py 7/7 PASS
§6.5 benchmarks meet all targets (above) PASS
§6.6 parity harness: 3/3 SHA golden gates green (cargo test --features
sota, 6/6); CI *wiring* as a release gate is out of python/ scope PARTIAL
§6.7 SOTA accuracy bars on labeled fixtures: NOT met (no labeled
fixtures / trained models available; parity proves path-equality,
not accuracy) OPEN
§6.8 .pyi stubs present for all three; mypy --strict on the 3 examples PASS
§6.9 base wheel `import wifi_densepose.{aether,meridian,mat}` raises a
clear ImportError naming the extra PASS
No regression: 76 pre-existing tests pass on the default wheel.
Status NOT flipped to Accepted: §6.7 (accuracy bars) is unmet, §6.6 CI
wiring is pending, and the per-extra wheel-size hoists (sensing-server /
train / mat leaf crates) remain follow-ups. docs/adr/ is owned by another
agent this session, so the ADR ledger edit is deferred to that owner.
167 lines
6.3 KiB
Markdown
167 lines
6.3 KiB
Markdown
# wifi-densepose
|
||
|
||
[](https://pypi.org/project/wifi-densepose/)
|
||
[](https://pypi.org/project/wifi-densepose/)
|
||
[](https://opensource.org/licenses/MIT)
|
||
|
||
**Detect human presence, count people, read breathing and heart rate, and
|
||
estimate skeletal pose — using only the WiFi signal already in your home.**
|
||
|
||
No cameras. No wearables. Works through walls and in the dark.
|
||
|
||
`wifi-densepose` is the Python binding for the [RuView](https://github.com/ruvnet/RuView)
|
||
sensing stack: a Rust core that turns the Channel State Information (CSI)
|
||
emitted by ordinary WiFi chips into ambient-intelligence signals. The wheel
|
||
ships compiled DSP for fast offline analysis, plus an opt-in Python client
|
||
for talking to a live RuView sensing-server over WebSocket or MQTT.
|
||
|
||
## Features
|
||
|
||
- **17-keypoint pose** — full-body skeletal estimate from WiFi CSI, no camera
|
||
- **Vital signs** — respiratory rate (6–30 BPM) and heart rate (40–120 BPM)
|
||
with a confidence score and clinical-grade / degraded / unreliable status
|
||
- **Presence, person count, fall detection, motion** — fused outputs from
|
||
the same CSI stream
|
||
- **10 semantic primitives** (HA-MIND) — someone-sleeping, possible-distress,
|
||
room-active, bathroom-occupied, fall-risk-elevated, bed-exit, … — ready
|
||
to wire into Home Assistant or Apple Home automations
|
||
- **Beamforming Feedback (BFLD) support** — 802.11ac/ax/be compressed feedback
|
||
matrices on top of the receiver-side CSI path
|
||
- **GIL-releasing DSP** — extract loops run with the GIL released, so a
|
||
tokio-backed web server can call into the pipeline without stalling its
|
||
event loop
|
||
- **Tiny wheel** — ~240 KB compiled (one binary per OS/arch covers Python
|
||
3.10+ via the stable ABI)
|
||
|
||
## Install
|
||
|
||
```bash
|
||
pip install wifi-densepose # core DSP only
|
||
pip install "wifi-densepose[client]" # + WebSocket/MQTT clients
|
||
```
|
||
|
||
Wheels are published for Linux (x86_64, aarch64), macOS (x86_64, arm64), and
|
||
Windows (amd64).
|
||
|
||
### SOTA extras (ADR-185)
|
||
|
||
Three optional subsystems bind the Rust SOTA modules as compiled-feature
|
||
wheels. Each raises a clear `ImportError` if you import it without the extra:
|
||
|
||
| Extra | Module | What it adds |
|
||
|-------|--------|--------------|
|
||
| `[aether]` | `wifi_densepose.aether` | Contrastive CSI embeddings / re-identification (ADR-024) — `EmbeddingExtractor`, `cosine_similarity`, `info_nce_loss` |
|
||
| `[meridian]` | `wifi_densepose.meridian` | Cross-environment domain generalization (ADR-027) — `HardwareNormalizer`, `GeometryEncoder`, `RapidAdaptation`, `CrossDomainEvaluator` |
|
||
| `[mat]` | `wifi_densepose.mat` | Mass-Casualty Assessment disaster-survivor detection + START triage — `DisasterResponse`, `Survivor`, `TriageStatus` |
|
||
| `[sota]` | all three | Convenience superset |
|
||
|
||
```bash
|
||
pip install "wifi-densepose[aether]" # re-identification embeddings
|
||
pip install "wifi-densepose[meridian]" # cross-room calibration
|
||
pip install "wifi-densepose[mat]" # disaster triage
|
||
pip install "wifi-densepose[sota]" # all three
|
||
```
|
||
|
||
Runnable examples: [`examples/reid_from_csi.py`](examples/reid_from_csi.py),
|
||
[`examples/cross_room_calibrate.py`](examples/cross_room_calibrate.py),
|
||
[`examples/mat_triage.py`](examples/mat_triage.py).
|
||
|
||
## Usage
|
||
|
||
### Extract breathing rate from a CSI stream
|
||
|
||
```python
|
||
from wifi_densepose import BreathingExtractor
|
||
|
||
br = BreathingExtractor.esp32_default() # 56 subcarriers @ 100 Hz, 30s window
|
||
|
||
for residuals, weights in your_csi_source: # one frame at a time
|
||
est = br.extract(residuals=residuals, weights=weights)
|
||
if est is not None:
|
||
print(f"{est.value_bpm:.1f} BPM (confidence={est.confidence:.2f})")
|
||
```
|
||
|
||
Heart rate is the same shape — `HeartRateExtractor.esp32_default()` with a
|
||
0.8–2.0 Hz band-pass and a 15-second window.
|
||
|
||
### Subscribe to a live sensing-server
|
||
|
||
```python
|
||
import asyncio
|
||
from wifi_densepose.client import SensingClient, EdgeVitalsMessage
|
||
|
||
async def main():
|
||
async with SensingClient("ws://your-ruview-node:8765/ws/sensing") as c:
|
||
async for msg in c.stream():
|
||
if isinstance(msg, EdgeVitalsMessage):
|
||
print(msg.presence, msg.breathing_rate_bpm, msg.heartrate_bpm)
|
||
|
||
asyncio.run(main())
|
||
```
|
||
|
||
### React to Home Assistant semantic primitives
|
||
|
||
```python
|
||
from wifi_densepose.client import (
|
||
RuViewMqttClient, SemanticPrimitive, SemanticPrimitiveListener,
|
||
)
|
||
|
||
listener = SemanticPrimitiveListener()
|
||
listener.on(SemanticPrimitive.BedExit, lambda e: print("bed exit:", e.node_id))
|
||
listener.on(SemanticPrimitive.PossibleDistress, lambda e: alert(e))
|
||
|
||
client = RuViewMqttClient(broker_host="homeassistant.local")
|
||
client.on_message(
|
||
"homeassistant/+/wifi_densepose_+/+/state",
|
||
listener.handle_mqtt_message,
|
||
)
|
||
client.start()
|
||
client.wait_connected()
|
||
```
|
||
|
||
### Decode 802.11ax beamforming feedback
|
||
|
||
```python
|
||
import numpy as np
|
||
from wifi_densepose import BfldFrame, BfldKind
|
||
|
||
# Parse compressed BFR from a Wireshark capture into a Complex64 ndarray ...
|
||
fb = np.zeros((2, 1, 996), dtype=np.complex64) # Nr=2 Nc=1 Nsc=996 for HE80
|
||
|
||
frame = BfldFrame.from_compressed_feedback(
|
||
timestamp_ms=ts,
|
||
sounding_index=seq,
|
||
sta_mac="aa:bb:cc:dd:ee:ff",
|
||
kind=BfldKind.CompressedHE80,
|
||
feedback_matrix=fb,
|
||
)
|
||
print(frame.n_subcarriers, frame.mean_amplitude)
|
||
```
|
||
|
||
## Hardware
|
||
|
||
Works with any WiFi chip that exposes CSI. Reference setups (ESP-IDF firmware,
|
||
build scripts, witness-verified test bundles) are in the
|
||
[RuView repo](https://github.com/ruvnet/RuView):
|
||
|
||
| Device | Cost | Role |
|
||
|---|---|---|
|
||
| ESP32-S3 (8MB flash) | ~$9 | WiFi CSI sensing node |
|
||
| ESP32-S3 SuperMini (4MB) | ~$6 | WiFi CSI (compact) |
|
||
| ESP32-C6 + Seeed MR60BHA2 | ~$15 | mmWave HR/BR/presence add-on |
|
||
|
||
The legacy v1 line (Wi-Pose-style FastAPI server) is end-of-life;
|
||
`wifi-densepose==1.99.0` is a tombstone that raises `ImportError` pointing
|
||
to v2 with a migration URL.
|
||
|
||
## Links
|
||
|
||
- **Repository** — https://github.com/ruvnet/RuView
|
||
- **Modernization plan** — [ADR-117](https://github.com/ruvnet/RuView/blob/main/docs/adr/ADR-117-pip-wifi-densepose-modernization.md)
|
||
- **Home Assistant integration** — [ADR-115](https://github.com/ruvnet/RuView/blob/main/docs/adr/ADR-115-home-assistant-integration.md)
|
||
- **Issues** — https://github.com/ruvnet/RuView/issues
|
||
|
||
## License
|
||
|
||
MIT.
|