02 · Learning platform
SYNCopated
Piano lessons, together — in sync.
Remote piano lessons that feel in-person: a shared live score kept in step in real time, a note listener trained on licensed piano audio, and a score library fed by an optical-music-recognition pipeline with a fitted region proposer.
- 01Live lesson sync — a WebSocket relay for MIDI, cursor, metronome and ink; its protocol is generated into every client and conformance-tested in CI.
- 02A trained note listener — an onset network on Basic Pitch's design, being retrained on 30 hours of licensed, rendered and augmented piano audio, for on-device inference through a C and WebAssembly core.
- 03OMR with a fitted proposer — music regions proposed by a model fitted on human-confirmed bands and measured on held-out method books; Audiveris reads each region.
- 04Practice that adapts — today's steps in order; a skill counts as mastered when the last three attempts average 80% or better.
- 05Phrase detection — music-theory cadence rules mark a score's phrases, tested once on held-out scores; the detector abstains where it is unsure.
- 06Self-driving library — scheduled corpus ingest drafts scores; a person publishes each one through a review queue.
- 07Observability — a Prometheus metrics endpoint and Application Insights on the server, with Grafana dashboards and alert rules.
- 4 surfaces
- 100 server ADRs
- 49 API route modules
- 19 sync message types
SurfacesiOSWeb
- Swift 6 · SwiftUI
- AVAudioEngine
- Node · Express
- Python OMR worker
- PostgreSQL
- LiveKit
- Azure Container Apps
- Cloudflare Workers