Neuro Studio Panels
Each Neuro Studio panel, the data it displays, the sketch code that produces it, and the controls it sends back to the board.
Neuro Studio's sidebar panels are driven by the metadata the board attaches to its video frames. A panel appears when the board announces the corresponding capability or sends the corresponding data, and shows a "No data" message otherwise. Panels reset when the board disconnects.
Video overlays
Overlays are drawn on the main picture rather than in a panel. Buttons above the picture switch each category on and off, and appear only for categories present in the stream.
| Overlay | Content | Produced by |
|---|---|---|
| Boxes | Rectangles with class name and score | Every bundled post-processor |
| Masks | Translucent instance segmentation fills | PostProcess_YOLOv8_ISEG |
| Keypoints and bindings | Body and hand points joined into skeletons | PostProcess_YOLOv8_MPE, PostProcess_HandLandmarks, PostProcess_PalmDetector |
| Inference time | Milliseconds per pass | The post-processor on metadata slot 0 |
| Warning | A text banner held for a few seconds | The core, for conditions such as a clamped crop |
Coordinates are camera-normalised, so overlays align with the picture whatever crop the model saw. Slot 0 provides the frame-wide box list; see Running Several Models.
Terminal
The board's USB serial console. Lines the board published before Neuro Studio connected are replayed between [bootlog] markers. The log is capped at 5000 lines. Text arrives as META_DEBUG_TEXT records; Serial.print output and vnd_meta_publish_debug_text() both appear here.
IMU and Magnetometer
Each has a Numbers page with live values and a Graph page with rolling line charts. The IMU graph shows acceleration and angular rate separately because their magnitudes differ. Charts have labelled axes and an automatic or manual y-axis range. Data arrives as META_IMU_FRAME (seven floats) and META_MAG_FRAME (four floats), published by the libraries' sendNS() methods.
ToF
A heat map of the VL53L1CB's zones with the distance in each. The panel's settings form sends a configuration packet (CFG0) to the board with the ranging profile, region size and step, timing budget and signal thresholds. The packet is not acknowledged by the board, and the panel reports it as sent rather than applied. Data arrives as META_TOF_FRAME.
Thermal
The FLIR Lepton frame, shown as the main video on a board without a colour camera or alongside it on a board with both. Colour maps are grey, ironbow and inferno. Tapping the picture places a probe that reads the temperature at that pixel; tapping a probe removes it. Alignment controls scale and offset the thermal frame over the visible one. Data arrives as META_THERMAL_FRAME, 160x120 16-bit values, radiometric in hundredths of a kelvin.
Camera Controls
Switches for automatic exposure, gain and white balance and sliders for manual exposure and gain. The panel appears when the board announces META_CAM_CAPS, which the OV5640 does and the VD66GY does not. Changes are sent as CAM0 packets and are not persisted on the board. See Capture Controls.
ISP
White balance gains, black level, sharpness, gamma and the colour correction matrix for the VD66GY's image signal processor. The panel appears when a sketch sets cfg.isp_enabled = VD66_isp_tuning_manual, which the board announces with META_VD66_ISP_ENABLED. Apply sends an ISP0 packet. See The Global Shutter Camera.
Tuning
One slider or switch per parameter the sketch registered with n6_tune_int, n6_tune_float, n6_tune_bool or n6_tune_hue. The board announces the parameter set as META_TUNE_DESC about once per second and the panel builds itself from the description. Dragging a slider sends a TUN0 packet. Copy as code places the current values on the clipboard as C literals. Values are not stored on the board. See Live Tuning and Assets.
Vision
Results from the classical vision sketches: QR codes, barcodes, colour blobs and AprilTags. Each result shows its decoded text or identifier and a crop thumbnail, and its box is drawn on the video. The panel title follows the META_VISION_ID announcement, a bitmask naming which detectors the sketch runs. Thumbnails are evidence and are produced by the board only while Neuro Studio is connected and subscribed; see Wire Protocol. Data arrives as META_QR_FRAME, META_BARCODE_FRAME, META_BLOB_FRAME and META_APRILTAG, with thumbnails in META_EVIDENCE_CROP.
Audio
Playback of the microphone is a status bar control rather than a panel; the board sends META_AUDIO_PCM chunks with their sample rate. The Audio panel shows the sound classifier's ten class scores as bars, the winning class, the level and the threshold, and the log-mel spectrogram the network was given. It appears once the board has sent the class names in META_AUDIO_LABELS. See Audio Event Detection.
Events
One entry per event reported by the N6Events library, with its identifier, time since boot, the sources that triggered it (motion, network, audio, thermal, ToF, GPIO, timer or host), its state, score, and the number of frames before and after it in the clip. Entries update in place as the board re-announces an event. The panel appears on the first event of a session and clears on disconnect. Data arrives as META_EVENT. See Events and SD Logging.
Stream view
A diagnostic panel showing the frame identifier, metadata length and JPEG length of the current frame and the parser's counters.