Spectral Workbench goals

[jywarren]

Background info

Here are some great places to read about how people have used this library in different ways:

• http://publiclab.org/tag/spectral-workbench
• documentation can be found here, including screencasts: https://publiclab.org/wiki/spectral-workbench

High priority

• modernize getUserMedia integration - Update getUserMedia WebRTC library for broader browser compatibility (+ iOS) #87
• continue/refine code compilation ADD: Compile capture.js subfiles into one file #152 - consider switch to Browserify/WebPack
• replace spectral-workbench capture with the modularized version, as Editor is included in plots2 - https://github.com/publiclab/PublicLab.Editor
• finalize v2 integration (above) and add publicly visible link to new interface (while preserving link to v1)
• iOS Safari video freezes #266 test on iOS?
• CFL autodetection:
• Allow different input resolutions - Enable resolution changes with getUserMedia API options #71
• develop a stand-alone program from viewer and capture modules
• develop test cases for capture program, such as doing a calibration, detecting overexposure, potentially using pre-recorded video
• create documentation for setup and initialization of capture interface

Nice to have

• ability to save spectra as JSON files
• new UI (react?) that fulfills the above (including rotate, flip, etc)
• ability to view saved spectra offline, by dragging in a standard local JSON file
• communicate requirements list for current capture UI to end-user (Safari, iOS, browsers, versions) behind a link
• make a static/standalone demo page for ability to upload an image and calibrate and graph it, extract JSON

---

Collecting more:

• More concise constructor
• Integration code consolidation
• Screen size adaptations
• “Matching” similar spectra interface
• Allow connecting to a remote video source, for example a video streaming off an ESP32 camera (https://www.instructables.com/ESP-32-Camera-Streaming-Video-Over-WiFi-Getting-St/ https://github.com/espressif/esp32-camera)
• Video flipping/rotating
• camera direction selection (front/back) is critical! I believe this can be achieved with the new capture code: Add switch camera, resolution buttons #190
• Add download button to new demo #191
• Integrate new Capture interface with upstream Rails application #219
• Add switch camera, resolution buttons #190
• Added connect to Pi button #103
• Add "capture" variant code for Raspberry Pi camera streaming #75
• mouseover should show wavelength on capture mode spectral-workbench#71
• Standardized WebRTC camera selection spectral-workbench#353
• reduce noise with time averaging spectral-workbench#339

I'm compiling a couple milestones with other important issues at:

• https://github.com/publiclab/spectral-workbench.js/milestones
• https://github.com/publiclab/spectral-workbench/milestone/4

Let's also combine #92 into this and close it.

[jywarren]

• https://publiclab.org/wiki/spectral-workbench-snapshots
• https://publiclab.org/wiki/spectral-workbench-calibration
• https://publiclab.org/wiki/spectral-workbench-tools
• https://publiclab.org/wiki/spectral-workbench-operations

[jywarren]

Just chiming in that the above tutorial videos are all fixed now! cc @alaxalves -- sorry it took a while!

[alaxalves]

OMG @jywarren I was totally unaware of this JS package!! The more I navigate through PublicLab the more I find new stuff. Since this is spectral-related maybe I can find some time in my GSOC schedule to contribute to this too. Thanks for taking time on those tutorials. 😄

[jywarren]

:-)

that would be amazing! thanks, Alax!

Just noting that i got this running on Node 8 (#165) but node 10 is blocked by a globals usage that may take significant refactoring: #162 -- and that we seem to be limited on how far we can upgrade d3 because of our use of nvd3 wrapper library (read more in #155).

However, i think a lot of the dependabot upgrades will start working more now that we are on Node 8.

[jywarren]

Many of these may be complete - let's update our list and close relevant issues, but only if they are very close to going live on SpectralWorkbench.org, maybe? Or just note if there are any remaining steps before they go live (i.e. their status):

[jywarren]

Updated this after the huge project of this summer by @waridrox !!! Great work!! publiclab/spectral-workbench#645