Spectral Video Acquisition
The prevalent spectrometers capture extremely high spectral resolution (even within 1nm), but remain only static scene capture because these spectrometers (temporally-varying filter, scanning mechanism) requires very long exposure time. Spectral video capture of dynamic real-world still presents lots of difficulties. The proposed spectral camera consists of two sensors, the gray one trades spatial information for spectrum (low-spatial-high-spectral resolution video, without sacrificing temporal information), the other RGB sensor records high-spatial but low-spectral (only RGB) video. The two video streams are synchronized and merged by spectral propagation to achieve high resolution spectral video capture in real-time.
Setups
 |  |  |
| PMIS I | PMIS II | PMIS III |
Videos
| Tracking: Distinguish Poster or Water color [Download] | Tracking: Identify the authenticity of skin [Download] |
Data
 |  |  |  |
readHSD.m is a program for reading HyperSpectral Data in Matlab.
writeHSD.m is a program for writing HyperSpectral Data in Matlab.
Publications
Du H, Tong X, Cao X and Lin S. "A prism-based system for multispectral video acquisition". IEEE International Conference on Computer Vision (ICCV), 30(2): 175-182, 2009
Cao X, Du H, Tong X, Dai Q and Lin S. "A prism-mask system for multispectral video acquisition". IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 33(12): 2423-2435, 2011
Cao X, Tong X, Dai Q and Lin S. "High resolution multispectral video capture with a hybrid camera system". IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 42(7): 297-304, 2011
Ma C, Cao X, Wu R, and Dai Q. "Content-adaptive high-resolution hyperspectral video acquisition with a hybrid camera system". Optics Letters, 39(4): 937-940, 2014
Feng J, Fang X, Cao X, et al. "Advanced hyperspectral video imaging system using Amici prism". Optics express, 22(16): 19348-19356, 2014
Ma C, Cao X, Tong X, Dai Q, and Lin S. "Acquisition of High Spatial and Spectral Resolution Video with a Hybrid Camera System". International Journal of Computer Vision (IJCV), 110 (2): 141-155, 2014
Cao X, Yue T, Lin X, Lin S, Yuan X, Dai Q, Carin L, Brady D. "Computational Snapshot Multispectral Cameras: Towards Dynamic Capture of the Spectral World". IEEE Signal Processing Magazine, 33 (5): 95-108, 2016
Zhao Y, Yue T, Chen L, Wang H, Ma Z, Brady D, Cao X. "Heterogeneous camera array for multispectral light field imaging". Optics Express, 25 (13): 14008-14022, 2017