Mitsubishi Electric Research Labs (MERL)
Cambridge, MA
Prakash: Lighting-Aware Motion Capture Using
Photosensing Markers and Multiplexed Illuminators
- Главная
- Разное
- Дизайн
- Бизнес и предпринимательство
- Аналитика
- Образование
- Развлечения
- Красота и здоровье
- Финансы
- Государство
- Путешествия
- Спорт
- Недвижимость
- Армия
- Графика
- Культурология
- Еда и кулинария
- Лингвистика
- Английский язык
- Астрономия
- Алгебра
- Биология
- География
- Детские презентации
- Информатика
- История
- Литература
- Маркетинг
- Математика
- Медицина
- Менеджмент
- Музыка
- МХК
- Немецкий язык
- ОБЖ
- Обществознание
- Окружающий мир
- Педагогика
- Русский язык
- Технология
- Физика
- Философия
- Химия
- Шаблоны, картинки для презентаций
- Экология
- Экономика
- Юриспруденция
raskar Mocap презентация
Содержание
- 1. raskar Mocap
- 2. Vicon Motion Capture High-speed IR
- 3. Hidden Marker Tags Outdoors Unique Id
- 4. Inverse Optical Mo-Cap High Speed
- 5. Imperceptible Tags Location
- 6. Location Orientation
- 7. 3D Overlay Orientation
- 8. Imperceptible Tags Incident Illumination
- 9. Prakash: Lighting-aware Mo-Cap Geometry via Space Labeling
- 10. Photosensing Marker Tag Scene
- 11. Labeling Space (Indoor GPS) Each location
- 12. Pattern MSB Pattern MSB-1 Pattern LSB Binary Gray-codes
- 13. Pattern MSB Pattern MSB-1 Pattern LSB
- 14. Fast Pattern Projector? 60 Hz => 3 location/sec 10,000 Hz
- 15. Fixed Masks + Blinking LEDs Fast
- 16. Fixed Masks + Blinking LEDs Fast
- 19. 1D location
- 20. Inside of Projector
- 22. 2D Location 3D Location Y data X data Y data X data X2 data
- 23. Prakash: Lighting-aware Mo-Cap Geometry via Space Labeling
- 24. Analog Space Labeling Projectors Beacon1 Beacon2 Beacon3 Beacon4
- 25. IR Beacons for Orientation Y projector X Projector X2 Projector
- 26. Photosensor On Marker Tag Orientation IR Beacons
- 27. Analog Space Labeling Projectors Beacon1 Beacon2 Beacon3 Tag N ?
- 28. Analog Space Labeling Projectors Beacon1 Beacon2 Beacon3
- 29. On-set MoCap: Location + Orientation + Incident Illumination Incident Illumination Color
- 30. Limitations Occlusions and Accuracy Multiple surround transmitters
- 31. Tracking Specular Object Tracking behind Coca Cola
- 32. System Specifications Location tracking in 2D: 500
- 33. Emerging Technology Demo 200,000 Hz Multi-LED
- 34. Prakash: Lighting Aware Optical Mo-Cap
- 35. END
- 36. Related Work Camera Based systems [ViconPeak 2006;
- 37. Inverse Optical Mo-Cap
- 38. Inside of Projector The Gray code pattern
- 40. Optical Mo-Cap High-speed Cameras Controlled
- 41. Labeling Space
Vicon
Motion Capture High-speed
IR Camera Medical Rehabilitation Athlete Analysis Performance Capture Biomechanical Analysis
Слайд 1
R Raskar, H Nii, B de Decker, Y Hashimoto, J Summet,
D Moore, Y Zhao, J Westhues, P Dietz, M Inami, S Nayar, J Barnwell, M Noland, P Bekaert, V Branzoi, E Bruns
Mitsubishi Electric Research Labs (MERL)
Cambridge, MA
Mitsubishi Electric Research Labs (MERL)
Cambridge, MA
Слайд 2Vicon
Motion Capture
High-speed
IR Camera
Medical Rehabilitation
Athlete Analysis
Performance Capture
Biomechanical Analysis
Слайд 4
Inverse Optical Mo-Cap
High Speed Camera
Reflecting/Emitting Marker
Only Location
High Speed Projector
Photosensing Marker
Location, Orientation, Illum
Слайд 9Prakash: Lighting-aware Mo-Cap
Geometry via Space Labeling
Binary
High speed LED projector
3D location
Analog
Bright Beacons
Orientation
Слайд 11Labeling Space
(Indoor GPS)
Each location
receives a unique
temporal code
But 60Hz
video
projector
is too slow
Projector
Tag
x=0
x=255
Time
Слайд 13
Pattern
MSB
Pattern
MSB-1
Pattern
LSB
For each tag
From projected pattern sequence, decode x coordinate
From projected pattern
sequence, decode y coordinate
Transmit back ( Id, x, y )
Transmit back ( Id, x, y )
0
1
1
0
0
X=12
Binary Gray-codes
Слайд 16
Fixed Masks + Blinking LEDs
Fast Switching using
Non-colocated Emitters for Structured Light
Tag
Слайд 23Prakash: Lighting-aware Mo-Cap
Geometry via Space Labeling
Binary
High speed LED projector
3D location
Analog
Bright Beacons
Orientation
Слайд 30Limitations
Occlusions and Accuracy
Multiple surround transmitters
Strong Ambient Light
High frequency (455Khz) Modulation
Inter-reflections
Binary optical
communication
Wires on Tags
Batteries + cables
Limited Wireless Bandwidth
Compression on aggregate data
Very Fast Motion
Simultaneity assumption
Wires on Tags
Batteries + cables
Limited Wireless Bandwidth
Compression on aggregate data
Very Fast Motion
Simultaneity assumption
Слайд 32System Specifications
Location tracking in 2D: 500 Hz
Location+Orientation+Illum: 124 Hz
Location:
FoV:
27 degrees
Angular resolution 0.1 degrees
Accuracy ~5mm at 3 meters
Orientation:
Resolution ~1 degree at 3 meters
Angular resolution 0.1 degrees
Accuracy ~5mm at 3 meters
Orientation:
Resolution ~1 degree at 3 meters
Слайд 33
Emerging Technology Demo
200,000 Hz Multi-LED Projector
Location precision 100 micrometer
Camera tracking with
imperceptible markers
All week
Sketch (Later today)
More details
Rendering techniques
Tuesday 3:30pm, ‘Is it real’, Room 1AB
All week
Sketch (Later today)
More details
Rendering techniques
Tuesday 3:30pm, ‘Is it real’, Room 1AB
Слайд 36Related Work
Camera Based systems [ViconPeak 2006; Optotrak 2007; PhaseSpace2005]
Expensive high speed
cameras
Systems using Photosensors [Indoor GPS 2004; HiBall 1997]
Low framerate or challenging setup
Magnetic/Acoustic Based Systems [F.H. Raab et al. 1979]
Interference, drift
Inertial Tracking (Gyro / Compass) [G. Welch 1995]
Drift
Systems using Photosensors [Indoor GPS 2004; HiBall 1997]
Low framerate or challenging setup
Magnetic/Acoustic Based Systems [F.H. Raab et al. 1979]
Interference, drift
Inertial Tracking (Gyro / Compass) [G. Welch 1995]
Drift
Слайд 38Inside of Projector
The Gray code pattern
Focusing Optics
Gray code Slide
Condensing Optics
Light Source
Слайд 40Optical Mo-Cap
High-speed Cameras
Controlled Settings
Visible retroreflective markers/LEDs
High contrast clothing
Controlled lighting
No unique Id
Marker-swapping/reacquisition
issues
Cleanup software
Expensive
High bandwidth
Limited by camera frame rate
Non-optical Mo-Cap
Drift/Global distortions
Difficult for video overlay
Cleanup software
Expensive
High bandwidth
Limited by camera frame rate
Non-optical Mo-Cap
Drift/Global distortions
Difficult for video overlay
1M at 500fps
