Video Orbits Head Tracker (VOHT): Real Time Head
Tracking: Images taken using the tracker with an EyeTap. Set your MPEG player
to play this video at 11fps (the speed at which it was run live). Note that
the real--world crosshair marker in the scene is just to judge the accuracy vs.
the virtual--world crosshairs - no such markers are required to run the Video
Orbits Head Tracker (VOHT).
Video Orbits Scene: Here's a scene taken with and eyetap and processed with Video Orbits to create sort of an environment map. Fun Fun. (Its in Amsterdam Schipol airport)(won't play under windoze media player (this mpeg is opensource encoded)).
ISMR2001: Yokohama Japan - I presented a paper at ISMR2001, and had some extra time to tour Tokyo - here's some cyberspace-memories.
Wearcomp images taken in Italy. I attended SSGRR
2000 conference in L'Aquila, Italy and also had some time to tour Rome with
my wearable and take some images.
Steve Mann, James Fung, and Ariel Garten,
"DECONcert: Making Waves with Water, EEG, and Music",
R. Kronland-Martinet, S. Ystad, and K. Jensen (Eds.): CMMR 2007, LNCS 4969, pp. 487-505. Springer-Verlag Berlin Heidelberg 2008 [ HTML ]
Steve Mann, Ryan Janzen, Raymond Lo, James Fung,
"Non-Electrophonic Cyborg Instruments...",
Proceedings of the 2007 Association of Computing Machinery (ACM) Multimedia
(ACM MM 2007) Conference, September 24-29, Augsburg, Germany.
Steve Mann, James Fung, and Ariel Garten,
"DECONcert: Bathing in the light, sound, and waters of the musical brainbaths",
Proceedings of the 2007 International Computer Music Conference
(ICMC2007), vol. 2, p. 204-211, August 27-31, Copenhagen, Denmark,
Steve Mann, James Fung and Raymond Lo, "Cyborglogging with Camera Phones: Steps Toward Equiveillance", Proceedings of the ACM Multimedia 2006 , Santa Barbara, California, Oct. 23--27, 2006 [ PDF ][ Presentation PDF ]
Computer Vision/GPU Programming
James Fung, Steve Mann, "Using Graphics Devices in Reverse: GPU-based Image Processing and Computer Vision", Proceedings of the IEEE Int'l Conf. on Multimedia & Expo, Hannover, Germany, June 23-26, 2008 [PDF]
James Fung, Steve Mann, Chris Aimone, "OpenVIDIA: Parallel GPU Computer Vision", Proceedings of the ACM Multimedia 2005 , Singapore, Nov. 6-11, 2005, pages 849-852 [ Adoble PDF ]
[ HTML ]
[ Web ]
James Fung, Steve Mann, "Projective Demosaicing Using Multiple
Overlapping Images", Proceedings of the 2004 International
Symposium on Intelligent Multimedia, Video and Speech Processing (ISIMP 2004),
Hong Kong, October 22--24, 2004, pages 190-193
[ PDF ]
Rosco Hill, James Fung, Steve Mann, "Reality Window Manager: A User Interface For Mediated Reality", Proceedings of the 2004 IEEE International
Conference on Image Processing (ICIP2004), Singapore, October 24-27, 2004.
[ Adoble PDF ]
[ HTML ]
James Fung, Steve Mann, "Using Multiple Graphics Cards as a General Purpose
Parallel Computer : Applications to Computer Vision",
Proceedings of the 17th International
Conference on Pattern Recognition (ICPR2004)
, Cambridge, United Kingdom, August 23-26, 2004, volume 1, pages 805-808.
[ Adobe PDF ]
S. Mann and J. Fung, "EyeTap devices for augmented, deliberately diminished,
or otherwise altered visual perception of rigid planar patches of real world scenes", PRESENCE, 2002, vol. 11, no. 2, pages 158-175, MIT Press.
# set the camera to store image from RAM memory onto the memory card
gphoto2 --set-config /main/settings/capturetarget=Memory\ card
# delete image 1 in the directory given by -f
gphoto2 -f /store_00010001/DCIM/100NCD70 -d 1
# delete all images in the directory given by -f
gphoto2 -f /store_00010001/DCIM/100NCD70 -D
# to transfer to PC, use similar function using -P and -p to delete
"When you stumble, it usually makes you move forward faster."
"Your options are only ever limited by your imagination."
"What is wrong is that we have invented the technology to eliminate
scarcity, but we are deliberately throwing it away to
benefit those who profit from scarcity."
"... the way constitutional rights are lost... Not in the thunder of a tyrant's edict, but in the soft judicial whispers of deference."
4th District Court of Appeal Justice David Sills (California)
Samuel C. Florman, "The Existential Pleasures of Engineering"
Just a picture of a minimalist desktop setup I played around with, using aterms tinted "Slategrey", and FVWM2, setting handles/borderwidths to 1.
That was my desktop. So here's the top of my desk. Messy you say? Ha. Should've
seen it before. This panorama was created with the graphics hardware
doing all the computations.
its cold. brr. gerstein is falling over.
and what's with the bizarre bales of hay anyways
These panorama generated entirely by a graphics card, from about 300
images from a webcam.
Nowadays, anyone can make easy panoramas using the online tool Glogger.
My interests include using Graphics Hardware for parallel general purpose
computing, including implementing Computer Vision on the GPU. This work won the
ACM Multimedia 2005 Open Source Software Award and resulted in the book chapter
"Computer Vision on the GPU" in the popular GPU Gems 2 series of graphics
programming books. This work has achieved implementation of vision algorithms
on the GPU, including projective image stitching, Chirplet detection, Radon
Transforms and natural feature processing and matching. I have been an author
on 12 peer reviewed papers in IEEE and ACM conferences in the areas of parallel
GPU Computer Vision and Mediated Reality. Merging technology with artistic
endeavours, I helped create a system for the first ``Deconcert'' where 100
participants' brainwaves analyzed in real-time to drive music and sound
synthesis. This work was featured on the Discovery Channel and Canadian
national radio (Canadian Broadcasting Corporation, CBC). I am a student
researcher in the SSHRC (Social Sciences and Humanities Research Council of
Canada) Anonequity Project examining the importance of anonymity and
authentication in a networked society. Currently I am involved in helping
build and architect the Glogger system for continuous live upload from camera
phones to a Glogger/Sousveillance community. I have acted as co-organizer
for DASIP 2011 special session on GPU processing, and guest editor for the
EURASIP Journal on Image and Video Processing special issue on Many-Core and
Multi-Core Real Time Image Processing. Additionally I have served on the
technical committee for GPUCV and CVPR sessions on the GPU processing. I
am co-author of the book "OpenCL Programming Guide" published by Addison-Wesley, 2011.
Short Bio, up to 2011
James Fung has been applying GPUs to accelerate general purpose parallel
computing since their graphics-only days, with a focus on image
processing and computer vision. He received his Ph.D. in Electrical and
Computer Engineering from the University of Toronto. He is at NVIDIA in
the Developer Technology group. His work has been featured on Canadian
national radio (CBC) and recently he has served as a guest editor for
the EURASIP Journal on Image and Video Processing and session organizer
at DASIP (2011). He is co-author of the "OpenCL Programming Guide"
published by Addison-Wesley, 2011.
Best Viewed by Lynx, GLynx, Netscape, IE, or any other browser - 'cause this is pretty accessible HTML!
This page generated with the power of vi