About UsResearchOpportunities
PublicationsResourcesSite Map
Publications

Selected Academic Publications
(a sampling of publications in reverse chronological order)

2007

Ryan Janzen, Steve Mann, "Arrays of Water Jets as User Interfaces: Detection and Estimation of Flow by Listening to Turbulence Signatures using Hydrophones", Proceedings of the 2007 Association of Computing Machinery (ACM) Multimedia (ACM MM 2007) Conference, September 24-29, Augsburg, Germany [Download].

Steve Mann, Ryan Janzen, "Fluid Samplers: Sampling Music Keyboards Having Fluidly Continuous Action and Sound, without Being Electrophones", Proceedings of the 2007 Association of Computing Machinery (ACM) Multimedia (ACM MM 2007) Conference, September 24-29, Augsburg, Germany [Download].

Steve Mann, Ryan Janzen, Raymond Lo, James Fung, "Non-Electrophonic Cyborg Instruments...", Proceedings of the 2007 Association of Computing Machinery (ACM) Multimedia (ACM MM 2007) Conference, September 24-29, Augsburg, Germany [Download].

Steve Mann, James Fung, and Ariel Garten, "DECONcert: Bathing in the light, sound, and waters of the musical brainbaths", Proceedings of the 2007 International Computer Music Conference (ICMC2007), August 27-31, Copenhagen [More info...].

Steve Mann, Ryan Janzen, Raymond Lo, and Chris Aimone, "Inventing new instruments based on a computational ``hack''...", Proceedings of the 2007 International Computer Music Conference (ICMC2007), August 27-31, Copenhagen. [Download].

Steve Mann, Ryan Janzen, and James Meier, "The electric hydraulophone: A hyperacoustic instrument with acoustic feedback", Proceedings of the 2007 International Computer Music Conference (ICMC2007), August 27-31, Copenhagen.

Steve Mann, Ryan Janzen, Chris Aimone, Ariel Garten, and James Fung, "Performance on Physiphones in each of the five states-of-matter", Live Performance at the 2007 International Computer Music Conference (ICMC2007), August 28, 17:00-18:00, DGI-Byen Swim Centre (Vandkulturhuset), Copenhagen.

Steve Mann, "Natural Interfaces for Musical Expression: Physiphones and a physics-based organology", Proceedings of the 2007 Conference on New Interfaces for Musical Expression (NIME07), June 6-10, New York, NY, USA. [PDF].

2006

Corey Manders and Steve Mann, "Digital Camera Resolution: An Improved Heisenberg-Gabor Testing Method", Proceedings of the 2006 International Symposium on Multimedia, December 11-13, San Diego, U.S.A. [PDF] [PDF with proper pagination (page numbers exactly as it appeared)].

Steve Mann, Michael Georgas, and Ryan Janzen, "Water Jets as Pixels: Water Fountains as Both Sensors and Displays", Proceedings of the 2006 International Symposium on Multimedia, pp.766-772, San Diego, U.S.A., December 11-13, 2006 [ PDF ]. [ Abstract, PDF, PS ].

Corey Manders and Steve Mann, "True images: a calibration technique to reproduce images as recorded", Proceedings of the 2006 International Symposium on Multimedia, December 11-13, San Diego, U.S.A. [PDF]

Corey Manders and Steve Mann, "A Handheld Electronic Camera Flash Lamp as a Tangible User Interface for Creating Expressive Visual Art Works", Proceedings of the 2006 ACM International Conference on Multimedia (ACM MM), October 23-27, Santa Barbara, USA. [PDF]

Steve Mann and Ryan Janzen and Mark Post, "Hydraulophone design considerations: Absement, displacement, and velocity-sensitive music keyboard in which each key is a water jet", Proceedings of the 2006 ACM International Conference on Multimedia (ACM MM), October 23-27, Santa Barbara, USA. [ PDF ] [ Abstract, PDF, PS ]

Steve Mann, James Fung and Raymond Lo, "Cyborglogging with Camera Phones: Steps Toward Equiveillance", Proceedings of the ACM Multimedia 2006 , Santa Barbara, California, Oct. 23--27, 2006 [ PDF ][ Presentation PDF ]

Corey Manders, "Lightspace: A Natural Domain for Imaging and Analysis", Ph.D. Thesis, supervisor Steve Mann, October 2006, University of Toronto. [PDF]

Steve Mann, Ahmedullah Sharifi, Mike Hung, and Russell Verbeeten, "The Hydraulophone: Instrumentation for tactile feedback from fluid streams as a new multimedia interface (water fountain as keyboard)", Proceedings of the 2006 IEEE International Conference on Multimedia and Expo (ICME2006), pp 409-412, Toronto, Canada, 2006 July 9-12 [ PDF ]. [ Abstract, PDF, PS ].

Corey Manders and Steve Mann, "A single Heisenberg-Gabor based figure-of-merit based on the modulation transfer function of digital imaging systems", Proceedings of the 2006 International Conference on Multimedia and Expo, July 9-12, Toronto, Canada. [PDF].

2005

Corey Manders and Steve Mann, "Digital Camera Sensor Noise Estimation from Different Illuminations of Identical Subject Matter", Proceedings of the 2005 IEEE International Conference on Information, Communication, and Signal Processing, Dec 6-9 2005, Bangkok, Thailand. [PDF].

J. Cui, W. Wong, and S. Mann, "Time-frequency analysis of visual evoked potentials using chirplet transform," IEE Electronics Letters, vol. 41, no. 4, pp. 217-218, 2005. [ Adobe PDF ]

Steve Mann, Isaac Harris, Joshua Harris, "The development of urban renewable energy at the existential technology research center (ETRC) in Toronto, Canada", Renewable and Sustainable Energy Reviews (In Press), pages 1-14 [ Adobe PDF ]

Steve Mann, James Fung, Chris Aimone, Anurag Sehgal and Daniel Chen. "Designing EyeTap Digital Eyeglasses for Continuous Lifelong Capture and Sharing of Personal Experiences." In Proceedings of ALT.CHI 2005. Portland, OR: ACM Press, 2005 [ Adobe PDF ]

James Fung. "Computer Vision on the GPU", in GPU Gems 2,Addison Wesley, 2005, chapter 40, pages 649-665, edited by Matt Pharr [ PDF (early edit) ] [ HTML (early edit) ] [ link ]

James Fung, Steve Mann, Chris Aimone, "OpenVIDIA: Parallel GPU Computer Vision", Proceedings of the ACM Multimedia 2005 , Singapore, Nov. 6-11, 2005, pages 849-852 [ Adoble PDF ] [ HTML ] [ Web ]

Steve Mann, "'flUId streams': Fountains that are keyboards with nozzle spray as keys that give rich tactile feedback and are more expressive and more fun than plastic keys", Proceedings of the ACM Multimedia 2005, pages 181-190, Singapore, Nov. 6-11, 2005 [ PDF ][ Abstract, PDF, PS ]

Steve Mann, "Image processing considerations for simple real-time restrictometric fluid-based user interfaces", Proceedings of the IEEE International Conference on Image Processing (ICIP2005), Volume: 3, pages: III- 1300-3, Genoa, Italy, 11-14 Sept. 2005 [ PDF ] [ Abstract, PDF, PS ]

2004

Corey Manders and Steve Mann, "Determining Camera Response Functions from Comparagrams of Images with Their Raw Datafile Counterparts", Proceedings of the 2004 IEEE International Symposium on Intelligent Multimedia, pages 418 to 421, Oct. 20-22 2004, Hong Kong. [PDF].

James Fung, Steve Mann, "Projective Demosaicing Using Multiple Overlapping Images", Proceedings of the 2004 International Symposium on Intelligent Multimedia, Video and Speech Processing (ISIMP 2004), Hong Kong, October 22--24, 2004, pages 190-193 [ Adobe PDF ] [ HTML ]

Steve Mann, "Sousveillance": inverse surveillance in multimedia imaging", Proceedings of the 12th annual ACM international conference on Multimedia, New York, NY, USA, Pages: 620 - 627, 2004, ISBN:1-58113-893-8 [Adobe PDF] [HTML]

Steve Mann, "Continuous lifelong capture of personal experience with EyeTap", keynote address, ACM International Multimedia Conference, Proceedings of the 1st ACM workshop on Continuous archival and retrieval of personal experiences (CARPE 2004), New York, New York, Oct. 15, 2004, p.1 - 21 [ Adobe PDF ] [ HTML ]

Corey Manders, Chris Aimone, and Steve Mann, "Camera Response Function Recovery from Different Illuminations of Identical Subject matter", Proceedings of the 2004 IEEE International Conference on Image Processing (ICIP2004), Singapore, October 24-27, 2004. [ Adobe PDF ] [ HTML ]

Rosco Hill, James Fung, Steve Mann, "Reality Window Manager: A User Interface For Mediated Reality", Proceedings of the 2004 IEEE International Conference on Image Processing (ICIP2004), Singapore, October 24-27, 2004. [ Adoble PDF ] [ HTML ]

James Fung, Steve Mann, "Using Multiple Graphics Cards as a General Purpose Parallel Computer : Applications to Computer Vision", Proceedings of the 17th International Conference on Pattern Recognition (ICPR2004) , Cambridge, United Kingdom, August 23-26, 2004, volume 1, pages 805-808. [ Adobe PDF ] [ HTML ]

Steve Mann, Corey Manders, Billal Belmellat, Mohit Kansal and Daniel Chen, "Steps towards 'undigital' intelligent image processing: Real-valued image coding of photoquantimetric pictures into the JLM file format for the compression of Portable Lightspace Maps", Proceedings of the 2004 IEEE International Symposium on Intelligent Signal Processing and Communications Systems (ISPACS 2004), Seoul, Korea, Nov. 18 - 19, 2004 [ Adobe PDF ] [ HTML ]

James Fung, Steve Mann, "Computer Vision Signal Processing on Graphics Processing Units", Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2004), Montreal, Quebec, Canada, May 17-21, 2004, pp. V-93 - V-96 [ Adobe PDF ] [ HTML ]

Rosco Hill, Joe Rideout, "Automatic Method Completion", Proceedings of the 2004 IEEE Automated Software Engineering Conference (ASE2004), Austria, September 20-24, 2004.

2003

S. Mann, C. Manders, and J. Fung, "The Lightspace Change Constraint Equation (LCCE) with practical application to estimation of the projectivity+gain transformation between multiple pictures of the same subject matter" Appears in IEEE ICASSP 2003 [Adobe PDF ]

Steve Mann, "Existential Technology: Wearable Computing Is Not the Real Issue!" Leonardo, MIT Press, 36(1), 2003, pp.19-26 [ Adobe PDF ] [ HTML ]

C. Aimone, J. Fung, S. Mann, "An EyeTap video-based featureless projective motion estimation assisted by gyroscopic tracking for wearable computer mediated reality" ACM Personal and Ubiquitous Computing published by Springer Verlag, Vol.7, Iss. 3, 2003

Steve Mann, Jason Nolan, Barry Wellman, "Sousveillance: Inventing and Using Wearable Computing Devices for Data Collection in Surveillance Environments" Surveillance and Society , Vol.1, Iss. 3, July, 2003 [Adobe PDF ]

2002

James Fung, Felix Tang, Steve Mann, "Mediated Reality Using Computer Graphics Hardware for Computer Vision", Proceedings of the IEEE International Symposium on Wearable Computing 2002 (ISWC2002), Seattle, Washington, USA, Oct 7-10, 2002, pp. 83-89. [Adobe PDF]

James Fung, Steve Mann, "Exploring Humanistic Intelligence Through Physiologically Mediated Reality", Proceedings of the IEEE International Symposium on Mixed and Augmented Reality 2002 (ISMAR2002), September 30-October 1, 2002, Darmstadt, Germany, Page(s): 275-276 [Adobe PDF]

Felix Tang, Chris Aimone, James Fung, Andrej Marjan, Steve Mann, "Seeing Eye to Eye: a shared mediated reality using EyeTap devices and the VideoOrbits Gyroscopic Head Tracker", Proceedings of the IEEE International Symposium on Mixed and Augmented Reality (ISMAR2002),September 30-October 1, 2002, Darmstadt, Germany, Page(s): 267-268. [Adobe PDF]

Steve Mann, Corey Manders, James Fung, "Painting with Looks: Photographic images from video using quantimetric processing", ACM Multimedia 2002 [Adobe PDF]

Chris Aimone, Andrej Marjan, Steve Mann IEEE International Symposium on Wearable Computing 2002 [Adobe PDF]

S. Mann and J. Fung, "EyeTap devices for augmented, deliberately diminished, or otherwise altered visual perception of rigid planar patches of real world scenes", PRESENCE, 2002, Vol. 11, No. 2, pages 158-175, MIT Press. [Adobe PDF]

Daniel Chen, Saman Sadeghi, Steve Mann, "On the Design of HI-based Biofeedback Interfaces", IEEE International Conference on Systems, Man and Cybernetics, September 30-October 1, 2002, Tunisia, Page(s): 275-276 [ Adobe PDF ]

Angela Garabet, Steve Mann, James Fung, "Watching Them Watching Us", ACM Conference on Computer Human Interaction (CHI 2002), Minneapolis, Minnesota, April 20-25, 2002

2001

Steve Mann, James Fung, "VideoOrbits on Eye Tap Devices for Deliberately Diminished Reality or Altering the Visual Perception of Rigid Planar Patches of a Real World Scene", Proceedings of the Second IEEE International Symposium on Mixed Reality, pp 48-55, March 14-15, 2001 [Postscript]

Steve Mann, Daniel Chen, Saman Sadeghi "HI-Cam: Intelligent Biofeedback Signal Processing ", Proceedings of the IEEE International Symposium on Wearable Computing 2001 (ISWC2001), Zurich, Switzerland, Oct 7-10, 2001 [Adobe PDF]

Steve Mann, Richard Mann "Quantigraphic Imaging: Estimating the Camera Response and Exposures from Differently Exposed Images ", IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Kauai, Hawaii, December 11-13, 2001 [Adobe PDF]

C. Manders, and S. Mann "Programming for Eyetap Systems" , Embedded Linux Journal, November/December, 2001 [HTML]

Steve Mann, Robert Guerra "The Witnessential Net", Proceedings of the IEEE International Symposium on Wearable Computing 2001 (ISWC2001), Zurich, Switzerland, Oct 7-10, 2001

2000

Steve Mann, "Telepointer: Hands-free completely self-contained wearable visual augmented reality without headwear and without any infrastructural reliance ", Proceedings of the IEEE International Symposium on Wearable Computing 2000 (ISWC2000), Oct 16-17, 2000 [Adobe PDF]

Steve Mann, "Comparametric Equations with Practical Applications in Quantigraphic Image Processing ", IEEE Transactions on Image Processing, Vol 9, No.8, August, 2000 [Adobe PDF]

Steve Mann, "Guest Editor's Introduction, Wearable Computing: Towards Humanistic Intelligence ", IEEE Intelligent Systems Special Issue on Wearable Computing and Humanistic Intelligence, Vol 16, No.3, May/June, 2001 [Adobe PDF]

Steve Mann, "Existential Education ", Communications of the ACM , Vol 43, No.5, pp. 33-36, 2000 [Adobe PDF]

Steve Mann, "Comparametric Transforms for Transmitting EyeTap Video with Picture Transfer Protocol (PTP)", The Transform and Data Compression Handbook, Chapter 3, p.79, 2000

1999

Steve Mann, "Personal Imaging and Lookpainting as Tools for Personal Documentary and Investigative Photojournalism", ACM Mobile Networks and Applications, Vol. 4, Issue 1, March 1999 [Adobe PDF]

Steve Mann, James Fung, and Eric Moncrieff, "EyeTap Technology for Wireless Electronic News Gathering", ACM SIGMOBILE Mobile Computing and Communications Review, Vol. 3, No. 4, pp 19-26, October 1999 [HTML] [PDF]

1998

Steve Mann"Humanistic computing: 'WearComp' as a new framework and application for intelligent signal processing ", IEEE Proceedings of the IEEE, pp. 2123-2151, Vol. 86, Iss. 11, November, 1998 [Adobe PDF]

Steve Mann"Headmounted Wireless Video: Computer Supported Collaboration for Photojournalism and Everyday Use", IEEE Communications Magazine, pp. 144-151, Vol. 36, Iss. 6, June, 1998 [Adobe PDF][ Post Script Gzip]

Steve Mann "'Reflectionism' and 'Diffusionism': New Tactics for Deconstructing the Video Surveillance Superhighway", Leonardo, MIT Press, Vol. 31, Iss. 2, April, 1998 [HTML ] (Leonardo On-Line Featured Articles)

1997

Steve Mann and R.W. Picard "Video orbits of the projective group a simple approach to featureless estimation of parameters ", IEEE Transactions on Image Processing, pp. 1281 - 1295, Vol. 6, Iss. 9, 1997 [Adobe PDF]

Steve Mann and R.W. Picard "An historical account of the `WearComp' and `WearCam' inventions developed for applications in `Personal Imaging' ", IEEE Proceedings of the First International Conference on Wearable Computing, pp. 66 - 73, Cambridge, Massachusetts, October 13-14, 1997 1997 [HTML]

Steve Mann "Further developments on "HeadCam": joint estimation of camera rotation+gain group of transformations for wearable bi-foveated cameras" , IEEE Conference on Acoustics, Speech, and Signal Processing, pp. 2909- 2912, Vol. 4, April 1997 [Adobe PDF]

Steve Mann "Smart Clothing: Wearable Multimedia Computing and 'personal imaging' to Restore the Technological Balance Between People and Their Environments" ", Proceedings of the Fourth ACM International Conference on Multimedia, February 1997 [Adobe PDF]

Steve Mann "Eudaemonic Computing ("underwearables")" , IEEE International Symposium Wearable Computers (ISWC97), 1997 [Adobe PDF]

Steve Mann "Wearable Computing: A first step towards personal imaging " , IEEE Computer, pp. 25-32, Vol. 30, Iss. 2 Feb. 1997 [Adobe PDF][HTML]

Steve Mann "The Wearable Computer and WearCam" , ACM Personal Technologies, pp. 21-27, Vol. 1, Iss. 1, 1997 [HTML]

Steve Mann "On the Bandwagon or Beyond Wearable Computing" , ACM Personal Technologies, pp. 203-207, Vol. 1, Iss. 4, 1997

T. Starner, S. Mann, B. Rhodes, J. Levine, J. Healey, D. Kirsch, R. W. Picard, and A. Pentland "Augmented Reality through Wearable Computing" ", MIT Presence: Teleoperators, and Virtual Environments, pp. 386-398, Vol. 6, Iss. 4, 1997 [Adobe PDF]

Len Bass, Steve Mann, Dan Siewiorek, Chris Thompson, "Issues in Wearable Computing: a CHI 97 Workshop" ", ACM SIGCHI Bulletin, pp. 34-39, Vol. 29, Iss. 4, October, 1997[HTML]

Steve Mann,Editorial, Personal and Ubiquitous Computing, Vol. 1, Iss. 3, 1997

1996

Steve Mann "Smart Clothing: The Shift to Wearable Computing" ", Communications of the ACM, August 1996 [Adobe PDF]

Steve Mann "`Pencigraphy' with AGC: joint parameter estimation in both domain and range of functions in same orbit of the projective-Wyckoff group" ", IEEE International Conference on Image Processing,Vol.3, 16-19,pp.193-196 September 1996 [Adobe PDF][HTML]

1995
Steve Mann "Recording 'Lightspace' so shadows and highlights vary with varying viewing illumination ", Optics Letters, Vol. 20, Iss. 4, 1995 [Adobe PDF]

Steve Mann and Simon Haykin "The Chirplet' Transform", IEEE Transactions on Signal Processing, Vol. 43, Iss. 11, pp. 2745-2761, 1995 [HTML]

1994
Steve Mann "Wearable,Tetherless, Computer-Mediated Reality (with possible future applications to the disabled)" , Technical Reporti #260, M.I.T. Medial Lab Perceptual Computing SectionCambridge, Massachusetts, 1994 [HTML]

Steve Mann and R. W. Picard "Virtual bellows: constructing high-quality images from video.", In Proceedings of the IEEE First International Conference on Image ProcessingAustin, Texas, November 13-16, 1994 [Adobe PDF]

Steve Mann and R. W. Picard " Being `undigital' with digital cameras: Extending dynamic range by combining differently exposed pictures", In the Proceedings of the 46th Annual Imaging Science & Technology Conferencepp. 422-428, May 1995 also appears in Technical Report 323, MIT Media Lab Perceptual Computing SectionBoston, Massachusetts, 1994 [ Adobe PDF ]

Nassir Navab and Steve Mann "Recovery of Relative Affine Structure Using the Motion Flow Field of a Rigid Planar Patch", M.I.T. Media Laboratory Perceptual Computing Section Technical Report No. 310, Appeared in Proceedings of Mustererkennung 1994, 16. Symposium der DAGM, Vienna Austria, Tagungsband. Informatik Xpress 5, pp. 186-196 [Adobe PDF]

1993
Steve Mann "Compositing Multiple Pictures of the Same Scene", Proceedings of the 46th Annual Imaging Science & Technology Conference, May 9-14, Cambridge, Massachusetts, 1993

1992
Steve Mann and Simon Haykin "Adaptive 'Chirplet' Transform: an adaptive generalization of the wavelet transform", Optics Letters, Vol. 20, Iss. 4, 1995

Steve Mann "Doppler Danse", Leonardo, Vol. 25, Iss. 1, 1992

1991
Steve Mann "Doppler Den", Leonardo, Vol. 24, Iss. 4, 1991

Steve Mann, and Simon Haykin "The Chirplet Transform: A Generalization of Gabor's Logon Transform", Vision Interface '91 - Canadian Image Processing and Pattern Recognition Society, pp.205-212, June 3-7, Calgary, Alberta, 1991 [ HTML ]

Books

Click here to locate the first book at BARNES & NOBLE

This book presents, to the layperson, wearable, mobile, wireless computing and communication, and personal experiences of inventing, designing, building, and wearing computers for the past 20 years, as well as how these inventions affect society as a whole.

Click here to locate the second book at Wiley

This book teaches the fundamentals of wearable computing and mediated reality, the EyeTap principle, the mathematical theory, as well as the practical details of how to design and build these systems.
Some reviews of "CYBORG: Digital Destiny and Human Possibility in the Age of the Wearable Computer" (Randomhouse Doubleday) are now on the Amazon.com site.

CYBORG reviews (amazon.com)

but you can get a better price, and better service by actually ordering it from BARNES & NOBLE instead!

Third Party Articles

Croatian Articles

English Articles

French Articles

Italian Articles

Japanese Articles

Korean Articles