CS663 | computer vision
  • outline
  • projects
  • syllabus
  • links
Links

 

Other Textbooks

  • CV: algorithms and applications by R. Szeliski draft only
 

Software:

TensorFlow 2.0 API

  • tf.keras api - Keras built into Tensorflow API

 

 

OpenCV (C++/C)

  • documentation
  • PYTHON OpenCV Maing page      & indexed API   
  • JAVA: API For version 4.*      Java: API for version 3.* (version 2.9 -better documentation)
  • Android & OpenCV & downloading setup
  • tutorials
  • wiki
  • samples
  • For Android setup on AndroidStudio

 

  • For Java Option 1 OpenCV install for Eclipse (NOT DOING -using AndroidStudio)
      • For Java OLD Option 2 JavaCV (wraper for OpenCV use in Java. YES!!!!)
        • online book featuring use of Kinect sensor(via OpenNI SDK) and JavaCV too
    For Android setup on Eclipse (NOT DOING - using Android Studio)
      1. Go to the OpenCV download page on SourceForge and download the latest available version. Currently it’s OpenCV-2.**-android-sdk.zip. (Or get latest)
      2. Create a new folder for OpenCV for Android for example the C:\OpenCV4Android\ directory.
      3. Unpack the downloaded file from #1 ito the directory created in #2
      4. Start Eclipse
      5. Create a New library in Eclipse for the just downloaded Android OpenCV library and call it OpenCVAndroid (see above link for general OpenCV install for Eclipse to see example of doing this but for general java library not the android one...hence why I say to name it here OpenCVAndroid). Do not use the same name as your general OpenCV download you might have done previously for non-Android Apps.

  • For C# (w/Kinect): use EmguCV cross platform .NET wrapper
  • Various OpenCV and Android tutorials
      • http://www.slideshare.net/mobile/yyquest/open-pen-cv-android
      • http://www.slideshare.net/mobile/wingstonsharon/opencv-droidcon-2012
      • http://developer.sonymobile.com/knowledge-base/tutorials/android_tutorial/get-started-with-opencv-on-android/
      • https://web.stanford.edu/class/ee368/Android/Tutorial-2-OpenCV-for-Android-Setup-Linux-API8.pdf


ImageJ (Java by NIH)

  • wiki
  • API
  • programming with Image J
    • use the API and import ij.jar into your Java project and create your own stand alone project OR do a pluggin (see below)
    • basic tips
    • pluggin code development (uses the ImageJ.exe that comes with download--not a seperate stand alone program)
    • showing make a ImageJ pluggin (not separate stand along project)with Eclipse

MatLab

    lectures

     

 

Gimp - photo editing tool

Vision Code

JVT Homepage

Sift Feature Detector in C

Python overview with NumPy (useful for deeplearning Convolutional NN with Google's Tensorflow --main supported development language is Python)

Software IDEs

SEE current recommendations / requirements made by instructor based on project work we are doing
>>> this quarter if you are programming in Java you are to use Eclipse
>>> this quarter if you are programming in C++ for Kinect you are to use Microsoft Visual Studio
>>> if you are wanting to do some other combination you must get permission from instructor

  • Android Studio - must use this for Android mobile vision development.
  • Eclipse (use this only for Kinect with OpenNI)
  • Netbeans- recommended for all non-android development as has a good gui drag and drop interface for making general GUIs.(use this tool for all projects and non-android work -- unless you have instrctors permission to use something else).

 

SW Installation Tips

 

 

 

  • Microsoft Visual Studio (this is what we will use for Kinect with C++ development). See details from Richard Uhler about how to get this free for home use. This is the IDE used most commonly by the pre-req. courses in C/C++.

email msdnaa@csueastbay.edu and give the following:

  • name,
  • horizon email address
  • instructor name
  • software request (MS Visual Studio **** = check version number for compatability with what we have currently in our classroom).

FOLLOW instructions given to you...this may be a straight download or may be a multi-part process and currently involves burning image of software to DVD and then installing from that DVD

here is an example of me doing it in Jan 2012 ---it may change for you so YOU FOLLOW the current instrucitons.

 

 

 

Special Note for Mac Users

This software can not be installed on the Mac OS. You have a number of options listed here

  1. OPTION 1 FOR MAC: use the VM with the MS Visual Studio Software on it from the CSU Virtual Computing Lab that I have setup for you.
  2. OPTION 2 FOR MAC: install your own VM and then in it Windows *** Operating System (you can get this software the same way as you got the compiler from Microsoft --see above).
  3. OPTION 3 FOR MAC:
    setup Bootcamp (boot manager --so you can startup your Mac directly to toggle between running Mac as normal or Windows) on their Mac (Intel based machine), they can download Windows 7 (or current version) from the site where you downloaded MS Visual Studio 2010. Then install the MS Visual Studio 2010 on this install of Windows.
    Note --- this will not erase your Mac OS or its software...it is like have two computer OSs on one computer you can switch between.

JAVA

Java API Index (versoin 10) - search yourself for a different version

Various Code Samples (students please send me links of code you have found and like)

  • Invariant SIFT features (in C with Matlab) http://www.vlfeat.org/overview/sift.html
  • Berkley segmenation software (in C++) http://www.cs.berkeley.edu/~fowlkes/BSE/

General Sites

Computer Vision Homepage

Computer Vision Online

CV Companies, list 2, list 3

Ventures, Venture list 2 , Some CV Angellists

CV demos

 

 

CODELABS

 

 

Google GAE Python w/ Computer Vision API -face emotion (joy) detection web app

Journals/ Conferences / Lists:

Computer Vision and Image Understanding

Medical Imaging Conferences List

CVPR- computer vision and pattern recognition

 

(See ACM and IEE and SPIE for various conferences)

 

Computer Vision Meetups

local autonomous vechicle group

Lectures/Training/Sites

Applications

Breast Cancer Research

Noise Tutorial

 

 

 

Mobile Image Proc

 

 

  • with Androidprojects - Copy
  • panorama building
  • face recog. on mobile

Course on Math for Computer vision and robotics (for the brave!)

 

Papers on "biometrics" and vision --e.g. face recognition, iris detection, etc

  • Fusing Face and Iris detection(http://www.nd.edu/~kwb/ConnaughtonEtAl_2012.pdf)
  • Survey of Iris Detection (http://www.nd.edu/~kwb/BowyerEtAl_2012.pdf)
  • Predicting Gender from Irises (http://www.nd.edu/~kwb/ThomasChawlaBowyerFlynnBTAS_2007.pdf)
  • Tutorial on Iris Detection (http://www.cse.nd.edu/~kwb/HST_Iris_Tutorial.pdf)

Web Conferencing

On Blackboard - blackboard collaborate

 

 

Zoom -plugin for chrome and other browsers (currently --can change free 1- on -1 meetings)

Tools and more

Gimp (software has some cpabilities of adobe photoshop)

Data - here are a few "free" data sets --search the web for more.

http://cocodataset.org/#home" coco

•Example from COCO

 

 

•Image Net – 14 Million images, 21,841 sub-categories

http://image-net.org


 

•COCO – 100 objects, images= 200K labeled, 330K total

http://cocodataset.org

 

 

RGB-D People dataset

http://www2.informatik.uni-freiburg.de/~spinello/RGBD-dataset.html

3000 images from 3 Vertically mounted Kinect

 

 

Index of various public (smaller) datasets individuals have posted- https://dataturks.com/projects/Trending?type=IMAGE_CLASSIFICATION

 

•Person -rgb +depth (kinect) - 100 people, 100,000 images http://srl.informatik.uni-freiburg.de/human_attributes_dataset

 

MIcrosoft DataSets and more (most non-visual, a few images):

Realistic Scenes wide variety of objects and scenes (PASCAL)

Caltech 101 - images of objects in 101 categories

 

 

 

Activity / Action Data Sets (video or image sequences):

UCF101: 13320 videos from 101 action categories, https://www.crcv.ucf.edu/data/UCF101.php

 

 

 

HMDB: Human Motion Database: 7,000 clips distributed in 51 action classes. http://serre-lab.clps.brown.edu/resource/hmdb-a-large-human-motion-database/

 

 

Human Affectation (emotion+):

  • SEWA-video w/ audio of human responding with emotions, marked landmark points, etc.
  • SEMA dataset - video w/audio of person talking with an agent

Bias and Vision/ML Ethics

  •  interactive video leads the viewer through a series of psychological experiments in order to illustrate what unconscious bias is and why it matters for women in technology. Get your household together to watch the video, and talk about your responses to each experiment as you go along.

MISCELLANEOUS

 

1) stanford cnn vision recognition course

2) mobile vision class

2) OpenCV with Java and Android

3) Readings on Wearabable Computers

4) Beginning Computer vision course at stanford (they use matlab-yuck)

5) Stanford 3D recognition lectures class

6)- Learning OpenCV, by Gary Bradski & Adrian Kaehler, O'Reilly Media, 2008.

7) Udacity mini degree self-driving cars

cs663:computer vision

  • home
  • outline
  • projects
  • syllabus
  • links