SignStream

SignStream® version 3 !*

A new Java version of SignStream® is now available !

screen shot

System requirements: Mac OS 10.8 or higher, using at least Java 1.6

Video codecs that work with the application; if your video is in a different format, you should first convert it to one of these:

Download the program

Click here for license information

User guide: ASLLRP Report No. 15  Neidle, C. [2017]: A User's Guide to SignStream® 3
[pdf - 24 MB]

Credits:

Gregory Dimitriadis Application Developer at Rutgers University (July 2015 - present)
Douglas Motto Application Developer Supervisor at Rutgers University (February 2016 - present)
Augustine Opoku Application Developer Supervisor at Rutgers University (July 2015 - January 2016)

Thanks also to:

 

 

Jason Boyd, George Kierstein, Robert G. Lee, Joan Nash, John Olson, Stan Sclaroff, Ashwin Thangali, Christian Vogler, and Iryna Zhuravlova, for prior contributions to design and implementation; and to our linguistic consultants and to all those at BU and Gallaudet University who have used versions of the program, provided feedback and suggestions, and shared their expertise !
Partial list: :  Justin Arrigo, Aimee Aylward, Ben Bahan, Cory Behm, Joshua Beckman, Rachel Benedict, Naomi Berlove Caselli, Elizabeth Cassidy, Lana Cook, Jaimee DiMarco, Daniel Ferro, Amanda Gaber, Graham Grail, Chelsea Hammond, Ryan Hevia, Reema Kharoufa, Kelsey Koenigs, Alix Kraminitz, Corbin Kuntze, Yulia Labkovsky, Carly Levine, Rebecca Lopez, Jonathan McMillan, Indya-Loreal Oliver, Caelan Pacelli, Braden Painter, Chrisann Papera, Emma Preston, Donna Riggle, Tyler Richard, Tory Sampson, Dana Schlang, Michael Schlang, Jessica Scott, Jonathan Suen, Norma Bowers Tourangeau, Blaze Travis, Amelia Wisniewski-Barker, Jennifer Witteborg, Norman Williams, Isabel Zehner

We also gratefully acknowledge:

 

contributions and assistance from the developers of the ASLLRP Data Access Interface (DAI, DAI 2), Christian Vogler and Augustine Opoku

support provided at Rutgers University by Dimitris Metaxas, Charles Hedrick, Charles McGrew, Hanz Makmur

support provided at Boston University by Stan Sclaroff, Ashwin Thangali, Vassilis Athitsos

support provided at Gallaudet University by Christian Vogler, Ben Bahan

those who contributed to development of prior versions of SignStream: David Greenfield (developer of versions through 2.2.2), Otmar Foeslche (developer supervisor), Ben Bahan, Judy Kegl, Robert G. Lee, Dawn MacLaughlin

Carol Neidle Project Director

 

*Development of SignStream®, our linguistically annotated corpora, and of our Data Access Interface (DAI and DAI 2), has been partially funded by grants from the National Science Foundation (NSF), including:

“Collaborative Research: CI-ADDO-EN: Development of Publicly Available, Easily Searchable, Linguistically Analyzed, Video Corpora for Sign Language and Gesture Research.” [#1059218, C. Neidle, S. Sclaroff; #1059281, D. Metaxas; #1059221, B. Bahan, C. Vogler; # 1059235, V. Athitsos]
“HCC: Large Lexicon Gesture Representation, Recognition, and Retrieval”
[#0705749, S. Sclaroff, C. Neidle]
“SignStream: A Multimedia Tool for Language Research.” [#9528985, C. Neidle]

 

Illustration of annotation of a dialog, with two signers producing overlapping utterances. (Click for larger view.) Illustration of new Sign Bank functionality, enabling the annotator to search, from within SignStream, for gloss labels from a repertoire of about 3,000 signs. If the desired sign is found, the sign's properties can be entered automatically into the annotation.
(Click for larger view.)

 


See also our online corpora:

The Data Access Interface (DAI) <http://secrets.rutgers.edu/dai/queryPages/> allows browsing, search, and download of ASL video data (linguistically annotated through use of SignStream®), for (a) the National Center for Sign Language and Gesture Resources (NCSLGR) corpus; and (b) ~10,000 examples (almost 3,000 distinct signs) in citation form, as part of the American Sign Language Lexicon Video Dataset (ASLLVD), which forms the basis for the initial ASLLRP Sign Bank (see above). [See Carol Neidle and Christian Vogler, A New Web Interface to Facilitate Access to Corpora: Development of the ASLLRP Data Access Interface, 5th Workshop on the Representation and Processing of Sign Languages: Interactions between Corpus and Lexicon, LREC 2012, Istanbul, Turkey, May 27, 2012.]

A new Beta version of our Data Access Interface, DAI 2, to faciliate, browsing, search, and download of data from our expanding corpora, annotated through use of SignStream® 3 (with more detailed morpho-phonological information than in previous datasets) is now available! For details, see http://www.bu.edu/asllrp/about-dai2.html. This interface currently allows access to 12 collections from our new ASLLRP SignStream® 3 Corpus, with a total of 275 utterances from 2 different signers (just over 2,000 signed examples corresponding to just over 500 distinct sign/variants). Additional data from this corpus will be released in the next few months, as soon as verifications are complete. Here is an illustration of search results for (1) the sign glossed as "ALWAYS" (on top), and (2) negation (partial) in DAI 2:


The DAI 2 also provides access to our new ASLLRP Sign Bank !

Return to the American Sign Language Linguistic Research Project