• Login
    View Item 
    •   Home
    • Doctoral Degree Granting Institutions
    • SUNY Polytechnic Institute
    • SUNY Polytechnic Institute Faculty Publications
    • View Item
    •   Home
    • Doctoral Degree Granting Institutions
    • SUNY Polytechnic Institute
    • SUNY Polytechnic Institute Faculty Publications
    • View Item
    JavaScript is disabled for your browser. Some features of this site may not work without it.

    Browse

    All of SUNY Open Access RepositoryCommunitiesPublication DateAuthorsTitlesSubjectsDepartmentThis CollectionPublication DateAuthorsTitlesSubjectsDepartmentAuthor ProfilesView

    My Account

    LoginRegister

    Campus Communities in SOAR

    Alfred State CollegeBrockportBroomeCantonDownstateDutchessEmpireFarmingdaleFinger LakesFredoniaHerkimerMaritimeNew PaltzNiagaraOld WestburyOneontaOnondagaOptometryOswegoPlattsburghPurchase CollegePolytechnic InstituteSUNY Office of Workforce Development and Upward MobilitySUNY PressUpstate Medical

    Statistics

    Most Popular ItemsStatistics by CountryMost Popular Authors

    Crowdsourcing Image Extraction and Annotation: Software Development and Case Study

    • CSV
    • RefMan
    • EndNote
    • BibTex
    • RefWorks
    Average rating
     
       votes
    Cast your vote
    You can rate an item by clicking the amount of stars they wish to award to this item. When enough users have cast their vote on this item, the average rating will also be shown.
    Star rating
     
    Your vote was cast
    Thank you for your feedback
    Author
    Jofre, Ana
    Berardi, Vincent
    Brennan, Kathleen P.J.
    Cornejo, Aisha
    Bennett, Carl
    Harlan, John
    Keyword
    Crowdsourcing
    Image extraction and annotation
    Crowdsourcing software
    Time Magazine
    Data verification methodology
    Amazon Mechanical Turk (AMT)
    Journal title
    Digital Humanities Quarterly
    Date Published
    2020-03
    
    Metadata
    Show full item record
    URI
    http://www.digitalhumanities.org/dhq/vol/14/2/000469/000469.html; http://hdl.handle.net/20.500.12648/7156
    Abstract
    We describe the development of web-based software that facilitates large-scale, crowdsourced image extraction and annotation within image-heavy corpora that are of interest to the digital humanities. An application of this software is then detailed and evaluated through a case study where it was deployed within Amazon Mechanical Turk to extract and annotate faces from the archives of Time magazine. Annotation labels included categories such as age, gender, and race that were subsequently used to train machine learning models. The systemization of our crowdsourced data collection and worker quality verification procedures are detailed within this case study. We outline a data verification methodology that used validation images and required only two annotations per image to produce high-fidelity data that has comparable results to methods using five annotations per image. Finally, we provide instructions for customizing our software to meet the needs for other studies, with the goal of offering this resource to researchers undertaking the analysis of objects within other image-heavy archives.
    Citation
    Jofre, Ana, Vincent Berardi, Kathleen P.J. Brennan, Aisha Cornejo, Carl Bennett, and John Harlan. 2020. “Crowdsourcing Image Extraction and Annotation: Software Development and Case Study.” Digital Humanities Quarterly 14 (2). http://www.digitalhumanities.org/dhq/vol/14/2/000469/000469.html.
    Collections
    SUNY Polytechnic Institute Faculty Publications

    entitlement

     

    DSpace software (copyright © 2002 - 2025)  DuraSpace
    Quick Guide | Contact Us
    Open Repository is a service operated by 
    Atmire NV
     

    Export search results

    The export option will allow you to export the current search results of the entered query to a file. Different formats are available for download. To export the items, click on the button corresponding with the preferred download format.

    By default, clicking on the export buttons will result in a download of the allowed maximum amount of items.

    To select a subset of the search results, click "Selective Export" button and make a selection of the items you want to export. The amount of items that can be exported at once is similarly restricted as the full export.

    After making a selection, click one of the export format buttons. The amount of items that will be exported is indicated in the bubble next to export format.