Crowd Science 2018 : Crowd Science @ HICSS 2018
Call For Papers
IT-mediated Crowds are being implemented for multifarious purposes, using multifarious techniques. In this minitrack we seek to coalesce a specific and enduring community of IS and IS-related researchers focused on the study of IT-mediated crowds as a phenomenon.
Our aim is to harness, and thus focus, the currently very broad inter-disciplinary study of IT-mediated Crowds within the IS discipline proper, to incite a sharing of results and a cross-pollination of ideas among researchers currently looking at IT-mediated Crowds from IS, I-School, HCI, Computer Science, Marketing, Education, Natural Sciences, Communication, and Technology Innovation perspectives.
In the purview of this mini-track, IT-mediated crowd phenomena include:
Crowd Finance (Crowdfunding, Blockchains, Digital Ledgers, etc)
Open Innovation/Competition platforms
Social Media for resource creation
Wikis & Wikipedia
Big Data from crowds
Participatory Sensing (Crowdsensing)
Spatial Crowdsourcing (the Sharing & Gig Economy)
Situated/Geo-fenced/IoT Crowdsourcing/VR crowds
IT-mediated Collective Intelligence
We encourage new empirical and theoretical submissions from social, economic, technical, and organizational scholars, investigating these phenomena in a variety of contexts, including:
Entrepreneurship/User Innovation/Creative Consumers
Institutional & Strategic perspectives
International Business & Development perspectives
Particular questions/topics of interest include:
Human computation, micro-tasking and virtual labour markets
Crowdsourced contests, their design and efficacy
Gamification in IT-mediated crowds
IT-mediated crowds and law/intellectual property
IT-mediated crowds for invention and commercialization
Business models of IT-mediated crowd companies and startups
The economics of IT-mediated crowds
The knowledge dynamics of IT-mediated crowds
IT-mediated crowds and 3D printing
Wearables & Sensors in, and as crowds
IT-mediated crowds and machine learning
The role of Bots/AI in IT-mediated crowds
Measuring IT-mediated crowds and outcomes
Formal models/computational models/simulations
IT-mediated crowd platforms
IT-mediated crowds & Common pool resources
Varieties of Crowd Capital
IT-mediated crowds and Industry/competitive dynamics
Crowd-labor movements and labor dynamics
Expert, non-expert, and mixed Crowds
Knowledge management in, and through, IT-mediated crowds
Double-sided markets/electronic markets/platforms
As track co-chairs, we endeavour to coalesce a set of compelling talks, provide developmental paper reviews, and special issues stemming from the track, focused on one or more of the areas mentioned here.
In the last two years, we’re delighted that we’ve been able to welcome eight substantial contributions to the Crowd Science program, which as a whole cross disciplinary boundaries, employ a variety of methodologies, and mark important new avenues in the field.
These contributions, as well as a bibliography of what we consider to be fundamental Crowd Science research, are listed below.
Papers are due June 15 2017. We look forward to your submission!
Lulea University of Technology
Afuah, A., & Tucci, C.L. (2012). Crowdsourcing as a solution to distant search. Academy of Management Review. 37(3), 355-375.
Aitamurto, T. (2016). Collective Intelligence in Law Reforms: When the Logic of the Crowds and the Logics of Policymaking Collide. In Proceedings of the Hawaii International Conference on System Sciences, vol. 49, pp. 5-8. 2016.
Archak, N., & Sundararajan, A. (2009). Optimal Design of Crowdsourcing Contests. In ICIS 2009 Proceedings.
Arrow, K.J, R. Forsythe, M. Gorham, R. Hahn, R. Hanson, J.O. Ledyard, S. Levmore, R. Litan, P. Milgrom, F.D. Nelson, G.R. Neumann, M. Ottaviani, T.C. Schelling, R.J. Shiller, V.L. Smith, E. Snowberg, C.R. Sunstein, P.C. Tetlock, P.E. Tetlock, H.R. Varian, J. Wolfers, & E. Zitzewitz. (2008). The promise of prediction markets. Science. 320(5878), 877-878.
Bayus, B.L. (2012). Crowdsourcing New Product Ideas over Time: An Analysis of the Dell IdeaStorm Community. Management Science. 59(1), 226-244.
Belleflamme, P., Lambert, T., & Schwienbacher, A. (2013). Crowdfunding: Tapping the right crowd. Journal of Business Venturing. 29(5), 585-609.
Bernstein, M.S., Brandt, J., Miller, R.C., & Karger, D.R. (2011). Crowds in two seconds: Enabling realtime crowd-powered interfaces. In Proceedings of the 24th annual ACM symposium on User interface software and technology (pp. 33-42). ACM.
Bernstein, M.S. (2013). Crowd-powered systems. Electrical Engineering and Computer Science. Cambridge, Massachusetts. Massachusetts Institute of Technology Ph.D. Dissertation.
Blohm, I., Bretschneider, U., Leimeister, J.M., & Krcmar, H. (2011). Does collaboration among participants lead to better ideas in IT-based idea competitions? An empirical investigation. International Journal of Networking and Virtual Organisations. 9(2), 106-122.
Bott, M., Gigler, B.-S., & Young, G. (2014). The Role of Crowdsourcing for Better Governance in Fragile State Contexts. International Bank for Reconstruction and Development/The World Bank.
Brabham, D.C. (2008). Crowdsourcing as a model for problem solving. Convergence. 14(1), 75-90.
Brabham, D.C. (2012). The Effectiveness of Crowdsourcing Public Participation in a Planning Context. First Monday. 17(12).
Brabham, D.C. (2013). Crowdsourcing. Cambridge, Massachusetts; London, England: The MIT Press.
Brabham, D.C. (2013). Using Crowdsourcing in Government. IBM Center for the Business of Government.
Burtch, G., Ghose, A., & Wattal, S. (2013). An empirical examination of the antecedents and consequences of contribution patterns in crowd-funded markets. Information Systems Research. 24(3), 499-519.
Chesbrough, H.W, (2003). Open Innovation: The new imperative for creating and profiting from technology. Boston: Harvard Business School Press.
Chua, R.Y.J., Roth, Y., & Lemoine, J.F. (2015). The Impact of Culture on Creativity How Cultural Tightness and Cultural Distance Affect Global Innovation Crowdsourcing Work. Administrative Science Quarterly. 60(2), 189-227
Crowston, K., & Prestopnik, N. (2013). Motivation and Data Quality in a Citizen Science Game: A Design Science Evaluation. In Proceedings of the 46th Annual Hawaii International Conference on System Sciences. IEEE Computer Society.
Cullina, E., Conboy, K. & Morgan, L. (2016). Choosing the Right Crowd: An Iterative Process for Crowd Specification in Crowdsourcing Initiatives. In System Sciences (HICSS), 2016 49th Hawaii International Conference on (pp. 4355-4364). IEEE.
De Vreede, T., Nguyen, C., De Vreede, G. J., Boughzala, I., Oh, O., & Reiter-Palmon, R. (2013). A Theoretical Model of User Engagement in Crowdsourcing. In Collaboration and Technology Lecture Notes in Computer Science Volume 8224 (pp. 94-109). Springer Berlin Heidelberg.
Difallah, D.E., Catasta, M., Demartini, G., Ipeirotis, P.G., & Cudré-Mauroux, P. (2015). The dynamics of micro-task crowdsourcing: The case of amazon mturk. In Proceedings of the 24th International Conference on World Wide Web (pp. 238-247). ACM.
Dron, J., & Anderson, T. (2014). Teaching Crowds: Learning and Social Media. Edmonton, AB:AU Press, Athabasca University.
Easley, D., & Kleinberg, J. (2010). Networks, crowds, and markets: Reasoning about a highly connected world. Cambridge University Press.
Gellers, J.C. (2016). Crowdsourcing global governance: sustainable development goals, civil society, and the pursuit of democratic legitimacy. International Environmental Agreements: Politics, Law and Economics. 16(3), 415-432.
Gerber, E. M., & Hui, J. (2013). Crowdfunding: Motivations and deterrents for participation. ACM Transactions on Computer-Human Interaction (TOCHI). 20(6), 34.
Gray, M.L., Suri, S., Ali, S.S., & Kulkarni, D. (2016). The crowd is a collaborative network. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (pp. 134-147). ACM.
Greenberg, J. & Mollick, E. (2016). Activist Choice Homophily and the Crowdfunding of Female Founders. Administrative Science Quarterly.
Hacker, S.B.H. (2014). Duolingo: Learning a Language while Translating the Web. Doctoral Dissertation. Carnegie Mellon University.
Hall, M., Mazarakis, A., Peters, I., Chorley, M., Caton, S., Mai, J.-E., & Strohmaier, M. (2016). Following User Pathways: Cross Platform and Mixed Methods Analysis. In CHI’16 Extended Abstracts. San Jose, USA: ACM Press.
Hayek, F.A. (1945). The Use of Knowledge in Society. The American Economic Review. 35(4), 519–530.
Haythornthwaite, C. (2009). Crowds and communities: Light and heavyweight models of peer production. In System Sciences, 2009. HICSS'09. 42nd Hawaii International Conference on (pp. 1-10). IEEE.
Hong, L., & Page, S.E. (2001). Problem solving by heterogeneous agents. Journal of economic theory. 97(1), 123-163.
Hong, L., & Page, S.E. (2004). Groups of diverse problem solvers can outperform groups of high-ability problem solvers. Proceedings of the National Academy of Sciences of the United States of America. 101(46), 16385-16389.
Ipeirotis, P.G., & Paritosh, P.K. (2011). Managing crowdsourced human computation: a tutorial. In Proceedings of the 20th international conference companion on World Wide Web. (pp. 287–288). ACM.
Jeppesen, L.B., & Lakhani, K.R. (2010). Marginality and Problem-Solving Effectiveness in Broadcast Search. Organization Science. 21(5), 1016-1033.
Kamar, E., S. Hacker, & E. Horvitz, (2012). Combining human and machine intelligence in large-scale crowdsourcing. In Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems. Volume 1 (pp. 467-474).
Kietzmann, J.H., K. Hermkens, I.P. McCarthy, & B.S. Silvestre, (2011). Social media? Get serious! Understanding the functional building blocks of social media. Business Horizons. 54(3), 241-251.
Kietzmann, J.H., Silvestre, B.S., McCarthy, I.P., & Pitt, L.F. (2012). Unpacking the social media phenomenon: towards a research agenda. Journal of Public Affairs. 12(2), 109-119.
Kietzmann, J., & Canhoto, A. (2013). Bittersweet! Understanding and managing electronic word of mouth. Journal of Public Affairs. 13(2), 146-159.
Kietzmann, J. & Prpić, J. (2016). Introduction to the Organizational Use of IT-Mediated Crowds Minitrack. 49th Hawaii International Conference on System Sciences (HICSS), Koloa, HI, USA, 2016, pp. 4354-4354.
Kietzmann, J., (2017). Crowdsourcing: A revised definition and introduction to new research, Business Horizons. Forthcoming.
King, A., & Lakhani, K.R. (2013). Using Open Innovation to Identify the Best Ideas. MIT Sloan Management Review. 55(1), 41-48.
Kingsley, S.C., Gray, M.L., & Suri, S. (2015). Accounting for market frictions and power asymmetries in online labor markets. Policy & Internet, 7(4), 383-400.
Krause, M., Hall, M., Williams, J.J., Paritosh, P., Prpić, J., & Caton, S. (2016). Connecting Online Work and Online Education at Scale. In CHI, Extended Abstracts on Human Factors in Computing Systems. pp. 3536– 3541. ACM.
Lakhani, K., & Panetta, J.A. (2007). The Principles of Distributed Innovation. Innovations: Technology, Governance, Globalization. 2(3), 97-112.
Landemore, H. (2014). Inclusive Constitution-Making: The Icelandic Experiment. Journal of Political Philosophy.
Lease, M., J. Hullman, J.P. Bigham, M. Bernstein, J. Kim, W. Lasecki, S. Bakhshi, T. Mitra, & R. C. Miller. (2013). Mechanical turk is not anonymous. Social Science Research Network.
Lee, J., & Seo, D. (2016). Crowdsourcing not all sourced by the crowd: An observation on the behavior of Wikipedia participants. Technovation. 55, 14-21.
Lee, D., (2013). Scientific Analysis by the Crowd: A System for Implicit Collaboration between Experts, Algorithms, and Novices in Distributed Work. Doctoral Thesis.
Lehdonvirta, V., & Bright, J. (2015). Crowdsourcing for Public Policy and Government. Policy & Internet, 7(3), 263-267.
Levy, P. (1997). Collective Intelligence: Mankind's Emerging World in Cyberspace. Perseus Books: Cambridge, MA, USA.
Li, S.W.D., & P. Mitros. (2015). Learnersourced recommendations for remediation. 2015 IEEE 15th International Conference on Advanced Learning Technologies (ICALT). pp. 411-412.
Lukyanenko., R., Jeffrey Parsons & Yolanda F. Wiersma (2014). The IQ of the Crowd: Understanding and Improving Information Quality in Structured User-Generated Content. Information Systems Research. 25:4, 669-689.
Majchrzak, A. (2006). Enabling customer-centricity using wikis and the wiki way. Journal of Management Information Systems. 23(3), 17-43.
Majchrzak, A., Wagner, C., & Yates, D. (2006). Corporate wiki users: results of a survey. In Proceedings of the 2006 international symposium on Wikis. ACM, 2006.
Majchrzak, A., & Malhotra, A. (2013). Towards an information systems perspective and research agenda on crowdsourcing for innovation. The Journal of Strategic Information Systems. 22(4), 257-268.
Malone, T. W., Laubacher, R., & Dellarocas, C. (2010). The collective intelligence genome. MIT Sloan Management Review, 51(3), 21.
Mamonov, S., Malaga, R., & Rosenblum, J. (2017). An Exploratory Analysis of Title II Crowdfunding Success. In Proceedings of the 50th Hawaii International Conference on System Sciences
Mergel, I. (2012). Distributed Democracy: Seeclickfix.com for Crowdsourced Issue Reporting. Social Science Research Network.
Mergel, I., & K.C. Desouza. (2013). Implementing Open Innovation in the Public Sector: The Case of Challenge. gov. Public Administration Review. 73(6), 882-90.
Mergel, I., S.I. Bretschneider, C. Louis, & J. Smith. (2014). The Challenges of Challenge.Gov: Adopting Private Sector Business Innovations in the Federal Government. In Proceedings of the 47th Hawaii International Conference on System Sciences. IEEE.
Michelucci, P. (2013). Synthesis and Taxonomy of Human Computation. In Handbook of Human Computation (pp. 83–86). Springer.
Michelucci, P., & Dickinson, J. L. (2016). The power of crowds. Science. 351(6268), 32-33.
Mitros, P. (2015). Learnersourcing of complex assessments. L@S ’15: Proceedings of the Second (2015) ACM Conference on Learning @ Scale. pp. 317-320.
Mitros, P., & F. Sun. (2014). Creating educational resources at scale. ICALT ’14: Proceedings of the 2014 IEEE 14th International Conference on Advanced Learning Technologies. pp. 16-18.
Mollick, E. (2014). The dynamics of crowdfunding: An exploratory study. Journal of business venturing. 29(1), 1-16.
Mollick, E., & Nanda, R. (2015). Wisdom or madness? Comparing crowds with expert evaluation in funding the arts. Management Science. 62(6), 1533-1553.
Mollick, E. & Robb, A. (2016). Democratizing Innovation and Capital Access. California management review. 58(2), 72-87.
Morschheuser, B., Hamari, J., & Koivisto, J. (2016). Gamification in crowdsourcing: a review. In 2016 49th Hawaii International Conference on System Sciences. IEEE.
Mortensen, J.M., M.A. Musen, & N.F. Noy. (2013). Crowdsourcing the verification of relationships in biomedical ontologies. AMIA Annual Symposium. pp. 1,020-1,029.
Morgan, J., & Wang, R. (2010). Tournaments for Ideas. California Management Review. 52(2), 77-97.
Mrass, V., Peters, C., & Leimeister, J.M. (2017). One for All? Managing External and Internal Crowds through a Single Platform-A Case Study. In Proceedings of the 50th Hawaii International Conference on System Sciences.
Nickerson, J.V. (2013). Crowd work and collective learning. In: A. Littlejohn and A. Margaryan (eds). Technology-enhanced professional learning: Processes, practices, and tools. New York: Routledge, pp. 39-49.
Noveck, B.S. (2009). Wiki-Government. How Technology Can Make Government Better, Democracy Stronger, and Citizens More Powerful. Washington, DC: Brookings Institution.
Piezunka, H., & Dahlander, L. (2015). Distant Search, Narrow Attention: How Crowding Alters Organizations’ Filtering of Suggestions in Crowdsourcing. Academy of Management Journal. 58(3), 856-880.
Piller, F.T., & Walcher, D. (2006). Toolkits for idea competitions: a novel method to integrate users in new product development. R&D Management. 36(3), 307-318.
Piscopo, A., Phethean, C., & Simperl, E. (2017). Wikidatians are Born: Paths to Full Participation in a Collaborative Structured Knowledge Base. In Proceedings of the 50th Hawaii International Conference on System Sciences
Prpić, J., (2015). Health Care Crowds: Collective Intelligence in Public Health. Collective Intelligence 2015. Center for the Study of Complex Systems, University of Michigan
Prpić, J. (2016). Next Generation Crowdsourcing for Collective Intelligence. Collective Intelligence Conference, 2016. Stern School of Business, NYU.
Prpić, J., & Shukla, P. (2013). The Theory of Crowd Capital. In Proceedings of the 46th Hawaii International Conference on Systems Sciences (pp. 3505–3514). Maui, Hawaii: IEEE Computer Society.
Prpić, J., & Shukla, P. (2014). The Contours of Crowd Capability. In Proceedings of the 47th Annual Hawaii International Conference on System Sciences (pp. 3461–3470). Big Island Hawaii: IEEE Computer Society.
Prpić, J., & Shukla, P. (2014). Crowd Capital in Governance Contexts. Oxford Internet Institute, University of Oxford - IPP 2014 - Crowdsourcing for Politics and Policy.
Prpić, J., & Shukla, P. (2016). Crowd Science: Models, Measurements, and Methods. Proceedings of the 49th Annual Hawaii International Conference on System Sciences, Big Island Hawaii, January 6-9, Computer Society Press, 2016.
Prpić, J., Jackson, P., & Nguyen, T. (2014). A Computational Model of Crowds for Collective Intelligence. Collective Intelligence 2014. MIT Center for Collective Intelligence.
Prpić, J., Taeihagh, A., & Melton, J. (2014). Crowdsourcing the Policy Cycle. Collective Intelligence 2014, MIT Center for Collective Intelligence.
Prpić, J., Taeihagh, A., & Melton, J. (2014). Experiments on Crowdsourcing Policy Assessment. Oxford Internet Institute, University of Oxford - IPP 2014 - Crowdsourcing for Politics and Policy.
Prpić, J., Taeihagh, A., & Melton, J. (2015). The Fundamentals of Policy Crowdsourcing. Policy & Internet. 7(3).
Prpić, J., Melton, J., Taeihagh, A., & Anderson, T. (2015). MOOCs and Crowdsourcing: Massive Courses and Massive Resources with Crowds. First Monday.20(12).
Prpić, J., Shukla, P., Roth, Y., & Lemoine, J.-F. (2014). Is the World Flat? Unpacking the Geography of Crowd Capital. 12th Annual Open and User Innovation Conference, Harvard Business School. Boston.
Prpić, J., Shukla, P., Roth, Y., & Lemoine, J.F. (2015). A Geography of Participation in IT-Mediated Crowds. Proceedings of the 48th Annual Hawaii International Conference on System Sciences, Kauai, Hawaii, January 5-8, Computer Society Press, 2015.
Prpić, J., Shukla, P., Kietzmann, J., & McCarthy, I. (2015). How to Work a Crowd: Developing Crowd Capital through Crowdsourcing. Business Horizons. 8(1), 77-85.
Prpić, J., & Kietzmann, J., 2017. Crowd Science: Research on IT-Mediated Crowds-Mini-Track Overview. 50th Hawaii International Conference on System Sciences (HICSS), Big Island, HI, USA, 2017.
Retelny, Daniela, Sébastien Robaszkiewicz, Alexandra To, Walter S. Lasecki, Jay Patel, Negar Rahmati, Tulsee Doshi, Melissa Valentine, and Michael S. Bernstein. "Expert crowdsourcing with flash teams." In Proceedings of the 27th annual ACM symposium on User interface software and technology, pp. 75-85. ACM, 2014.
Robson, K., Plangger, K., Kietzmann, J. H., McCarthy, I., & Pitt, L. (2015). Is it all a game? Understanding the principles of gamification. Business Horizons. 58(4), 411-420.
Robson, K., Plangger, K., Kietzmann, J. H., McCarthy, I., & Pitt, L. (2016). Game on: Engaging customers and employees through gamification. Business Horizons. 59(1), 29-36.
Rothschild, D. & Sethi, R. (2016). Trading strategies and market microstructure: Evidence from a prediction market. Journal of Prediction Markets. 10(1), 29.
Simons, A., Weinmann, M., Tietz, M., & vom Brocke, J. (2017). Which Reward Should I Choose? Preliminary Evidence for the Middle-Option Bias in Reward-Based Crowdfunding. In Proceedings of the 50th Hawaii International Conference on System Sciences.
Von Ahn, L., Maurer, B., McMillen, C., Abraham, D., & Blum, M. (2008). reCAPTCHA: Human-based character recognition via web security measures. Science. 321(5895), 1465-1468.
Von Hippel, E. (2005a). Democratizing Innovation. Cambridge, M.A.: The MIT Press.
Von Hippel, E. (2005b). Open source software projects as user innovation networks - no manufacturer required, In Perspectives on Free and Open Source Software, edited by J. Feller, B. Fitzgerald, S. Hissam, and K. Lakhani. Cambridge: MIT Press.
Wexler, M.N. (2011). Reconfiguring the sociology of the crowd: exploring crowdsourcing. International Journal of Sociology and Social Policy. 31(1/2), 6-20.
Wiggins, A., & K. Crowston. (2015). Surveying the citizen science landscape. First Monday. 20(1).
Wilkinson, D.M., & Huberman, B.A. (2007). Cooperation and quality in wikipedia. In Proceedings of the 2007 international symposium on Wikis. (pp. 157-164). ACM.
Wolfson, S.M., & Lease, M. (2011). Look before you leap: legal pitfalls of crowdsourcing. Proceedings of the American Society for Information Science and Technology. 48(1), 1-10.
Yang, H.L., & Cheng, Y.L. (2010). Motivations of Wikipedia content contributors. Computers in Human Behavior. 26(6), 1377-1383.
Ye, H. J., & Kankanhalli, A. (2015). Investigating the antecedents of organizational task crowdsourcing. Information & Management. 52(1), 98-110.
Yoo, Y., R.J., Boland, Jr., K., Lyytinen, & A., Majchrzak. (2012). Organizing for innovation in the digitized world. Organization Science. 23(5), 1398-1408.