Software crowdsourcing for developing Software-as-a-Service

Abstract

Recently software crowdsourcing has become a viable development paradigm for Software-as-a-Service (SaaS) ecosystems. TopCoder, one of the largest competitive programming communities, enables enterprises to tap into its global talent pool and crowdsource a variety of SaaS development tasks including requirement analysis, architecture design, code, and testing. Many researchers have proposed auction-based modelling methods to characterize general software crowdsourcing. But there are few papers on the comprehensive analysis of SaaS crowdsourcing process and developer community.

This paper introduces a holistic analysis framework to model the SaaS-oriented software crowdsourcing from two dimensions: individual behavior in crowdsourcing contests and collective competition in the community. The framework includes a game-theoretical model to describe the competitive nature of software crowdsourcing process. Moreover, the framework defines a competition network to characterize the topological properties of a crowdsourcing community for SaaS development. The analysis of this model indicates that the success of a competitive software crowdsourcing project essentially depends upon the networks of key participants with sufficient skills and dedication for the project. This is validated by a large historical data collected from the Top-Coder website over a ten-year period.

Keywords

SaaS / Software Crowdsourcing / TopCoder

References

[1] Tsai W T, Sun X, Balasooriya J. Service-oriented cloud computing architecture. In: Proceedings of the 7th IEEE International Conference on Information Technology: New Generations. 2010, 684―689

[2] Fisher S. The architecture of the apex platform, salesforce.com’s platform for building on-demand applications. In: Proceedings of the 29th International Conference on Software Engineering IEEE Computer Society, 2007

[3] Lakhani K R, Garvin D A, Eric Logstein E. TopCoder: Developing Software through Crowdsourcing. Harvard Business School Case 610-032, 2010

[4] Ramasubbu N, Cataldo M, Balan, R. K, Herbsleb J D. Configuring global software teams: a multi-company analysis of project productivity, quality, and profits. In: Proceedings of the 33rd ACM International Conference on Software Engineering. 2011, 261―270

[5] Šmite D, Wohlin C, Gorschek T, Feldt R. Empirical evidence in global software engineering: a systematic rreview. Empirical Software Engineering, 2010, 15(1): 91―118

[6] Scacchi W, Joseph F, Brian F, Scott H, Karim L. Understanding free/open source software development processes. Software Process: Improvement and Practice, 2006, 11(2): 95―105

[7] Crowston, K, Wei K, Howison J, Wiggins A. Free/Libre open-source software development: what we know and what we do not know. ACM Computing Surveys, 2012, 44(2): 7

[8] Archak N. Money glory and cheap talk: analyzing strategic behavior of contestants in simultaneous crowdsourcing contests on TopCoder.com. In: Proceedings of the 19th International Conference on World Wide Web, 2010

[9] DiPalantino D, Vojnovic M. Crowdsourcing and all-pay auctions. In: Proceedings of the 10th ACM Conference on Electronic Commerce. 2009

[10] Bacond D F, Chen Y, Parkes D, Rao M. A market-based approach to software evolution. In: Proceedings of the 24th ACM SIGPLAN Conference Companion on Object Oriented Programming Systems Languages and Applications. 2009

[11] Herbsleb J, MüllerBirn C, Towne W B. The vist a ecosystem: current status and future directions. Pittsburgh, PA: Institute for Software Research, 2010

[12] Tsai W T, Huang Y, Shao Q. EasySaaS: a SaaS development framework. IEEE International Conference on Service-oriented Computing and Applications, 2011: 1―4

[13] Tsai W T, Wu W, Huhns M N. Cloud-based software crowdsourcing. Internet Computing, IEEE, 2014, 18(3): 78―83

[14] Ye Y, Kishida K. Toward an understanding of the motivation of open source software developers. In: Proceedings of the 25th IEEE International Conference on Software Engineering. 2003, 419―429

[15] Mason W, Watts D J. Financial incentives and the performance of crowds. ACM SigKDD Explorations Newsletter, 2010, 11(2): 100―108

[16] Jsang A. The beta reputation system. In: Proceedings of the 15th Bled Electronic Commerce Conference on e-Reality: Constructing the e-Economy. 2002

[17] Wu W, Tsai W T, Li W. An evaluation framework for software crowdsourcing. Frontiers of Computer Science, 2013, 7(5): 694―709

[18] Gupta R, Pareek S. Developing applications with salesforce chatter. Packt Publishing Ltd, 2013

[19] Wargo J M. PhoneGap Essentials: Building Cross-Platform Mobile Apps. Addison-Wesley, 2012

[20] Corchón L C. The theory of contests: a survey. Review of Economic Design, 2007, 11(2): 69―100

[21] DiPalantino D, Karagiannis T, Milan V. Individual and collective user behavior in crowdsourcing services. Technical report, Microsoft Research, 2011

RIGHTS & PERMISSIONS

2014 Higher Education Press and Springer-Verlag Berlin Heidelberg