This project (NSF 16-18444) involves development of theory and tools to improve the coordination of distributed teams, i.e., groups of geographically-dispersed individuals working together over time towards a common goal. The separation of distributed work generally makes it harder for team members to work together effectively. However, when work products are shared via a computer system, team participants can see the work produced by remote colleagues as easily as from those who are local, and the work can provide information to support team coordination. Specifically, prior research suggests that free/libre open source software (FLOSS) developers use the software code they are developing as a basis for coordinating their work, a phenomenon known as stigmergic coordination. Stigmergic coordination can be more effective and efficient than coordination through explicit discussion, so there could be benefits if it can be used more broadly. The goal of the project is to study FLOSS developers to understand how stigmergic coordination works and to develop a system to enable its use in other settings. To achieve these goals, a two-phase study is underway: first identifying the socio-technical affordance enabling stigmergic coordination in FLOSS development teams (as exemplars of distributed teams) and similar settings, and second, testing the emerging theoretical understanding by implementing and assessing a system to support stigmergic coordination of distributed work in a new domain. The study has several expected intellectual contributions. First, the empirical study should provide evidence for (or possibly against) stigmergic coordination as a mode of coordination in distributed work. As well, the study will identify possible negative outcomes from the use of stigmergy. More importantly, the study will identify socio-technical affordances that enable the use of stigmergy. A preliminary analysis has been done based on a literature review. Knowing these affordances will provide a basis for designing shared-work systems that support stigmergy. They will also help in understanding the possibilities and limits on the transfer of coordination mechanisms from open content creation teams to other domains. The study will have several broader impacts. First, being able to implement a novel mode of coordination could be transformative for the conduct of online work and computer-supported work more generally. Second, if it seems that reliance on stigmergy is off-putting for certain potential group participants (women in particular), then the project can study how that happens and potentially mitigate the huge gender gap currently observed in FLOSS development participation in particular and in online groups more generally. The software system to be developed will be released as open source for use in future research (thus contributing to the infrastructure for research) and potentially for use by distributed workers (thus potentially benefiting society). You can see papers related to this project here and the proposal below.
Attachment | Size |
---|---|
proposal.pdf | 269.77 KB |
<p>Prior research on Wikipedia has noted the importance of both explicit coordination of edits (i.e., through the article Talk page) and stigmergic coordination (i.e., through the article itself). Using a panel data set of article quality and edits for 23 articles over time, we examine the impact of different kinds of edits on article quality. We find that stigmergically-coordinated edits seem to have the biggest effect on quality, but that explicit coordination of major edits also predicts article quality. The findings have implications for both research on coordination inWikipedia and for supporting editors.</p>
<p>Data science teams working on a shared analysis face coordination problems such as dividing up the work to be done, monitoring performance and integrating the pieces. Research on distributed software development teams has raised the potential of stigmergic coordination, that is, coordination through a shared work product in place of explicit communication. The MIDST system was developed to support stigmergic coordination by making individual contributions to a shared work product visible, legible and combinable. In this paper, we present initial studies of a total of 40 student teams (24 using MIDST) that shows that teams that used MIDST did experience the intended system affordances to support their work, did seem to coordinate at least in part stigmergically and performed better on an assigned project.</p>
<p>This paper explores the skills needed to be a data scientist. Specifically, we report on a mixed method study of a project-based data science class, where we evaluated student effectiveness with respect to dividing a project into appropriately sized modular tasks, which we termed task modularity. Our results suggest that while data science students can appreciate the value of task modularity, they struggle to achieve effective task modularity. As a first step, based our study, we identified six task decomposition best practices. However, these best practices do not fully address this gap of how to enable data science students to effectively use task modularity. We note that while computer science/information system programs typically teach modularity (e.g., the decomposition process and abstraction), and there remains a need identify a corresponding model to that used for computer science / information system students, to teach modularity to data science students.</p>
<p>We apply two theoretical frameworks to analyze spell-checkers as a form of automation and apply the lessons learned to analyze opportunities to support data science. The analysis distinguishes between automation of analysis to suggest actions and automation of implementation of actions. Having the automation work in the same space as users (e.g., editing the same document) supports stigmergic coordination between the two, but attention is needed to ensure that the contributions can be combined and have a recognizable form that indicates their purpose.</p>
<p>With the increasing ability to generate actionable insight from data, the field of data science has seen significant growth. As more teams develop data science solutions, the analytical code they develop will need to be enhanced in the future, by an existing or a new team member. Thus, the importance of being able to easily maintain and enhance the code required for an analysis will increase. However, to date, there has been minimal research on the maintainability of an analysis done by a data science team. To help address this gap, data science maintainability was explored by (1) creating a data science maintainability model, (2) creating a new tool, called MIDST (Modular Interactive Data Science Tool), that aims to improve data science maintainability, and then (3) conducting a mixed method experiment to evaluate MIDST. The new tool aims to improve the ability of a team member to update and rerun an existing data science analysis by providing a visual data flow view of the analysis within an integrated code and computational environment. Via an analysis of the quantitative and qualitative survey results, the experiment found that MIDST does help improve the maintainability of an analysis. Thus, this research demonstrates the importance of enhanced tools to help improve the maintainability of data science projects.</p>
<p>We examine a novel approach to coordination, namely stigmergic coordination, that is, coordination mediated by changes to a shared work product. Stigmergy stands in contrast to the two coordination approaches identified in the existing literature on coordination, explicit coordination, based on direct communication through discussion page or user talk pages, and implicit coordination, based on unspoken expectations and shared mental models of the task to be accomplished. We look for evidence of stigmergic coordination in the context of Wikipedia, as one of the most successful experiments in online collaborative knowledge building. Using a novel approach to identifying edits to the same part of a Wikipedia article, we show that a majority of edits to two example articles are not associated with discussion on the article Talk page, suggesting the possibility of stigmergic coordination. However, some amount of discussion does seem to be related to article quality, suggesting the limits to this approach to coordination.</p>
<p>Coordination in software development teams has been a topic of perennial interest in empirical software engineering research. The vast majority of this literature has drawn on a conceptual separation between work and coordination mechanisms, separate from the work itself, which enable groups to achieve coordination. Traditional recommendations and software methods focused on planning: using analysis to predict and manage dependencies. Empirical research has demonstrated the limits of this approach, showing that many important dependencies are emergent and pointing to the persistent importance of explicit discussion to managing these dependencies as they arise. Drawing on work in Computer-Supported Collaborative Work and building from an analogy to collaboration amongst insects (stigmergy), we argue that the work product itself plays an under-appreciated role in helping software developers manage dependencies as they arise. This short paper presents the conceptual argument with empirical illustrations and explains why this mechanism would have significant implications for Software Engineering coordination research. We discuss issues in marshaling clear positive evidence, arguing that these issues are responsible, in part, for the under-consideration of this mechanism in software engineering and outlining research strategies which may overcome these issues.</p>
<p>When work products are shared via a computer system, members of distributed teams can see the work products produced by remote colleagues as easily as those from local colleagues. Drawing on coordination theory and work in computer-supported cooperative work (CSCW), we theorize that these work products can provide information to support team coordination, that is, that work can be coordinated through the outcome of the work itself, a mode of coordination analogous to the biological process of stigmergy. Based on studies of documents and work, we postulate three features of work products that enable them to support team coordination, namely having a clear genre, being visible and mobile, and being combinable. These claims are illustrated with examples drawn from free/libre open source software development teams. We conclude by discussing how the proposed theory might be empirically tested.</p>
<p>We present a conceptual framework for socio-technical affordances for stigmergic coordination, that is, coordination supported by a shared work product. Based on research on free/libre open source software development, we theorize that stigmergic coordination depends on three sets of socio-technical affordances: the visibility and combinability of the work, along with defined genres of work contributions. As a demonstration of the utility of the developed framework, we use it as the basis for the design and implementation of a system, MIDST, that supports these affordances and that we thus expect to support stigmergic coordination. We describe an initial assessment of the impact of the tool on the work of project teams of three to six data-science students that suggests that the tool was useful but also in need of further development. We conclude with plans for future research and an assessment of theory-driven system design.</p>