Real-time Community Health Analytics

@daniel-ospina @noturhandle could there be opportunitiy for AN DAO data insights contributors to build/collaborate on this project through DAOOps bounty funding? cc @anukriti10

I ask because as @AlexClay referenced their s1 proposal includes the development of a community dashboard. Although it proposed a different focus (team KPI’s) - early stage AN DAO contributor participation 1) builds capability to advance outcomes of this proposal and 2) could support delivery of “…the stretch goal of real-time community health analytics…”

I think research always has its place within organizations, even more so if it aims to give insight into the situation of social layers. From my point of view, the results should be oriented slightly differently. I like the idea that the research goes to analyze the causes that might lead a contributor to participate in or possibly leave the Aragon DAO. I think this topic is related to people’s needs; these same needs can be diametrically different depending on the category of stakeholders to which one belongs. Research has a potential to meet the different actors within an organization by bringing out data that no single working group would be able to do individually (this partly answers the problem expressed by @fartunov in the sample bias post [On delivery]). I think the real added value of this research would be to ghater and analyze qualitative data allowing each stakeholders category to work with a better overall view of the system needs. There is a chronic need for mutual understanding, heaven more in decentrlaized organisation wich are facing huge challenges into creating and coordinate a shared vision wich everybody can relate to. I think this research would have the potential to bring the various point of view togheter, however the scope of this research sould be oriented slightly into this direction.

1 Like

Yeah of course. Collaboration is most welcomed

1 Like

Thank you @AcidCavin for sharing your views.

In our working definition, Community health includes onboarding and onboarding (or inflows and outflows). So we do plan to look into this to some degree. The idea is first to create the overview (overall framework) and then go into the specific verticals or subtopics.
The pulse survey and interactions data functionality paves the way for a lot of further research, so hopefully this is but the begining of what can be a whole area of study into DAOs and communities!

1 Like

Many thanks for the response @daniel-ospina there were a lot of questions there.

Personally I am happy as a group to participate in the risk. Do you also know who else you are requesting funds from at the moment?

Also happy to see the results are public, appreciate your insight on the venture side. As long as the results are public there should be not issue with this.

Thanks,

Alex

1 Like

Thank you for a very detailed response. However unfortunately it gives “it depends” answers to straightforward yes/no questions, so I will try to rephrase:

  • Is Aragon receiving a tool that can be meaningfully and easily used periodically, or a one-time assessment?

So the research will be focused on Aragon and up to two other DAOs (subject to approved funding)?

We rejected @Brian’s ESD funding request although different in topic, was very similar in terms of work required and somewhat more extensive and complete in deliverables on the basis of somewhat rich valuation for vague deliverables. Based on the same yardstick this one probably shouldn’t pass.

Based on your responses to @AlexClay and @AcidCavin it seems that @Fabs’s ESD funding request is again an example of “better bang for the buck” from the Network perspective with a similar focus. To clarify, based on your response, out of all stakeholder groups we are aware of, the focus here is on compensated DAO contributors?

The above being said the Network should also support the progression of the space as a whole, for example through the DAOstar proposal [funded] and the GitCoin matching pool [hopefully coming].
However, the response of whether we are funding public good or product development for rnDAO (not going to copy-paste as it’s unnecessarily wordy) falls flat on clarifying which one it is.

If the outcome is a useable public good functional tool available and free for anyone to use, build upon (rnDAO included obviously), and customize I think this would be an amazing proposal. All the “future research” hedging sounds like there are going to be one or more follow-up proposals “working towards that goal”.

The proposal is priced as an investment, presented as public good funding and the deliverables are a one-time assessment - there are some assumptions here that I tried to clarify but your response did not provide any additional clarity.

I have spent time in professional services and understand the business model - it’s a great one. Not sure a network with about 100 contributors (@Ricktik6 can provide the exact figure) should be paying $300 per contributor for assessing onboarding and offboarding experience, considering @Shawncubbedge is already doing strong work on the onboarding front.

For me, it’s a no-go in its current form.
Given the Network DAO design, it makes no sense for me to invest further time in this discussion. The team has enough voting power in its circle of influence to push this through. My role is to do my best effort in spending well the ESD budget. This is the Main DAO over which my influence is a rounding error even at current network participation levels.

3 Likes

Hi,

Congrats and thanks to the team for putting forward such a solid methodology and proposal. Regardless of the outcome here, wishing success and would like to follow the project.

This is not exactly ‘my area’ that I’m contributing to at Aragon (I work on product marketing), but I think it’s important to assess the proposals holistically in terms of where we are at and what our priorities are.

Not sure a network with about 100 contributors (@Ricktik6 can provide the exact figure) should be paying $300 per contributor for assessing onboarding and offboarding experience, considering @Shawncubbedge is already doing strong work on the onboarding front.

100% agree with this. It feels like over-analysis for our state, especially given that we already have community insights coming in (from the sources mentioned in previous posts).

Furthermore, my interpretation is that our community is not huge & will have ‘health conditions’, because we are at a stage of rebuilding the project and preparing to rally as a community around a new product. I imagine that a healthy community depends on people being able to contribute to advance the project, which for now is restricted a lot by the moment of the product. So therefore I have doubts as to how much the insights would turn into action (on our part), if in this phase they are restricted in action, and in the next phase, we’re looking at a different picture. (Like going to the best doctors in the world for assessment on cutting-edge machines for a health assessment, when you have a broken leg).

Considering the community size, the transitional moment we are in, and that there are already related insights on community health (mentioned in posts above), I wouldn’t support the proposal.

3 Likes

Thank you Harry for your feedback.
I’m sensing that we haven’t done a good enough job in explaining the power of ONA and the combination with other data sources.
A basic analysis of inflows/outflows or a questionnaire of why people join/leave could indeed be done for a much cheaper price. This proposal can help do those sorts of analyses ongoingly in the future, but that’s just the tip of the iceberg.
The thing that we really want to look into, and it requires research not just a bit of data analysis, is the broader possibilities of what can be done when we really understand network data. Facebook and other algorithms have used some insights in these domains to make people addicted to a platform (e.g. knowing who to connect you with when you’re likely to leave) but the same nights can be used in a more pro-social way.
Some underexplored applications in the corporate world have already enabled organisations to predict which teams would perform better by looking at the patterns of communication between team members. Equally to predict which teams are likely to lose team members and even predict who’s likely to leave. Or we could think about reputation weighted voting where the reputation model is adjusted dynamically based on survey and organisational data (which makes reputation ungameable).

If we can understand those patterns in DAOs, combine them with other sources of data, and then create nudges that serve both the users and the DAOs, this is a whole realm of future of work possibilities that opens up using AI, social system design, and blockchain technology.

So we can take an incrementalist view of let’s just solve the immediate issues that Aragon has, at which point probably it just makes sense to be one small product team, or take a more expansive/disruptive view of Aragon as a platform to transform and shape the future of work and invest in research initiatives that open new possibilities (and also have some impact on current priorities, but as mentioned, that’s the tip of the iceberg) :slight_smile:
Hope that makes sense

1 Like

Thanks for your reply @daniel-ospina, appreciate it. The power of ONA is clear from your description, thanks - I’m very interested in this topic.

Also not advocating for an incrementalist approach, but rather doing the expansive approach when the time is right for AN DAO. (If the time is right is open to peoples’ different views here! My view on that is in my first comment).

1 Like

Thanks @lee0007 for bringing me in in this conversation. I particularly appreciate in this proposal the fact that the questionnaire won’t be just a matter of closed-ended questions or variables to be assigned a numerical value (quantitative evaluation), but also open-ended questions in which participants themselves can take part in generating feedback and insight (qualitative). I am curious to understand how the tool works in practice, I see that pulse offers 14-day demo version, maybe it’s possible to start from there to do an evaluation.
As it was already mentioned, there are some privacy and tool management issues that will be generated as the tool is implemented but that I think would be useful to try to answer first, such as:

  • Who will be the repository of the data? Will the metrics and the results of the survey be open-access according to the transparency culture? Or will they be transmitted to a specific team?
  • How will the tool provide an assessment of an individual person’s burnout risk status without violating their privacy? Such a warning signal will be transmitted only to the person itself?
  • This for the Aragon community: how will a possible burnout situation be managed by the community? Are we going to create an internal welfare system?

On the financial and other technical evaluations made in comparison with previous proposals, I am not commenting both because it is not my area of expertise and because of my brief membership in this community. In general, I believe that tools are useful for making informed choices when used ethically. Also, I am always in favor of research and experimentation so I can only support initiatives that go in this direction. If it were possible, in my view the ideal is always to integrate different initiatives rather than exclude them from each other (“and” instead of “or” approach).

1 Like

Jumping in late on this = my apologies…

So on the one hand i agree - the tooling side of this probably is a ways off from useful… that said thank you @daniel-ospina for the introduction to katerinabc - i looked at her github repo and was heartened to see several projects related to cleaning up authorship issues in the research space = this is still unfortunately difficult (yay orcid) however points to the type of clarity and generally thoughtful approach I can support.

Literature reviews are an interesting space and as a librarian working in a hospital we specifically do literature reviews for best practices in health care as a service for clinicians and researchers. Increasingly tools like wikidata and wikicite are being leveraged to store, reference, and contextualize information and data sets.

My .02 is that we consider something like https://docs.openalex.org/ or wikidata in the deliverables because at some point for the literature review to be an actionable product it needs broad contextualization and also needs to be editable… the underlying research in this space is still being written and it should be anticipated that “shit may change”

anyhow - congrats on your bounty = i’ll look forward to seeing how you progress

1 Like

Congratulations on the Proposal passing. It is a shame we didn’t get the Transparency on the finance of the proposal or when the funds should be released, would be great if they can be clarified now. Especially when the funds should be released. Congratulations again

Thank you @AlexClay

I’m sorry to hear that the reply didn’t offer the clarity you hopped for.

Attempting another response here:

  • We’re asking other communities for the same ticket item as Aragon.
  • As the timeline suggests, the work starts immediately and in parallel streams (we started with the research since Monday already) so ideally we receive the funding as soon as possible.

I hope that clarifies but please don’t hesitate to ask if any questions remain

3 Likes

@alibama @Incandenza @AcidCavin @mroldann and everyone else who commented, thank you for your recommendations for the project!

We’re hoping to engage with the Aragon community throughout the project to facilitate learning and value creation for all the project stakeholders. The best approach we have identified for that relies on creating shared spaces for discussion and learning, where we can receive your perspectives and exchange ideas.

I’ve already shared your comments with our team, and if you’d be happy to answer any clarifying questions we might have or have anything else you’d like to share so we might best orient this initiative, we’ve created this telegram group:
Telegram: Join Group Chat

2 Likes

@noturhandle Can you add wallet address to the budget section of the original proposal please for ease of reference. Thank you

1 Like

Just updated.

1 Like

Presenting RnDAO’s paper on Community Health

Hi Aragon Community,

I am a part of RnDAO. I joined this project on Community Health just before it was approved by the Aragon community. I am happy to share the working paper, on behalf of the RnDAO team.

Let me provide a TLDR and overview of the paper first and the link further below

  • This document includes an overview of the background research, our proposed view of DAO community, our proposed definition of DAO Community health, and our approach to measuring community health

  • We based the definitions on well referenced scientific research across a broad range of topics

  • Our view on community and it’s health, in a nutshell

    • Community should be viewed as nested and interdependent systems. Therefore it should be measured at these 5 levels

      • Individual members
      • The relationships between individuals forming community specific participation structure
      • The sub-groups (formally created) and cliques (informally arising)
      • The overall community
      • The overall ecosystem in which the community is embedded
    • A community’s health is an aggregation of how these systems are

      • Individually operating
      • Interacting with other subsystems
      • Integrating with the community
    • Our definition of Community Health: “A DAO community’s health is the state of being, interaction, and integration of individuals and nested subsystems of the DAO Community as they work to achieve individual and collective goals.”

    • A community is considered healthy when it

      • Contributes to the needs of itself and its stakeholders
      • Is resilient, adaptable and has the capacity to transform to better fulfill the above needs
  • Measuring community health

    • Our measures can be viewed in 3 buckets

      • Engagement: Observable behavior of community members
      • Participation structure: The social fabric of interactions within the community
      • Sense of Community: Emotional interconnectedness between community members
    • Tools: We are proposing a mix of

      • Organizational Network Analysis with the data available for Aragon
      • Pulse surveys delivered in Discord
    • This approach requires minimal administrative effort from DAO community managers

    • The approach also requires low incremental effort by the community - no long surveys to be filled

    • The analysis can be real time and predictive, if required

  • Here is a link to the paper . Would invite everyone interested in community to read the paper (the summary does not do complete justice to it. The battle of brevity vs depth). And we’d love your feedback! (this is the first draft putting together a lot of work, but with the next steps of data collection and analysis and your feedback, we’ll improve it before publishing).

  • Current status

    • The working paper is ready, and are open to inputs from the community
    • Our Pulse survey tool has been developed
    • Our Organizational Network Analysis hypotheses are being tested on RnDAO data
    • If you have any feedback for us
      • Post in in this thread
      • Or even better, join our telegram group which has people from acros Web 3 space, who are interested in this project
  • Next steps

    • We will engage with the Aragon team to move to the measurement phase of our project
4 Likes

Liaising with the Community, Ops, and Data teams, we’ve received feedback that the community’s bandwidth is maxed atm with the proposal season and a survey that’s just been launched.
As such, we’re following the recommendation of postponing the beginning of the Implementation for 2 weeks, so as not to create survey fatigue.

5 Likes

Awesome, looking forward to learning from the work you all are doing on this and using that to make the community better.

2 Likes

Thanks @Shawncubbedge . Meanwhile if there is anything specific you’d want to know please drop one of us a DM. We will be glad to connect and share

1 Like