Funding Proposal: Daolist

That’s the part I am curious about if you want to expand on the rationale. To me your first point makes perfect sense, and actually because of the fact that the engineering resources should be focused on the product, managed hosting services might be a good path. While I am saying that, I am aware that in some specific cases it is better to manage those services internally, I am just not seeing this case here, yet.

Hey I just found this, that’s exactly what I have in mind: https://blog.slock.it/how-to-not-run-an-ethereum-archive-node-a-journey-d038b4da398b

At Scout, we started with Infura and quickly ran into limitations of how we can gather, aggregate and transform data. We consider having that flexibility significantly improves the core of our product. That’s why we ended up rolling out our own node structures.

For database, we use mongodb atlas which is a cloud based managed service. We’re more than happy to pay extra money for not worrying about managing, fine tuning, migrating and scaling our database servers.

I hope that’s helpful for evaluating your case.

1 Like

I see, thanks for clarifying!

I would think that the archive node is just that: an archive node. So the admin of that node just has to make sure there’s enough Storage / IOPS / CPU / Memory in order for the service to work properly for its users. Then a separate server would indeed gather, aggregate and transform data; for that specific (much) smaller server it makes sense for it to be dedicated to the project.

When it comes to your usage of Infura, their interests are not aligned with yours, so although they might try to help a bit, they will probably dedicate little resources to adjust their systems for your use case. In the case of having an “infura-like” infrastructure for the Aragon devs and projects, like SlockIt did / are doing, it would probably be quite different as Aragon has every incentive to maintain an archive-node that works well for the devs and projects relying on it.

I might be wrong but this seems worth clarifying to help token holders best spend the project’s funds.

Gustav,

It is beyond my knowledge to give suggestions on what approach you should take since I don’t have enough insights of what will or have been planned for Aragon.

If you are confident that there are enough upside to justify the risk+cost of building an Aragon infrastructure team upfront, having an “infura-like” infrastructure for the Aragon devs and projects makes sense. It is almost guaranteed that there will be overhead of maintaining, tuning and scaling that infrastructure no matter how simple it might appear at the beginning.

If you are not confident, probably best just wait and see whether there are enough demand as more projects are building on top of Aragon. By then, you would probably have more data points to make a solid decision.

From my personal experience (having founded and exited two venture backed startups), I have never made significant investment in the tech infrastructure in house until I know that

  1. We have a very clear product market fit
  2. We have a solid 18-24 months runway without revenue.
2 Likes

I thank you for the concern, I’ve tried to reply to the best of my ability :slight_smile:

Sure, but I am not running 6 nodes and I don’t have any particular need in running 6 nodes. I only need to run 1 for now, maybe one or two more if I want to be really sure nothing funky happens (like missed events). I just don’t need that now.

This is not how Daolist works now and this is not how Daolist is going to work. I’ve also stated in the funding proposal that I am going to run the code on a seperate server - the architecture Daolist uses now is scalable enough and does not use cronjobs.

I am certain I will upgrade it at some point, but for aggregation this happens as soon as the data comes in and is cached. This is why I’ve requested funding for a Redis instance, used for caching.

I am aware of this, but I am swallowing that cost myself.

I am not even counting the compensation for your time.

I am not searching compensation for my time.

Final note, I am not asking for the full amount needed to host Daolist. I am well aware that it might cost more and there will certainly be unforeseen expenses, but I am willing to pay for these myself. This proposal has never been about getting full funding for Daolist. It’s about getting funding for the most expensive parts, because I can’t take on the full cost myself, otherwise I would have done that.

I am aware that the setup I’ve described might not seem “scalable” or “production ready”, but I know what i am doing and I am sure that this is enough for now. If Daolist needs to scale even further and I all of a sudden have to run a lot more stuff, then that will be reflected in another funding proposal if needed.

Final note, I don’t think Scout and Daolist can be compared too much. Yes, both collect and transform data from the blockchain, but Scout has a lot more requirements in terms of scalability seeing that Scout is general purpose and needs to be able to manage more than 1 project. Daolist is exclusively collecting data on Aragon orgs and provides a bit more of an Aragon-centric experience.

2 Likes

My friend, that’s totally your call.

2 Likes

Thank you very much @huangkuan for taking the time to express your experience with this matter, that’s precious feedback.

The question for me is now whether or not Aragon should have an Ethereum archive node that would be shared among devs and sponsored projects. The cost of such node is high, higher if configured in a fault-tolerant way, and will also keep getting higher as the chain size increases.

Maybe @jorge / @luis want to weight in on this strategic aspect?

edit: I’d be curious to see how this would work out. I’m open to start an Ethereum archive node now and fund it for 3 to 6 months. Out of this I’d get to increase my DevOps skills and we get to experience with the model I suggested. However, if we clarify that it’s useless to eventually have an archive node shared within the org, it’s probably best that nobody waste time with this idea.

3 Likes

I like this proposal. I would vote yes on it. Good work on daolist so far @onbjerg and the redesign looks nice too :slight_smile:

4 Likes

I’m sure @jorge has an opinion on this

1 Like

I think that having an archive node synced and available for Flock and Nest teams could be valuable. For example, generating EVM Storage Proofs requires an archive node, and we have only been testing with the latest block (totally misses the point) or local development nodes because we didn’t have access to the node.

An archive node would also be helpful in case there is an issue that requires us to inspect the blockchain at a particular block height in order to debug.

The fact that daolist.io also needs it and Oliver is willing to set it up and maintain it, converts it into a win-win situation in my opinion.

Regarding daolist vs Scout I think they solve different problems and I use them both every day for different reasons. I would really love for both proposals to pass so these amazing services can keep improving!

4 Likes

I’m curious to know, what are the different reasons that you use them?

1 Like
  • Daolist I use when I just want to get the figure of deployed DAOs and checking the names of new DAOs. It is also what I always use to show how people are using Aragon.

  • Scout I use mainly for personal use a couple of times a week, to check usage stats that Daolist doesn’t currently have.

4 Likes

Bumping this in relationship to: How to make proposals to the Community Funding DAO

2 Likes

Hey! In light of recent conversations around the cryptoeconomics of on-chain voting, I’m very curious to measure the metrics that could affect Aragon on-chain voting. There’s lots of services that provide a lot of data (Etherscan, CoinMarketCap, Scout, etc…), but they take time to parse through and mentally digest. It would be great to have that info displayed all in one place in an easy to read dashboard. Having a shared community archive node would really help with this. Are you still pursuing building said archive node?

1 Like

@onbjerg I am getting a 404 on daolist.io, is this expected or accidental downtime?

I also got a 404 a few days ago. Just checked right now though and it’s working for me.

Hey @light and @burrrata,

I had some troubles paying the bill but the site is up now :slight_smile:

Might take a while for it to catch up.

Edit: In regards to the archive node @burrrata, I’d like to have one up and running but I am not able to pay for one myself at the moment, unfortunately.

3 Likes

If it got funded would you or @GustavMarwin want to set that up?

Also, regarding funding, would it make sense to start with a proposal to the Community Funding DAO, then once it’s running maybe formalize it into an AGP requesting sustainable long term funding?

3 Likes

I had one ready and rolling for @onbjerg and others but never heard from anyone so I shut it down and moved on to help on things were my help felt really necessary.

4 Likes

Maybe. I haven’t thought about long-term funding right now, to be completely transparent.

I’m sorry to hear that, I’ve been a bit off the grid for the past few months.

1 Like