View All Medium Spender
Requested:99.03K DOT
Executed

substrate-etl Retroactive funding: Q3+Q4 2022-Q1+Q2 2023

inMedium Spender
2 years ago
data
infrastructure
analytics
BeneficiaryBeneficiary:

(99.03K DOT)

substrate-etl is a large scale index of Polkadot + Kusama and their parachains based on Polkaholic.io, a multichain block explorer/indexer. Using this data warehouse, anyone can query decoded blocks, extrinsics, events, calls across both ecosystems.

We onboarded Polkadot Data into Google Public Datasets, announced in September 2023:

The substrate-etl index results in two large datasets (crypto_polkadot and crypto_kusama) covering the 2 relay chains and over 70 parachains. This represents Polkadot/Kusama alongside other Web3 ecosystems and supports complex large scale analyses with SQL using BigQuery's lightning-fast query performance on extremely large datasets. Having substrate-etl enables Dune-like analytics to guide business intelligence, inform engineering decision making, and showcase ecosystem growth.

Power users include Parity Data (led by Karim Jedda and Pavla Mijic), Subwallet/DotInsights, Web3metrics,
Dolpha.com, ChainViz and many data analysts within parachains and outside the ecosystem.

Quick Start

For a full guide, see substrate-etl, but you can get started with the following Analytics Hub links:

Roadmap

In addition to continuing support for substrate-etl/Polkaholic.io for existing and future chains, our plans for 2024 are to:

Proposal Details

Requested: 99,025 DOT

Proposal Details here

Proposal Costs here

About Colorful Notion

Colorful Notion is led by Sourabh Niyogi and Michael Chung, based in the SF Bay Area. We have been active in the Polkadot ecosystem over the last 2 years and look forward to building with others in CoreJam/Polkadot 2.0’s “map reduce” ubiquitous computing future.

We are grateful for everyone who has helped us and hope we can pay it forward by helping others

Comments (7)

2 years ago

Your web site seems so rough and why we need you, we already have Subscan.

2 years ago

Hi,

Thanks for the proposal, some questions below.

  1. Have you ever been funded by the W3F, and if so, could you please provide the details including any open/undelivered applications?
  2. Can you please provide the details of any treasury grants you received for this or related projects and the related referenda? Also related to this, how is the team related to Polkaholic?
  3. You have two more full-time people on your team as can be seen on your costs sheet, but the sheet only has initials. Can you provide their details? Also it would be great to get to get to know more about the web presence of all 4 team members.
  4. We're already in Q4'23. Why wasn't Q3 '23 included in the proposal? And you probably have an estimation for Q3&Q4 summed up. It would be good if you can share that too so we can have an overall up-to-date yearly cost.
  5. Can you provide the source code repository? I went through the documents, sorry if I missed it.
  6. I have previously tried and accessed the data sets on Google, and APIs on Polkaholics and found the XCM API quite useful. Yet the data sets on Google seemed to be quite limited in scope. Is there a documentation of the data sets and the extent of the data they store? For example, can one observe the change of the staked amount for a nominator over time?

Overall, although I find the direction useful, your costs seem to be exceeding 600K USD per year, even more if you have received other funding either from the treasury or the W3F, and I find this total very unconvincing for the product provided.

Thanks,
Kutsal | Helikon

PleaseLogin to comment

Proposal Passed

3

of 3

Summary

0%

Aye

AyeNay

0%

Nay

Aye (69)0.0 DOT

Support0.0 DOT

Nay (78)0.0 DOT

Comments (7)

2 years ago

Your web site seems so rough and why we need you, we already have Subscan.

2 years ago

Hi,

Thanks for the proposal, some questions below.

  1. Have you ever been funded by the W3F, and if so, could you please provide the details including any open/undelivered applications?
  2. Can you please provide the details of any treasury grants you received for this or related projects and the related referenda? Also related to this, how is the team related to Polkaholic?
  3. You have two more full-time people on your team as can be seen on your costs sheet, but the sheet only has initials. Can you provide their details? Also it would be great to get to get to know more about the web presence of all 4 team members.
  4. We're already in Q4'23. Why wasn't Q3 '23 included in the proposal? And you probably have an estimation for Q3&Q4 summed up. It would be good if you can share that too so we can have an overall up-to-date yearly cost.
  5. Can you provide the source code repository? I went through the documents, sorry if I missed it.
  6. I have previously tried and accessed the data sets on Google, and APIs on Polkaholics and found the XCM API quite useful. Yet the data sets on Google seemed to be quite limited in scope. Is there a documentation of the data sets and the extent of the data they store? For example, can one observe the change of the staked amount for a nominator over time?

Overall, although I find the direction useful, your costs seem to be exceeding 600K USD per year, even more if you have received other funding either from the treasury or the W3F, and I find this total very unconvincing for the product provided.

Thanks,
Kutsal | Helikon

PleaseLogin to comment
    Polkassembly - Referendum #248