From 78dba0b527c6bd621029379496d7114e81ee4822 Mon Sep 17 00:00:00 2001 From: RogerLe Date: Mon, 25 Nov 2024 23:04:48 +0800 Subject: [PATCH 01/15] add queryweb3 --- applications/queryWeb3.md | 280 ++++++++++++++++++++++++++++++++++++++ 1 file changed, 280 insertions(+) create mode 100644 applications/queryWeb3.md diff --git a/applications/queryWeb3.md b/applications/queryWeb3.md new file mode 100644 index 00000000000..19687d5456d --- /dev/null +++ b/applications/queryWeb3.md @@ -0,0 +1,280 @@ +# QueryWeb3 + +- **Team Name:** QueryWeb3 +- **Payment Details:** + - **DOT**: 15SXUVLizxWtMpYx7eambqqH9Bi942WZdT4wDH89GTXfkeso + - **Payment**: 15SXUVLizxWtMpYx7eambqqH9Bi942WZdT4wDH89GTXfkeso , Currency ( USDT) +- **[Level](https://github.com/w3f/Grants-Program/tree/master#level_slider-levels):** 2 + +## Project Overview :page_facing_up: + +- **Tagline**: The most valuable BI and efficient AI-powered information service platform in the Polkadot ecosystem. +- **Brief Description**: QueryWeb3 aims to address the fragmentation of information and data across various projects within the Polkadot and Kusama ecosystem. By aggregating data, we improve information retrieval and transaction efficiency, enhance user experience, and increase user satisfaction. +- **Integration with Substrate/Polkadot/Kusama**: Our platform aggregates and analyzes data from the Polkadot and Kusama ecosystem, providing users with timely and integrated valuable information. +- **Team Interest**: Our team is passionate about leveraging both BI and AI to solve the challenges of fragmented information in the blockchain ecosystem. By integrating advanced BI and AI technologies, we aim to enhance the overall user experience and efficiency, providing users with timely, valuable insights and data-driven decision-making capabilities. + +### Overview + +Please provide the following: + +- If the name of your project is not descriptive, a tagline (one sentence summary). +- A brief description of your project. +- An indication of how your project relates to / integrates into Substrate / Polkadot / Kusama. +- An indication of why your team is interested in creating this project. + +### Project Details + +Use Case 1: QueryWeb3 + +- Business Description：By consolidating all underlying data from the Polkadot and Kusama ecosystem chains (including transaction volume, transaction count, DEX trading data, TVL and so on) into foundational BI data, and aggregating activity data, document data, technical code, funding data, TG data, DC data, X data, media data, and video data related to the Polkadot ecosystem into a database, we can use AI to extract user intent and provide timely information feedback. + +- Business flow +![business flow for queryweb3](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2Fefcdcde0-30fd-4903-b1a8-870020f35197%2Fa6eea7ae-635d-4c2a-b857-3fd6fbf57622%2Fimage.png?table=block&id=12d2a993-d640-80de-9861-f38852cc6271&spaceId=efcdcde0-30fd-4903-b1a8-870020f35197&width=2000&userId=638ad09f-5298-4a73-90a4-fce8f1564ca6&cache=v2) +- **User Roles**: Polkadot users + +![queryweb3](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2Fefcdcde0-30fd-4903-b1a8-870020f35197%2F3f301465-e1c0-4a47-ae2e-e20aa51ff2ee%2Fimage.png?table=block&id=10a2a993-d640-8082-bd6b-e0013ec9a78a&spaceId=efcdcde0-30fd-4903-b1a8-870020f35197&width=2000&userId=638ad09f-5298-4a73-90a4-fce8f1564ca6&cache=v2) + + +Use Case 2: Yield Query + +- Business Description：allows users to query snapshots of various chains within the Polkadot ecosystem (e.g., DOT, KSM, Hydration, Bifrost, etc.) on any given day. Users can search for all asset types (RWA or DeFi) and all yield types (staking, farming), including all tokens (DOT, KSM, HDT, vDOT, vKSM, BNC, etc.). The query results will list the TVL (Total Value Locked), 24-hour trading volume, and the number of transactions for each token or currency pair. Additionally, based on these query results, our platform can display the top 10 yield rates in the Polkadot ecosystem, the top 10 chains by TVL, and various visual representations such as line charts, pie charts, or other graphical formats. This information is designed to provide investors and operators with valuable insights for making informed investment and operational decisions. + +- Data process： Extract DEFI yield data through the APIs of various blockchains into TiDB and other databases, then process and organize it into multidimensional data suitable for BI, and store it in TiDB. + +- Business flow +![Business flow for yield query](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2Fefcdcde0-30fd-4903-b1a8-870020f35197%2F72c39f08-a156-4621-b692-2d799dec3ae8%2Fimage.png?table=block&id=12d2a993-d640-8000-a6f7-c8d337600098&spaceId=efcdcde0-30fd-4903-b1a8-870020f35197&width=2000&userId=638ad09f-5298-4a73-90a4-fce8f1564ca6&cache=v2) + +- User Roles: Polkadot users including investors, operators, data analysts, technical personnel, and media personnel. + +![Yield query](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2Fefcdcde0-30fd-4903-b1a8-870020f35197%2F6379f6e0-67b8-4957-85db-70dddde1bd3d%2Fimage.png?table=block&id=10a2a993-d640-80f5-bd5a-d7c06146082c&spaceId=efcdcde0-30fd-4903-b1a8-870020f35197&width=2000&userId=638ad09f-5298-4a73-90a4-fce8f1564ca6&cache=v2) + +Use Case 3:Vol & Txns Query + +- Business Description：allows users to query transaction volume, transaction count, and token trading volume data for any chain within the Polkadot ecosystem over a specified time period. Users can analyze this data across various time cycles, such as daily, weekly, monthly, quarterly, semi-annual, and annual cycles. The query results will include year-over-year (YoY) and month-over-month (MoM) metrics and so on .Additionally, based on these query results, our platform can generate reports showing the top 10 chains by transaction volume (or transaction count, YoY, MoM、QoQ) for a specific period, as well as trend line charts and other visual representations over a given time frame. This enables users to understand the current state and development trends of each chain within the Polkadot ecosystem. For example, users can observe whether the monthly transaction volume or transaction count has increased or decreased over the past year. This information helps users understand the status and trends of various chains within the Polkadot ecosystem, identify chains with investment potential or risks, and make informed investment and operational decisions. + +- data process: Initially, extract data from APIs like Subscan, Hydration, Bifrost and so on for DOT, KSM, Hydration, and Bifrost, process it into multidimensional BI data, and save it to MySQL or Crust to form the data source. + +- Business folw ： the same as use case2 + +- **User Roles**: Polkadot users including investors, operators, data analysts, technical personnel, and media personnel. + +![Vol&Txns query](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2Fefcdcde0-30fd-4903-b1a8-870020f35197%2F7bbaaa93-b688-47eb-a052-3a68706406fd%2Fimage.png?table=block&id=0a4f87d6-b3ca-4f35-b3ac-b19961126cca&spaceId=efcdcde0-30fd-4903-b1a8-870020f35197&width=2000&userId=638ad09f-5298-4a73-90a4-fce8f1564ca6&cache=v2) + + +### Ecosystem Fit + +Help us locate your project in the Polkadot/Substrate/Kusama landscape and what problems it tries to solve by answering each of these questions: + +- Where and how does your project fit into the ecosystem? + +- Who is your target audience (parachain/dapp/wallet/UI developers, designers, your own user base, some dapp's userbase, yourself)? +Our target audience includes parachain/dapp/wallet/UI developers, designers, our own user base, and users of other dapps within the ecosystem. + +- What need(s) does your project meet? +QueryWeb3 meets the need for timely and integrated information from the Polkadot ecosystem, addressing issues such as finding high-yield financial products, getting timely feedback on information queries, tracking major wallet movements, and identifying airdrops and NFT rewards. + +- How did you identify these needs? Please provide evidence in the form of (scientific) articles, forum discussions, case studies, or raw data. + + +**Similar Projects**: + +- If there are similar projects, we will identify and assess them, explaining how QueryWeb3 is distinct. If no similar projects exist, we will indicate why such a project might not have been possible, successful, or attempted. + +- Are there any other projects similar to yours in the Substrate / Polkadot / Kusama ecosystem? + - If so, how is your project different? Please identify and assess any projects addressing the same need and explain how your project is distinct. Feel free to include applicable research data, statistics, or metrics. + - If not, please indicate why such a project might not have been possible, successful, or attempted. + +- Are there any projects similar to yours in related ecosystems? + +## Team :busts_in_silhouette: + +> Please note that the data provided in this section is for administrative and informational purposes only. All beneficiaries of a grant must also be listed in the KYC/KYB process during the application phase. See our [FAQ](https://grants.web3.foundation/docs/faq#what-is-kyckyb-and-why-do-i-have-to-provide-this-data) for more info. + +### Team members + +- Product Manager: RogerLe + + Entered the blockchain industry in 2017 as a long-term value investor. Have been holding Polkadot since its auction in 2017 and continuously increasing the position. + + 3 years of BI consulting at Huawei, with successful BI business system solutions, methodologies, and practical business experience. + + 4 years of technical development, 8 years of product management，worked at Infosys for several years. + + Awarded third place in the National Graduate Business Competition “Peak Moment” (strategy, product design, marketing, R&D, finance), serving as the team leader. + + Independently developed quantitative trading strategies. + + Resilient, pursuing lifelong growth, with a diverse knowledge structure: Bachelor’s degree in Computer Science and Master’s degree in Economic Philosophy. + + Other link: [RogerLe🦄🦍 (@lechangxu) / X](https://x.com/lechangxu) + +- Names of team members +- **Community Operations & Technical Advisor:** Dr cao + + actively participated in several parachain projects as CM, ambassadors, founder of AIWeb3, leads the most vibrant Chinese community within the Polkadot ecosystem, and also renowned for its active Chinese content creators. + + He is one of the most engaged users, investors, and YouTubers in Polkadot eco (verified by Mythical, check the tweet here: https://twitter.com/cao_lab/status/1781750280117510518). + + Dr. Cao has also developed Discord and Telegram bots for AIWeb3 and various parachain Chinese communities. + +- **Backend Developer:** YanOctavian + + 5 years Senior Polkadot eco-developer and 7 years Ethereum eco-developer; + + Proficient in public chain development; + + He has extensive practical experience in the blockchain field and is involved in most areas of public chain development, including rollup and zero-knowledge proof. + + Rich experience in project management and team leadership. + + He has worked on prestigious teams such as orbiter. + + Currently working at SuperEx, helping them build their own public chain using polkadot eco-technology. + + An avid amateur AI enthusiast, I believe AI technology will bring great changes to web3. + +- **Full-Stack Developer:** BinX + + 12 years experience in front, familiar with the react/vue/flutter/nestjs/fastapi conventional technology stack; + + Familiar with javascript/python/Java/dart language, understands rust; + + Familiar with web3 Dapp development; + + Proficient in Polkadot.js, with experience in developing multiple wallets and Dapps. + +### Contact + +- **Contact Name:** RogerLe +- **Contact Email:** lechangxu@gmail.com +- **Website:** https://queryweb3.com/ + +### Legal Structure + +- **Registered Address:** Address of your registered legal entity, if available. Please keep it in a single line. (e.g. High Street 1, London LK1 234, UK) +- **Registered Legal Entity:** Name of your registered legal entity, if available. (e.g. Duo Ltd.) + +### Team's experience + +Please describe the team's relevant experience. If your project involves development work, we would appreciate it if you singled out a few interesting projects or contributions made by team members in the past. + +If anyone on your team has applied for a grant at the Web3 Foundation previously, please list the name of the project and legal entity here. + +### Team Code Repos + +- https://github.com/{your_organisation}/{project_1} +- https://github.com/{your_organisation}/{project_2} + +Please also provide the GitHub accounts of all team members. If they contain no activity, references to projects hosted elsewhere or live are also fine. + +- https://github.com/{team_member_1} +- https://github.com/{team_member_2} + +### Team LinkedIn Profiles (if available) + +- https://www.linkedin.com/{person_1} +- https://www.linkedin.com/{person_2} + + +## Development Status :open_book: + +If you've already started implementing your project or it is part of a larger repository, please provide a link and a description of the code here. In any case, please provide some documentation on the research and other work you have conducted before applying. This could be: + +- links to improvement proposals or [RFPs](https://github.com/w3f/Grants-Program/tree/master/docs/RFPs) (requests for proposal), +- academic publications relevant to the problem, +- links to your research diary, blog posts, articles, forum discussions or open GitHub issues, +- references to conversations you might have had related to this project with anyone from the Web3 Foundation, +- previous interface iterations, such as mock-ups and wireframes. + +## Development Roadmap :nut_and_bolt: + +This section should break the development roadmap down into milestones and deliverables. To assist you in defining it, we have created a document with examples for some grant categories [here](../docs/Support%20Docs/grant_guidelines_per_category.md). Since these will be part of the agreement, it helps to describe *the functionality we should expect in as much detail as possible*, plus how we can verify and test that functionality. Whenever milestones are delivered, we refer to this document to ensure that everything has been delivered as expected. + +Below we provide an **example roadmap**. In the descriptions, it should be clear how your project is related to Substrate, Kusama or Polkadot. We *recommend* that teams structure their roadmap as 1 milestone ≈ 1 month. + +> :exclamation: If any of your deliverables are based on somebody else's work, make sure you work and publish *under the terms of the license* of the respective project and that you **highlight this fact in your milestone documentation** and in the source code if applicable! **Projects that submit other people's work without proper attribution will be immediately terminated.** + +### Overview + +- **Total Estimated Duration:** 4.5 months +- **Full-Time Equivalent (FTE):** 60 +- **Total Costs:** 30,000 USD + +### Milestone 1 1 构建defi索引和数据后台 + +- **Estimated duration:** 1.5 month +- **FTE:** 25 +- **Costs:** 12,000 USD + +> :exclamation: **The default deliverables 0a-0d below are mandatory for all milestones**, and deliverable 0e at least for the last one. + +| Number | Deliverable | Specification | +| -----: | ----------- | ------------- | +| **0a.** | License | Apache 2.0 / GPLv3 / MIT / Unlicense. See the [delivery guidelines](https://grants.web3.foundation/docs/Support%20Docs/milestone-deliverables-guidelines#license) for details. | +| **0b.** | Documentation | We will provide both **inline documentation** of the code and a basic **tutorial** that explains how a user can (for example) spin up one of our Substrate nodes and send test transactions, which will show how the new functionality works. See the [delivery guidelines](https://grants.web3.foundation/docs/Support%20Docs/milestone-deliverables-guidelines#documentation) for details. | +| **0c.** | Testing and Testing Guide | Core functions will be fully covered by comprehensive unit tests to ensure functionality and robustness. In the guide, we will describe how to run these tests. See the [delivery guidelines](https://grants.web3.foundation/docs/Support%20Docs/milestone-deliverables-guidelines#testing-guide) for details. | +| **0d.** | Docker | We will provide a Dockerfile(s) that can be used to test all the functionality delivered with this milestone. | +| 0e. | Article | We will publish an **article**/workshop that explains [...] (what was done/achieved as part of the grant). (Content, language, and medium should reflect your target audience described above.) | +| 1. | DEFI indexer | 负责数据的ETL工作， 根据每条链（先做Biforst、Acala、Assethub、HDX、Moonbean， 后续再添加更多链）上每个DEX或者每个DEFI产品的操作规则，对相关数据进行解析并入库 | +| 2. | 事实表和维度表|根据数据的特点，建立defi数据事实表和维度表 | +| 3. | 数据后台 | 基于TiDB、GraphQL和Django构建一个数据后台，对外提供数据api | + + +### Milestone 2 网页和BI开发 + +- **Estimated Duration:** 1 month +- **FTE:** 2,0 +- **Costs:** 10,000 USD + +| Number | Deliverable | Specification | +| -----: | ----------- | ------------- | +| **0c.** | Testing and Testing Guide | Core functions will be fully covered by comprehensive unit tests to ensure functionality and robustness. In the guide, we will describe how to run these tests. See the [delivery guidelines](https://grants.web3.foundation/docs/Support%20Docs/milestone-deliverables-guidelines#testing-guide) for details. | +| **0d.** | Docker | We will provide a Dockerfile(s) that can be used to test all the functionality delivered with this milestone. | +| 0e. | Article | We will publish an **article**/workshop that explains [...] (what was done/achieved as part of the grant). (Content, language, and medium should reflect your target audience described above.) | +| 1. | staking indexer | 对波卡链staking相关的数据进行ETL并入库 | +| 2. | Web服务 | 开发官网并且提供数据查询，实现case 2所提及的功能 | +| 3. | BI开发 | 基于superset， 为用户实现更多维度的数据查询和展示 | + + +### Milestone 3 大数据服务 + +- **Estimated Duration:** 1 month +- **FTE:** 1,5 +- **Costs:** 8,000 USD + +| Number | Deliverable | Specification | +| -----: | ----------- | ------------- | +| **0c.** | Testing and Testing Guide | Core functions will be fully covered by comprehensive unit tests to ensure functionality and robustness. In the guide, we will describe how to run these tests. See the [delivery guidelines](https://grants.web3.foundation/docs/Support%20Docs/milestone-deliverables-guidelines#testing-guide) for details. | +| **0d.** | Docker | We will provide a Dockerfile(s) that can be used to test all the functionality delivered with this milestone. | +| 0e. | Article | We will publish an **article**/workshop that explains [...] (what was done/achieved as part of the grant). (Content, language, and medium should reflect your target audience described above.) | +| 1. | 大数据后台 | 一个基于kafka、Spark和Flink的大数据后台，让用户请求更加及时 | +| 2. | 智能数据查询 | 通过chat2db进行二次开发，让用户可以实现意图查询 | + + +... + + +## Future Plans + +Please include here + +- how you intend to finance the project's long-term maintenance and development, +- how you intend to use, enhance, and promote your project in the short term, and +- the team's long-term plans and intentions in relation to it. + +## Referral Program (optional) :moneybag: + +You can find more information about the program [here](../README.md#moneybag-referral-program). + +- **Referrer:** weimeme +- **Payment Address:** 152SFecVuA1X6ii1CGTzQWyq4xUMQXHD67TtDJyFNiRyujms (Assethub USDC) + +## Additional Information :heavy_plus_sign: + +**How did you hear about the Grants Program?** Web3 Foundation Website / Medium / Twitter / Element / Announcement by another team / personal recommendation / etc. + +Here you can also add any additional information that you think is relevant to this application but isn't part of it already, such as: + +- Work you have already done. +- If there are any other teams who have already contributed (financially) to the project. +- Previous grants you may have applied for. From 7f0d8eccd13c5dc61c194d52a7156a512c16a3c9 Mon Sep 17 00:00:00 2001 From: RogerLe Date: Tue, 26 Nov 2024 07:57:36 +0800 Subject: [PATCH 02/15] Translate some Chinese milestones into English --- applications/queryWeb3.md | 22 +++++++++++----------- 1 file changed, 11 insertions(+), 11 deletions(-) diff --git a/applications/queryWeb3.md b/applications/queryWeb3.md index 19687d5456d..0a4b0f4b6be 100644 --- a/applications/queryWeb3.md +++ b/applications/queryWeb3.md @@ -200,7 +200,7 @@ Below we provide an **example roadmap**. In the descriptions, it should be clear - **Full-Time Equivalent (FTE):** 60 - **Total Costs:** 30,000 USD -### Milestone 1 1 构建defi索引和数据后台 +### Milestone 1 Build a DeFi index and data backend. - **Estimated duration:** 1.5 month - **FTE:** 25 @@ -215,12 +215,12 @@ Below we provide an **example roadmap**. In the descriptions, it should be clear | **0c.** | Testing and Testing Guide | Core functions will be fully covered by comprehensive unit tests to ensure functionality and robustness. In the guide, we will describe how to run these tests. See the [delivery guidelines](https://grants.web3.foundation/docs/Support%20Docs/milestone-deliverables-guidelines#testing-guide) for details. | | **0d.** | Docker | We will provide a Dockerfile(s) that can be used to test all the functionality delivered with this milestone. | | 0e. | Article | We will publish an **article**/workshop that explains [...] (what was done/achieved as part of the grant). (Content, language, and medium should reflect your target audience described above.) | -| 1. | DEFI indexer | 负责数据的ETL工作， 根据每条链（先做Biforst、Acala、Assethub、HDX、Moonbean， 后续再添加更多链）上每个DEX或者每个DEFI产品的操作规则，对相关数据进行解析并入库 | -| 2. | 事实表和维度表|根据数据的特点，建立defi数据事实表和维度表 | -| 3. | 数据后台 | 基于TiDB、GraphQL和Django构建一个数据后台，对外提供数据api | +| 1. | DEFI indexer | Responsible for ETL (Extract, Transform, Load) tasks, parsing and storing relevant data according to the operational rules of each DEX or DEFI product on each blockchain (starting with Bifrost, Acala, Assethub, HDX, Moonbeam, and adding more chains later). | +| 2. | Facts table and dimensions table.|Based on BI data, establish DEFI data fact tables and dimension tables. | +| 3. | Data backend. | Build a data backend based on TiDB, GraphQL, and Django to provide external data APIs.| -### Milestone 2 网页和BI开发 +### Milestone 2 Web and BI development. - **Estimated Duration:** 1 month - **FTE:** 2,0 @@ -231,12 +231,12 @@ Below we provide an **example roadmap**. In the descriptions, it should be clear | **0c.** | Testing and Testing Guide | Core functions will be fully covered by comprehensive unit tests to ensure functionality and robustness. In the guide, we will describe how to run these tests. See the [delivery guidelines](https://grants.web3.foundation/docs/Support%20Docs/milestone-deliverables-guidelines#testing-guide) for details. | | **0d.** | Docker | We will provide a Dockerfile(s) that can be used to test all the functionality delivered with this milestone. | | 0e. | Article | We will publish an **article**/workshop that explains [...] (what was done/achieved as part of the grant). (Content, language, and medium should reflect your target audience described above.) | -| 1. | staking indexer | 对波卡链staking相关的数据进行ETL并入库 | -| 2. | Web服务 | 开发官网并且提供数据查询，实现case 2所提及的功能 | -| 3. | BI开发 | 基于superset， 为用户实现更多维度的数据查询和展示 | +| 1. | staking indexer | Perform ETL (Extract, Transform, Load) operations on staking-related data from the Polkadot chain and store it in the database. | +| 2. | Web service | Develop an official website and provide data query functionality to implement the features mentioned in case 2. | +| 3. | BI development | Based on Superset, enable users to perform more multidimensional data queries and visualizations. | -### Milestone 3 大数据服务 +### Milestone 3 Big data service - **Estimated Duration:** 1 month - **FTE:** 1,5 @@ -247,8 +247,8 @@ Below we provide an **example roadmap**. In the descriptions, it should be clear | **0c.** | Testing and Testing Guide | Core functions will be fully covered by comprehensive unit tests to ensure functionality and robustness. In the guide, we will describe how to run these tests. See the [delivery guidelines](https://grants.web3.foundation/docs/Support%20Docs/milestone-deliverables-guidelines#testing-guide) for details. | | **0d.** | Docker | We will provide a Dockerfile(s) that can be used to test all the functionality delivered with this milestone. | | 0e. | Article | We will publish an **article**/workshop that explains [...] (what was done/achieved as part of the grant). (Content, language, and medium should reflect your target audience described above.) | -| 1. | 大数据后台 | 一个基于kafka、Spark和Flink的大数据后台，让用户请求更加及时 | -| 2. | 智能数据查询 | 通过chat2db进行二次开发，让用户可以实现意图查询 | +| 1. | Big data backend. | A big data backend based on Kafka, Spark, and Flink, enabling more timely user requests. | +| 2. | BI query | Conduct secondary development with Chat2DB, enabling users to perform intent-based queries. | ... From 95280b928bf8e89a8febf729e7340de82769050d Mon Sep 17 00:00:00 2001 From: RogerLe Date: Tue, 26 Nov 2024 10:25:55 +0800 Subject: [PATCH 03/15] Supplement incomplete content for QueryWeb3 --- applications/queryWeb3.md | 65 ++++++++++++++++++++++----------------- 1 file changed, 36 insertions(+), 29 deletions(-) diff --git a/applications/queryWeb3.md b/applications/queryWeb3.md index 0a4b0f4b6be..0f149e3cf66 100644 --- a/applications/queryWeb3.md +++ b/applications/queryWeb3.md @@ -13,14 +13,6 @@ - **Integration with Substrate/Polkadot/Kusama**: Our platform aggregates and analyzes data from the Polkadot and Kusama ecosystem, providing users with timely and integrated valuable information. - **Team Interest**: Our team is passionate about leveraging both BI and AI to solve the challenges of fragmented information in the blockchain ecosystem. By integrating advanced BI and AI technologies, we aim to enhance the overall user experience and efficiency, providing users with timely, valuable insights and data-driven decision-making capabilities. -### Overview - -Please provide the following: - -- If the name of your project is not descriptive, a tagline (one sentence summary). -- A brief description of your project. -- An indication of how your project relates to / integrates into Substrate / Polkadot / Kusama. -- An indication of why your team is interested in creating this project. ### Project Details @@ -52,7 +44,7 @@ Use Case 3:Vol & Txns Query - Business Description：allows users to query transaction volume, transaction count, and token trading volume data for any chain within the Polkadot ecosystem over a specified time period. Users can analyze this data across various time cycles, such as daily, weekly, monthly, quarterly, semi-annual, and annual cycles. The query results will include year-over-year (YoY) and month-over-month (MoM) metrics and so on .Additionally, based on these query results, our platform can generate reports showing the top 10 chains by transaction volume (or transaction count, YoY, MoM、QoQ) for a specific period, as well as trend line charts and other visual representations over a given time frame. This enables users to understand the current state and development trends of each chain within the Polkadot ecosystem. For example, users can observe whether the monthly transaction volume or transaction count has increased or decreased over the past year. This information helps users understand the status and trends of various chains within the Polkadot ecosystem, identify chains with investment potential or risks, and make informed investment and operational decisions. -- data process: Initially, extract data from APIs like Subscan, Hydration, Bifrost and so on for DOT, KSM, Hydration, and Bifrost, process it into multidimensional BI data, and save it to MySQL or Crust to form the data source. +- data process: Initially, extract data from APIs like Subscan, Hydration, Bifrost and so on for DOT, KSM, Hydration, and Bifrost, process it into multidimensional BI data, and save it to TiDB to form the data source. - Business folw ： the same as use case2 @@ -151,8 +143,8 @@ QueryWeb3 meets the need for timely and integrated information from the Polkadot ### Legal Structure -- **Registered Address:** Address of your registered legal entity, if available. Please keep it in a single line. (e.g. High Street 1, London LK1 234, UK) -- **Registered Legal Entity:** Name of your registered legal entity, if available. (e.g. Duo Ltd.) +- **Registered Address:** 3118 Yindu Road, Minhang District, Shanghai, China +- **Registered Legal Entity:** N/A ### Team's experience @@ -162,13 +154,13 @@ If anyone on your team has applied for a grant at the Web3 Foundation previously ### Team Code Repos -- https://github.com/{your_organisation}/{project_1} -- https://github.com/{your_organisation}/{project_2} +- https://github.com/Query-Web3 Please also provide the GitHub accounts of all team members. If they contain no activity, references to projects hosted elsewhere or live are also fine. -- https://github.com/{team_member_1} -- https://github.com/{team_member_2} +- https://github.com/Query-Web3/backend +- https://github.com/Query-Web3/frontend +- https://github.com/Query-Web3/database ### Team LinkedIn Profiles (if available) @@ -178,13 +170,7 @@ Please also provide the GitHub accounts of all team members. If they contain no ## Development Status :open_book: -If you've already started implementing your project or it is part of a larger repository, please provide a link and a description of the code here. In any case, please provide some documentation on the research and other work you have conducted before applying. This could be: - -- links to improvement proposals or [RFPs](https://github.com/w3f/Grants-Program/tree/master/docs/RFPs) (requests for proposal), -- academic publications relevant to the problem, -- links to your research diary, blog posts, articles, forum discussions or open GitHub issues, -- references to conversations you might have had related to this project with anyone from the Web3 Foundation, -- previous interface iterations, such as mock-ups and wireframes. +Under construction ## Development Roadmap :nut_and_bolt: @@ -223,7 +209,7 @@ Below we provide an **example roadmap**. In the descriptions, it should be clear ### Milestone 2 Web and BI development. - **Estimated Duration:** 1 month -- **FTE:** 2,0 +- **FTE:** 20 - **Costs:** 10,000 USD | Number | Deliverable | Specification | @@ -239,7 +225,7 @@ Below we provide an **example roadmap**. In the descriptions, it should be clear ### Milestone 3 Big data service - **Estimated Duration:** 1 month -- **FTE:** 1,5 +- **FTE:** 15 - **Costs:** 8,000 USD | Number | Deliverable | Specification | @@ -250,17 +236,38 @@ Below we provide an **example roadmap**. In the descriptions, it should be clear | 1. | Big data backend. | A big data backend based on Kafka, Spark, and Flink, enabling more timely user requests. | | 2. | BI query | Conduct secondary development with Chat2DB, enabling users to perform intent-based queries. | - ... ## Future Plans -Please include here +### Financing Long-Term Maintenance and Development + +To ensure the long-term sustainability of QueryWeb3 and provide public goods for the Polkadot ecosystem, we plan to implement the following measures: + +- **Partnerships and Sponsorships**: Collaborating with key stakeholders within the Polkadot and Kusama ecosystem to secure funding and sponsorship deals. +- **Grants and Funding**: Considering support from the Polkadot or KSM treasury and applying for grants from the Web3 Foundation and other blockchain-focused funding bodies to support continuous development. +- **Community Crowdfunding**: Conducting community crowdfunding campaigns to engage and support the project's long-term development by attracting passionate users and developers. + +### Short-Term Use, Enhancement, and Promotion + +In the short term, we aim to rapidly iterate on our platform to enhance its functionality and user experience. Our focus includes: + +- **User Feedback Integration**: Actively soliciting and incorporating user feedback to ensure our platform meets the needs of our community. +- **Marketing and Outreach**: Utilizing targeted marketing campaigns and participating in industry events to raise awareness about QueryWeb3, and expanding our influence through cooperation with communities like AIweb3. +- **Feature Expansion**: Continuously adding new features and improving existing ones to provide more value to our users, such as advanced data visualization tools and real-time alerts. +- **Data Integration and AI Services**: Using BI to integrate data and provide better AI services, offering users timely value discovery, investment information, and operational insights. + +### Long-Term Plans and Intentions + +Looking ahead, our team has ambitious goals for QueryWeb3: + +- **Become the Go-To Information Hub**: Establish QueryWeb3 as the most reliable and comprehensive BI and AI-powered information service platform in the Polkadot ecosystem. +- **Expand Ecosystem Integration**: Deepen our integration with the Polkadot and Kusama ecosystems by adding support for more parachains and external data sources. +- **Innovative Solutions**: Leverage cutting-edge technologies like machine learning and advanced analytics to provide predictive insights and automate complex data queries. +- **Community Building**: Through this BI+AI data platform, address information asymmetry and data fragmentation issues, continuously serving the Polkadot ecosystem community users to enhance Polkadot's core competitiveness. -- how you intend to finance the project's long-term maintenance and development, -- how you intend to use, enhance, and promote your project in the short term, and -- the team's long-term plans and intentions in relation to it. +By executing on these plans, we aim to create a robust and invaluable resource for the Polkadot and Kusama ecosystems, enhancing overall user experience, improving information retrieval, and driving greater efficiency in transactions and decision-making processes. ## Referral Program (optional) :moneybag: From 159a36bb551c9b2de1ce4f333ada48530a2e3115 Mon Sep 17 00:00:00 2001 From: RogerLe Date: Tue, 26 Nov 2024 11:58:34 +0800 Subject: [PATCH 04/15] Add UI image --- applications/queryWeb3.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/applications/queryWeb3.md b/applications/queryWeb3.md index 0f149e3cf66..1ee3c90b281 100644 --- a/applications/queryWeb3.md +++ b/applications/queryWeb3.md @@ -24,7 +24,7 @@ Use Case 1: QueryWeb3 ![business flow for queryweb3](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2Fefcdcde0-30fd-4903-b1a8-870020f35197%2Fa6eea7ae-635d-4c2a-b857-3fd6fbf57622%2Fimage.png?table=block&id=12d2a993-d640-80de-9861-f38852cc6271&spaceId=efcdcde0-30fd-4903-b1a8-870020f35197&width=2000&userId=638ad09f-5298-4a73-90a4-fce8f1564ca6&cache=v2) - **User Roles**: Polkadot users -![queryweb3](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2Fefcdcde0-30fd-4903-b1a8-870020f35197%2F3f301465-e1c0-4a47-ae2e-e20aa51ff2ee%2Fimage.png?table=block&id=10a2a993-d640-8082-bd6b-e0013ec9a78a&spaceId=efcdcde0-30fd-4903-b1a8-870020f35197&width=2000&userId=638ad09f-5298-4a73-90a4-fce8f1564ca6&cache=v2) +![queryweb3](https://github.com/Query-Web3/product/blob/main/UI/queryweb3_with_AI.png) Use Case 2: Yield Query @@ -38,7 +38,7 @@ Use Case 2: Yield Query - User Roles: Polkadot users including investors, operators, data analysts, technical personnel, and media personnel. -![Yield query](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2Fefcdcde0-30fd-4903-b1a8-870020f35197%2F6379f6e0-67b8-4957-85db-70dddde1bd3d%2Fimage.png?table=block&id=10a2a993-d640-80f5-bd5a-d7c06146082c&spaceId=efcdcde0-30fd-4903-b1a8-870020f35197&width=2000&userId=638ad09f-5298-4a73-90a4-fce8f1564ca6&cache=v2) +![Yield query](https://raw.githubusercontent.com/Query-Web3/product/refs/heads/main/UI/Yield%20query.webp?token=GHSAT0AAAAAACZVGVFATVKL4KHR5FAG57ZKZ2FIMHA) Use Case 3:Vol & Txns Query @@ -50,7 +50,7 @@ Use Case 3:Vol & Txns Query - **User Roles**: Polkadot users including investors, operators, data analysts, technical personnel, and media personnel. -![Vol&Txns query](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2Fefcdcde0-30fd-4903-b1a8-870020f35197%2F7bbaaa93-b688-47eb-a052-3a68706406fd%2Fimage.png?table=block&id=0a4f87d6-b3ca-4f35-b3ac-b19961126cca&spaceId=efcdcde0-30fd-4903-b1a8-870020f35197&width=2000&userId=638ad09f-5298-4a73-90a4-fce8f1564ca6&cache=v2) +![Vol&Txns query](https://raw.githubusercontent.com/Query-Web3/product/refs/heads/main/UI/vol%26txns%20query.webp?token=GHSAT0AAAAAACZVGVFAC2UQ2XPXSICKANW6Z2FILUA) ### Ecosystem Fit From 9aa570e77299c8015cf049d9c99072ab33f05ad4 Mon Sep 17 00:00:00 2001 From: RogerLe Date: Tue, 26 Nov 2024 12:04:09 +0800 Subject: [PATCH 05/15] Add UI files --- applications/queryWeb3.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/applications/queryWeb3.md b/applications/queryWeb3.md index 1ee3c90b281..aee37ebed28 100644 --- a/applications/queryWeb3.md +++ b/applications/queryWeb3.md @@ -38,7 +38,7 @@ Use Case 2: Yield Query - User Roles: Polkadot users including investors, operators, data analysts, technical personnel, and media personnel. -![Yield query](https://raw.githubusercontent.com/Query-Web3/product/refs/heads/main/UI/Yield%20query.webp?token=GHSAT0AAAAAACZVGVFATVKL4KHR5FAG57ZKZ2FIMHA) +![Yield query](https://github.com/Query-Web3/product/blob/main/UI/Yield%20query.webp) Use Case 3:Vol & Txns Query @@ -50,7 +50,7 @@ Use Case 3:Vol & Txns Query - **User Roles**: Polkadot users including investors, operators, data analysts, technical personnel, and media personnel. -![Vol&Txns query](https://raw.githubusercontent.com/Query-Web3/product/refs/heads/main/UI/vol%26txns%20query.webp?token=GHSAT0AAAAAACZVGVFAC2UQ2XPXSICKANW6Z2FILUA) +![Vol&Txns query](https://github.com/Query-Web3/product/blob/main/UI/vol%26txns%20query.webp) ### Ecosystem Fit From 4c4f478b8863ee49dfd93692d346a3632ba3aaa8 Mon Sep 17 00:00:00 2001 From: RogerLe Date: Tue, 26 Nov 2024 12:13:52 +0800 Subject: [PATCH 06/15] Add business flow files --- applications/queryWeb3.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/applications/queryWeb3.md b/applications/queryWeb3.md index aee37ebed28..3c503f9775e 100644 --- a/applications/queryWeb3.md +++ b/applications/queryWeb3.md @@ -21,7 +21,7 @@ Use Case 1: QueryWeb3 - Business Description：By consolidating all underlying data from the Polkadot and Kusama ecosystem chains (including transaction volume, transaction count, DEX trading data, TVL and so on) into foundational BI data, and aggregating activity data, document data, technical code, funding data, TG data, DC data, X data, media data, and video data related to the Polkadot ecosystem into a database, we can use AI to extract user intent and provide timely information feedback. - Business flow -![business flow for queryweb3](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2Fefcdcde0-30fd-4903-b1a8-870020f35197%2Fa6eea7ae-635d-4c2a-b857-3fd6fbf57622%2Fimage.png?table=block&id=12d2a993-d640-80de-9861-f38852cc6271&spaceId=efcdcde0-30fd-4903-b1a8-870020f35197&width=2000&userId=638ad09f-5298-4a73-90a4-fce8f1564ca6&cache=v2) +![business flow for queryweb3](https://github.com/Query-Web3/product/blob/main/business%20flow/queryweb3_with_ai_businessflow.png) - **User Roles**: Polkadot users ![queryweb3](https://github.com/Query-Web3/product/blob/main/UI/queryweb3_with_AI.png) @@ -34,7 +34,7 @@ Use Case 2: Yield Query - Data process： Extract DEFI yield data through the APIs of various blockchains into TiDB and other databases, then process and organize it into multidimensional data suitable for BI, and store it in TiDB. - Business flow -![Business flow for yield query](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2Fefcdcde0-30fd-4903-b1a8-870020f35197%2F72c39f08-a156-4621-b692-2d799dec3ae8%2Fimage.png?table=block&id=12d2a993-d640-8000-a6f7-c8d337600098&spaceId=efcdcde0-30fd-4903-b1a8-870020f35197&width=2000&userId=638ad09f-5298-4a73-90a4-fce8f1564ca6&cache=v2) +![Business flow for yield query](https://github.com/Query-Web3/product/blob/main/business%20flow/YieldQuery_businessflow.webp) - User Roles: Polkadot users including investors, operators, data analysts, technical personnel, and media personnel. From 659e9fd586c173ef236118d701e7ba2949a52c14 Mon Sep 17 00:00:00 2001 From: lechangxu Date: Wed, 27 Nov 2024 08:56:47 +0800 Subject: [PATCH 07/15] Add business flow files --- applications/queryWeb3.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/applications/queryWeb3.md b/applications/queryWeb3.md index aee37ebed28..3c503f9775e 100644 --- a/applications/queryWeb3.md +++ b/applications/queryWeb3.md @@ -21,7 +21,7 @@ Use Case 1: QueryWeb3 - Business Description：By consolidating all underlying data from the Polkadot and Kusama ecosystem chains (including transaction volume, transaction count, DEX trading data, TVL and so on) into foundational BI data, and aggregating activity data, document data, technical code, funding data, TG data, DC data, X data, media data, and video data related to the Polkadot ecosystem into a database, we can use AI to extract user intent and provide timely information feedback. - Business flow -![business flow for queryweb3](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2Fefcdcde0-30fd-4903-b1a8-870020f35197%2Fa6eea7ae-635d-4c2a-b857-3fd6fbf57622%2Fimage.png?table=block&id=12d2a993-d640-80de-9861-f38852cc6271&spaceId=efcdcde0-30fd-4903-b1a8-870020f35197&width=2000&userId=638ad09f-5298-4a73-90a4-fce8f1564ca6&cache=v2) +![business flow for queryweb3](https://github.com/Query-Web3/product/blob/main/business%20flow/queryweb3_with_ai_businessflow.png) - **User Roles**: Polkadot users ![queryweb3](https://github.com/Query-Web3/product/blob/main/UI/queryweb3_with_AI.png) @@ -34,7 +34,7 @@ Use Case 2: Yield Query - Data process： Extract DEFI yield data through the APIs of various blockchains into TiDB and other databases, then process and organize it into multidimensional data suitable for BI, and store it in TiDB. - Business flow -![Business flow for yield query](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2Fefcdcde0-30fd-4903-b1a8-870020f35197%2F72c39f08-a156-4621-b692-2d799dec3ae8%2Fimage.png?table=block&id=12d2a993-d640-8000-a6f7-c8d337600098&spaceId=efcdcde0-30fd-4903-b1a8-870020f35197&width=2000&userId=638ad09f-5298-4a73-90a4-fce8f1564ca6&cache=v2) +![Business flow for yield query](https://github.com/Query-Web3/product/blob/main/business%20flow/YieldQuery_businessflow.webp) - User Roles: Polkadot users including investors, operators, data analysts, technical personnel, and media personnel. From f70204bed2dbddb8afb8a39ae1c5ae14b0bb5120 Mon Sep 17 00:00:00 2001 From: lechangxu Date: Sat, 30 Nov 2024 18:05:48 +0800 Subject: [PATCH 08/15] Answering Milestones Questions --- applications/queryWeb3.md | 31 ++++++++++++++++++++++++------- 1 file changed, 24 insertions(+), 7 deletions(-) diff --git a/applications/queryWeb3.md b/applications/queryWeb3.md index 3c503f9775e..21d3127af36 100644 --- a/applications/queryWeb3.md +++ b/applications/queryWeb3.md @@ -72,11 +72,28 @@ QueryWeb3 meets the need for timely and integrated information from the Polkadot - If there are similar projects, we will identify and assess them, explaining how QueryWeb3 is distinct. If no similar projects exist, we will indicate why such a project might not have been possible, successful, or attempted. -- Are there any other projects similar to yours in the Substrate / Polkadot / Kusama ecosystem? - - If so, how is your project different? Please identify and assess any projects addressing the same need and explain how your project is distinct. Feel free to include applicable research data, statistics, or metrics. - - If not, please indicate why such a project might not have been possible, successful, or attempted. +There are no projects entirely similar to ours, although some have partial similarities, making our BI+AI QueryWeb3 project unique. Here are two examples: + +1. **Subscan in the Polkadot Ecosystem**: They offer the following services: + - **Blockchain Data Queries**: Comprehensive queries on Polkadot and its ecosystem, including block information, transaction records, and account balances. + - **Transaction and Event Tracking**: Users can track the transaction history and events of specific addresses in real-time. + - **Asset Management**: Detailed information on various assets, including transfer records and current balances. + - **Governance and Proposals**: Displays governance proposals and voting situations in the Polkadot network. + - **Statistical Analysis**: Provides network statistics, helping users analyze the network's health. + + QueryWeb3 provides BI+AI services based on these data points, offering multi-dimensional BI reports and statistical analysis. This includes identifying investment opportunities through top transaction volumes and trends. Currently, no project in the Polkadot community achieves this level of analysis. Additionally, users can query which DeFi pools offer the highest returns, enabling efficient investment and staking. Our BI data also feeds into AI, aggregating various project data in the Polkadot ecosystem to solve information asymmetry and data fragmentation issues, serving investors, operators, and media in the Polkadot community. + +2. **DEX Screener in the Ethereum Ecosystem**: They offer the following services: + - **Real-time Data Analysis**: Provides real-time data on prices, liquidity, market cap, and trading volume. + - **Charts and Trend Analysis**: Supports TradingView charts for technical analysis. + - **Multi-Chain Data Aggregation**: Tracks data from over 80 blockchain networks, covering thousands of DEX trading pairs. + - **Personalization Features**: Users can set alerts, create watchlists, analyze trends, and trade directly on the platform. + - **Cross-Chain Analysis Tools**: Provides data analysis tools across multiple DEX and blockchain networks, helping users make more informed trading decisions. + + QueryWeb3 is similar to DEX Screener in some respects. We process base trading information and volume into BI data, offering multi-dimensional, varied granularity, and different perspective charts and trend analyses. We also use AI searches to solve information asymmetry in the Polkadot ecosystem, improving user value discovery efficiency and reducing trading costs. + -- Are there any projects similar to yours in related ecosystems? +In summary, unlike Subscan and DEX Screener, Subscan provides basic information search services, and DEX Screener mainly offers DeFi information services. However, QueryWeb3 excels in dimensions, depth, perspective, and scope. QueryWeb3 aggregates various data within the Polkadot ecosystem and processes basic data into BI reports, offering direct application value for users, investors, and project operators. The QueryWeb3 project is crucial and irreplaceable in the current Polkadot ecosystem. ## Team :busts_in_silhouette: @@ -200,7 +217,7 @@ Below we provide an **example roadmap**. In the descriptions, it should be clear | **0b.** | Documentation | We will provide both **inline documentation** of the code and a basic **tutorial** that explains how a user can (for example) spin up one of our Substrate nodes and send test transactions, which will show how the new functionality works. See the [delivery guidelines](https://grants.web3.foundation/docs/Support%20Docs/milestone-deliverables-guidelines#documentation) for details. | | **0c.** | Testing and Testing Guide | Core functions will be fully covered by comprehensive unit tests to ensure functionality and robustness. In the guide, we will describe how to run these tests. See the [delivery guidelines](https://grants.web3.foundation/docs/Support%20Docs/milestone-deliverables-guidelines#testing-guide) for details. | | **0d.** | Docker | We will provide a Dockerfile(s) that can be used to test all the functionality delivered with this milestone. | -| 0e. | Article | We will publish an **article**/workshop that explains [...] (what was done/achieved as part of the grant). (Content, language, and medium should reflect your target audience described above.) | +| 0e. | Article | We will be publishing an article on the Polkadot community, AIweb3 community, as well as on X and Telegram to update everyone on our progress and work. | | 1. | DEFI indexer | Responsible for ETL (Extract, Transform, Load) tasks, parsing and storing relevant data according to the operational rules of each DEX or DEFI product on each blockchain (starting with Bifrost, Acala, Assethub, HDX, Moonbeam, and adding more chains later). | | 2. | Facts table and dimensions table.|Based on BI data, establish DEFI data fact tables and dimension tables. | | 3. | Data backend. | Build a data backend based on TiDB, GraphQL, and Django to provide external data APIs.| @@ -216,7 +233,7 @@ Below we provide an **example roadmap**. In the descriptions, it should be clear | -----: | ----------- | ------------- | | **0c.** | Testing and Testing Guide | Core functions will be fully covered by comprehensive unit tests to ensure functionality and robustness. In the guide, we will describe how to run these tests. See the [delivery guidelines](https://grants.web3.foundation/docs/Support%20Docs/milestone-deliverables-guidelines#testing-guide) for details. | | **0d.** | Docker | We will provide a Dockerfile(s) that can be used to test all the functionality delivered with this milestone. | -| 0e. | Article | We will publish an **article**/workshop that explains [...] (what was done/achieved as part of the grant). (Content, language, and medium should reflect your target audience described above.) | +| 0e. | Article | We will be publishing an article on the Polkadot community, AIweb3 community, as well as on X and Telegram to update everyone on our progress and work. | | 1. | staking indexer | Perform ETL (Extract, Transform, Load) operations on staking-related data from the Polkadot chain and store it in the database. | | 2. | Web service | Develop an official website and provide data query functionality to implement the features mentioned in case 2. | | 3. | BI development | Based on Superset, enable users to perform more multidimensional data queries and visualizations. | @@ -232,7 +249,7 @@ Below we provide an **example roadmap**. In the descriptions, it should be clear | -----: | ----------- | ------------- | | **0c.** | Testing and Testing Guide | Core functions will be fully covered by comprehensive unit tests to ensure functionality and robustness. In the guide, we will describe how to run these tests. See the [delivery guidelines](https://grants.web3.foundation/docs/Support%20Docs/milestone-deliverables-guidelines#testing-guide) for details. | | **0d.** | Docker | We will provide a Dockerfile(s) that can be used to test all the functionality delivered with this milestone. | -| 0e. | Article | We will publish an **article**/workshop that explains [...] (what was done/achieved as part of the grant). (Content, language, and medium should reflect your target audience described above.) | +| 0e. | Article | We will be publishing an article on the Polkadot community, AIweb3 community, as well as on X and Telegram to update everyone on our progress and work.| | 1. | Big data backend. | A big data backend based on Kafka, Spark, and Flink, enabling more timely user requests. | | 2. | BI query | Conduct secondary development with Chat2DB, enabling users to perform intent-based queries. | From 2557b179e58bda7b73080632400a0a5dd544f86f Mon Sep 17 00:00:00 2001 From: lechangxu Date: Sun, 1 Dec 2024 08:43:22 +0800 Subject: [PATCH 09/15] update TiDB with MySQL for current version --- applications/queryWeb3.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/applications/queryWeb3.md b/applications/queryWeb3.md index 21d3127af36..5c8e381d042 100644 --- a/applications/queryWeb3.md +++ b/applications/queryWeb3.md @@ -31,7 +31,7 @@ Use Case 2: Yield Query - Business Description：allows users to query snapshots of various chains within the Polkadot ecosystem (e.g., DOT, KSM, Hydration, Bifrost, etc.) on any given day. Users can search for all asset types (RWA or DeFi) and all yield types (staking, farming), including all tokens (DOT, KSM, HDT, vDOT, vKSM, BNC, etc.). The query results will list the TVL (Total Value Locked), 24-hour trading volume, and the number of transactions for each token or currency pair. Additionally, based on these query results, our platform can display the top 10 yield rates in the Polkadot ecosystem, the top 10 chains by TVL, and various visual representations such as line charts, pie charts, or other graphical formats. This information is designed to provide investors and operators with valuable insights for making informed investment and operational decisions. -- Data process： Extract DEFI yield data through the APIs of various blockchains into TiDB and other databases, then process and organize it into multidimensional data suitable for BI, and store it in TiDB. +- Data process： Extract DEFI yield data through the APIs of various blockchains into MySQL and other databases, then process and organize it into multidimensional data suitable for BI, and store it in MySQL. - Business flow ![Business flow for yield query](https://github.com/Query-Web3/product/blob/main/business%20flow/YieldQuery_businessflow.webp) @@ -44,7 +44,7 @@ Use Case 3:Vol & Txns Query - Business Description：allows users to query transaction volume, transaction count, and token trading volume data for any chain within the Polkadot ecosystem over a specified time period. Users can analyze this data across various time cycles, such as daily, weekly, monthly, quarterly, semi-annual, and annual cycles. The query results will include year-over-year (YoY) and month-over-month (MoM) metrics and so on .Additionally, based on these query results, our platform can generate reports showing the top 10 chains by transaction volume (or transaction count, YoY, MoM、QoQ) for a specific period, as well as trend line charts and other visual representations over a given time frame. This enables users to understand the current state and development trends of each chain within the Polkadot ecosystem. For example, users can observe whether the monthly transaction volume or transaction count has increased or decreased over the past year. This information helps users understand the status and trends of various chains within the Polkadot ecosystem, identify chains with investment potential or risks, and make informed investment and operational decisions. -- data process: Initially, extract data from APIs like Subscan, Hydration, Bifrost and so on for DOT, KSM, Hydration, and Bifrost, process it into multidimensional BI data, and save it to TiDB to form the data source. +- data process: Initially, extract data from APIs like Subscan, Hydration, Bifrost and so on for DOT, KSM, Hydration, and Bifrost, process it into multidimensional BI data, and save it to MySQL to form the data source. - Business folw ： the same as use case2 @@ -220,7 +220,7 @@ Below we provide an **example roadmap**. In the descriptions, it should be clear | 0e. | Article | We will be publishing an article on the Polkadot community, AIweb3 community, as well as on X and Telegram to update everyone on our progress and work. | | 1. | DEFI indexer | Responsible for ETL (Extract, Transform, Load) tasks, parsing and storing relevant data according to the operational rules of each DEX or DEFI product on each blockchain (starting with Bifrost, Acala, Assethub, HDX, Moonbeam, and adding more chains later). | | 2. | Facts table and dimensions table.|Based on BI data, establish DEFI data fact tables and dimension tables. | -| 3. | Data backend. | Build a data backend based on TiDB, GraphQL, and Django to provide external data APIs.| +| 3. | Data backend. | Build a data backend based on MySQL, GraphQL, and Django to provide external data APIs.| ### Milestone 2 Web and BI development. From 54299bf91b5626921d11db58a1d88a4b82c0bb92 Mon Sep 17 00:00:00 2001 From: lechangxu Date: Sun, 1 Dec 2024 11:19:12 +0800 Subject: [PATCH 10/15] update Django with FastAPI for development --- applications/queryWeb3.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/applications/queryWeb3.md b/applications/queryWeb3.md index 5c8e381d042..30b849c76d0 100644 --- a/applications/queryWeb3.md +++ b/applications/queryWeb3.md @@ -220,7 +220,7 @@ Below we provide an **example roadmap**. In the descriptions, it should be clear | 0e. | Article | We will be publishing an article on the Polkadot community, AIweb3 community, as well as on X and Telegram to update everyone on our progress and work. | | 1. | DEFI indexer | Responsible for ETL (Extract, Transform, Load) tasks, parsing and storing relevant data according to the operational rules of each DEX or DEFI product on each blockchain (starting with Bifrost, Acala, Assethub, HDX, Moonbeam, and adding more chains later). | | 2. | Facts table and dimensions table.|Based on BI data, establish DEFI data fact tables and dimension tables. | -| 3. | Data backend. | Build a data backend based on MySQL, GraphQL, and Django to provide external data APIs.| +| 3. | Data backend. | Build a data backend based on MySQL, GraphQL, and FastAPI to provide external data APIs.| ### Milestone 2 Web and BI development. From 07a619d363c2a543a01f3f7a97f41bc716dc81a3 Mon Sep 17 00:00:00 2001 From: lechangxu Date: Tue, 3 Dec 2024 11:35:51 +0800 Subject: [PATCH 11/15] add some unnecessary info --- applications/queryWeb3.md | 15 ++------------- 1 file changed, 2 insertions(+), 13 deletions(-) diff --git a/applications/queryWeb3.md b/applications/queryWeb3.md index 30b849c76d0..d70cbde9f31 100644 --- a/applications/queryWeb3.md +++ b/applications/queryWeb3.md @@ -165,9 +165,7 @@ In summary, unlike Subscan and DEX Screener, Subscan provides basic information ### Team's experience -Please describe the team's relevant experience. If your project involves development work, we would appreciate it if you singled out a few interesting projects or contributions made by team members in the past. - -If anyone on your team has applied for a grant at the Web3 Foundation previously, please list the name of the project and legal entity here. +Please see the Team members‘introduction ### Team Code Repos @@ -181,22 +179,13 @@ Please also provide the GitHub accounts of all team members. If they contain no ### Team LinkedIn Profiles (if available) -- https://www.linkedin.com/{person_1} -- https://www.linkedin.com/{person_2} +- https://www.linkedin.com/lechangxu ## Development Status :open_book: Under construction -## Development Roadmap :nut_and_bolt: - -This section should break the development roadmap down into milestones and deliverables. To assist you in defining it, we have created a document with examples for some grant categories [here](../docs/Support%20Docs/grant_guidelines_per_category.md). Since these will be part of the agreement, it helps to describe *the functionality we should expect in as much detail as possible*, plus how we can verify and test that functionality. Whenever milestones are delivered, we refer to this document to ensure that everything has been delivered as expected. - -Below we provide an **example roadmap**. In the descriptions, it should be clear how your project is related to Substrate, Kusama or Polkadot. We *recommend* that teams structure their roadmap as 1 milestone ≈ 1 month. - -> :exclamation: If any of your deliverables are based on somebody else's work, make sure you work and publish *under the terms of the license* of the respective project and that you **highlight this fact in your milestone documentation** and in the source code if applicable! **Projects that submit other people's work without proper attribution will be immediately terminated.** - ### Overview - **Total Estimated Duration:** 4.5 months From d35208e3bd91567509b36954f1f4cd11073f430a Mon Sep 17 00:00:00 2001 From: lechangxu Date: Tue, 3 Dec 2024 11:49:11 +0800 Subject: [PATCH 12/15] add some unnecessary info --- applications/queryWeb3.md | 1 - 1 file changed, 1 deletion(-) diff --git a/applications/queryWeb3.md b/applications/queryWeb3.md index d70cbde9f31..cda31181934 100644 --- a/applications/queryWeb3.md +++ b/applications/queryWeb3.md @@ -181,7 +181,6 @@ Please also provide the GitHub accounts of all team members. If they contain no - https://www.linkedin.com/lechangxu - ## Development Status :open_book: Under construction From 1bd8c36cc7d94d5a9ec3d5f79213f28eb2699d3b Mon Sep 17 00:00:00 2001 From: lechangxu Date: Fri, 6 Dec 2024 10:07:30 +0800 Subject: [PATCH 13/15] update format info --- applications/queryWeb3.md | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/applications/queryWeb3.md b/applications/queryWeb3.md index cda31181934..c7e1018fba4 100644 --- a/applications/queryWeb3.md +++ b/applications/queryWeb3.md @@ -29,9 +29,9 @@ Use Case 1: QueryWeb3 Use Case 2: Yield Query -- Business Description：allows users to query snapshots of various chains within the Polkadot ecosystem (e.g., DOT, KSM, Hydration, Bifrost, etc.) on any given day. Users can search for all asset types (RWA or DeFi) and all yield types (staking, farming), including all tokens (DOT, KSM, HDT, vDOT, vKSM, BNC, etc.). The query results will list the TVL (Total Value Locked), 24-hour trading volume, and the number of transactions for each token or currency pair. Additionally, based on these query results, our platform can display the top 10 yield rates in the Polkadot ecosystem, the top 10 chains by TVL, and various visual representations such as line charts, pie charts, or other graphical formats. This information is designed to provide investors and operators with valuable insights for making informed investment and operational decisions. +- Business Description：allows users to query snapshots of various chains within the Polkadot ecosystem (e.g., Polkadot, Kusama, Hydration, Bifrost, etc.) on any given day. Users can search for all asset types (RWA or DeFi) and all yield types (staking, farming), including all tokens (DOT, KSM, HDT, vDOT, vKSM, BNC, etc.). The query results will list the TVL (Total Value Locked), 24-hour trading volume, and the number of transactions for each token or currency pair. Additionally, based on these query results, our platform can display the top 10 yield rates in the Polkadot ecosystem, the top 10 chains by TVL, and various visual representations such as line charts, pie charts, or other graphical formats. This information is designed to provide investors and operators with valuable insights for making informed investment and operational decisions. -- Data process： Extract DEFI yield data through the APIs of various blockchains into MySQL and other databases, then process and organize it into multidimensional data suitable for BI, and store it in MySQL. +- Data process: Extract DEFI yield data through the APIs of various blockchains into MySQL and other databases, then process and organize it into multidimensional data suitable for BI, and store it in MySQL. - Business flow ![Business flow for yield query](https://github.com/Query-Web3/product/blob/main/business%20flow/YieldQuery_businessflow.webp) @@ -40,13 +40,13 @@ Use Case 2: Yield Query ![Yield query](https://github.com/Query-Web3/product/blob/main/UI/Yield%20query.webp) -Use Case 3:Vol & Txns Query +Use Case 3: Vol & Txns Query - Business Description：allows users to query transaction volume, transaction count, and token trading volume data for any chain within the Polkadot ecosystem over a specified time period. Users can analyze this data across various time cycles, such as daily, weekly, monthly, quarterly, semi-annual, and annual cycles. The query results will include year-over-year (YoY) and month-over-month (MoM) metrics and so on .Additionally, based on these query results, our platform can generate reports showing the top 10 chains by transaction volume (or transaction count, YoY, MoM、QoQ) for a specific period, as well as trend line charts and other visual representations over a given time frame. This enables users to understand the current state and development trends of each chain within the Polkadot ecosystem. For example, users can observe whether the monthly transaction volume or transaction count has increased or decreased over the past year. This information helps users understand the status and trends of various chains within the Polkadot ecosystem, identify chains with investment potential or risks, and make informed investment and operational decisions. - data process: Initially, extract data from APIs like Subscan, Hydration, Bifrost and so on for DOT, KSM, Hydration, and Bifrost, process it into multidimensional BI data, and save it to MySQL to form the data source. -- Business folw ： the same as use case2 +- Business flow ： the same as use case 2 - **User Roles**: Polkadot users including investors, operators, data analysts, technical personnel, and media personnel. From 3b5fdf025f65c3632105f6b7083cfe35a6f78954 Mon Sep 17 00:00:00 2001 From: lechangxu Date: Fri, 6 Dec 2024 12:05:22 +0800 Subject: [PATCH 14/15] delete assethub info --- applications/queryWeb3.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/applications/queryWeb3.md b/applications/queryWeb3.md index c7e1018fba4..fc0e681cbb8 100644 --- a/applications/queryWeb3.md +++ b/applications/queryWeb3.md @@ -206,7 +206,7 @@ Under construction | **0c.** | Testing and Testing Guide | Core functions will be fully covered by comprehensive unit tests to ensure functionality and robustness. In the guide, we will describe how to run these tests. See the [delivery guidelines](https://grants.web3.foundation/docs/Support%20Docs/milestone-deliverables-guidelines#testing-guide) for details. | | **0d.** | Docker | We will provide a Dockerfile(s) that can be used to test all the functionality delivered with this milestone. | | 0e. | Article | We will be publishing an article on the Polkadot community, AIweb3 community, as well as on X and Telegram to update everyone on our progress and work. | -| 1. | DEFI indexer | Responsible for ETL (Extract, Transform, Load) tasks, parsing and storing relevant data according to the operational rules of each DEX or DEFI product on each blockchain (starting with Bifrost, Acala, Assethub, HDX, Moonbeam, and adding more chains later). | +| 1. | DEFI indexer | Responsible for ETL (Extract, Transform, Load) tasks, parsing and storing relevant data according to the operational rules of each DEX or DEFI product on each blockchain (starting with Bifrost, Acala, Hydration, Moonbeam, and adding more chains later). | | 2. | Facts table and dimensions table.|Based on BI data, establish DEFI data fact tables and dimension tables. | | 3. | Data backend. | Build a data backend based on MySQL, GraphQL, and FastAPI to provide external data APIs.| From 6defe75b5f177548821649cb14179438e11445a7 Mon Sep 17 00:00:00 2001 From: lechangxu Date: Thu, 19 Dec 2024 07:49:07 +0800 Subject: [PATCH 15/15] update DOT payment --- applications/queryWeb3.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/applications/queryWeb3.md b/applications/queryWeb3.md index fc0e681cbb8..b796ba94fe9 100644 --- a/applications/queryWeb3.md +++ b/applications/queryWeb3.md @@ -190,7 +190,7 @@ Under construction - **Total Estimated Duration:** 4.5 months - **Full-Time Equivalent (FTE):** 60 - **Total Costs:** 30,000 USD - +- **DOT payment:** 50% of total costs. ### Milestone 1 Build a DeFi index and data backend. - **Estimated duration:** 1.5 month