Proposed by:
Requested amount:
0 DOT

#1366 · Subscan Q3/Q4 2024 Funding Proposal: Basic service fee & Development cost for the Polkadot, Westend, and Rococo Ecosystems)

> Due to potential display issues with some charts in markdown format across various devices and platforms, please refer to the detailed information in this Google Document:

https://docs.google.com/document/d/1qeOoJww2aXMzAcpCMyp5r_ETxcjSm1SFGCAEtNL2T9Y/edit?usp=sharing

------------

Subscan is a comprehensive and widely-used explorer and indexer within the Polkadot ecosystem. It provides developers, validators, parachain teams, and general users with critical data insights—enabling efficient on-chain operations, debugging, and decision-making. We have previously received funding from the Polkadot Treasury for infrastructure and development costs, ensuring that the platform remains stable, accessible, and continuously evolving.

Past proposals

Overview and Rationale

In earlier funding cycles, we relied on a reimbursement model closely tied to API usage and traffic distribution. This often resulted in cost volatility and estimation inaccuracies. To improve fairness, predictability, and transparency, we have refined our pricing model based on storage usage—an approach that correlates more reliably with total costs and has been successfully tested over the last year.

In addition to standard maintenance, Subscan invests heavily in continuous improvement. We detail our Q3 development efforts here, linking costs directly to feature enhancements and platform optimizations. By providing this level of transparency, we help the community understand how funds translate into tangible ecosystem benefits. Future development tasks for Q4 are ongoing; while their costs are not included here, we offer a brief roadmap to demonstrate what’s on the horizon.

Encouraging Community Participation
We strongly value community feedback. Stakeholders can suggest new features, raise issues, and influence development priorities via our GitHub Issue Tracker:

In the past, community feedback has led to UI improvements, enhanced token price display mechanisms, and more robust search functionalities. This iterative feedback loop ensures the ongoing alignment of our efforts with the community’s evolving needs.

Scope of This Proposal

1. Q3/Q4 Maintenance (14 Networks):

  • Polkadot and Parachains: Polkadot, Assethub-Polkadot (Statemint), Bridgehub-Polkadot, Collectives-Polkadot, Coretime-Polkadot, People-Polkadot
  • Westend and Parachains: Westend, Assethub-Westend, Bridgehub-Westend, Coretime-Westend
  • Rococo and Parachains (until Oct 18, 2024): Rococo, Assethub-Rococo (Rockmine), Bridgehub-Rococo, Coretime-Rococo
  • These networks benefit from high-quality data indexing, stable uptime, accurate block and transaction data, NFT indexing improvements, and reliable APIs that developers and validators depend on daily.

2. Q3 Development Costs:
This covers new feature development and improvements completed during Q3, including NFT module optimization, multi-address query APIs, login and account management enhancements, token pricing configurations, and performance and security audits. These changes have already been implemented and are improving the end-user experience, developer tooling, and platform reliability.

3. Future Work (Q4 Development Preview):
Although not included in this funding request, ongoing Q4 development tasks include improved cross-chain data retrieval, further performance optimizations, and enhanced data visualization features. We will submit these costs in Q1 2025. Transparency remains key: once Q4 tasks conclude, we will present their breakdown and associated costs.

Cost Optimization and Historical Metrics

Our previous proposal for 5 networks over 9 months totaled approximately USD 303,791.7, averaging USD 33,754.63 per month. Through targeted optimizations—improving indexing algorithms, refining caching strategies, and consolidating infrastructure—our monthly average costs have decreased by about 35.01% for the current cycle (Q3/Q4), landing at approximately USD 21,937.33 per month for Q3.

These optimizations have not come at the expense of performance. Over the past two quarters, we have:

  • Reduced average API response times by ~12% due to more efficient database queries and enhanced caching.
  • Decreased storage overhead by implementing automated data cleaning and improved indexing structures, ensuring sustained performance even as chain data grows.
  • Lowered bandwidth costs through better CDN (Cloudflare) and request-caching strategies, resulting in more stable page load times for end-users.

Benefits to Different User Groups

  • Developers: The enhanced APIs and improved indexing accuracy allow developers to more quickly access real-time and historical data, enabling them to build more reliable dApps and automation tools.
  • Validators & Parachain Teams: Up-to-date block information, node health monitoring, and clear notification pipelines help validators maintain stable operations and quickly address issues. Parachain teams receive timely insights into network performance, asset transfers, and governance activities, facilitating better decision-making.
  • End-Users & Traders: Subscan’s improved UI/UX, faster data retrieval, and more accurate token pricing empower end-users to confidently explore and evaluate chain data. Improved NFT module performance enhances the experience for users and creators alike, making the platform more accessible and engaging.

Service Fee Model & Pricing Methodology

Our maintenance packages are designed to address a variety of data needs, ensuring smooth and efficient operations. Given the complexity of our overall cost structure—which includes expenses for GCP, Cloudflare, Datadog, Onfinality, Dwellir, and Subscan’s team operations—we use storage as the primary metric to determine fees. Storage usage strongly correlates with total costs and fluctuates as new blocks are produced. To maintain fairness and accuracy, we use the median storage value measured on the 15th day of each quarter to establish the quarterly baseline fee.

Pricing Tiers:
a. Basic Plan

  • Up to 200 GB: $799/month
  • Beyond 200 GB: $5.3/GB
  • Automatically upgrades to the next tier after 350 GB

b. Advanced Plan

  • Up to 500 GB: $1,699/month
  • Beyond 500 GB: $5.2/GB
  • Automatically upgrades to the next tier after 750 GB

c. Professional Plan

  • Up to 1 TB: $2,999/month
  • Beyond 1 TB: $5/GB

Monthly Service Fee Breakdown

Database Storage & Indexing

  • What It Covers: Continuous indexing of on-chain data—from blocks and transactions to event logs, governance info, and NFTs—so users can reliably access both real-time and historical records.
  • Why It Matters: As chain activity increases, so does data volume. By tying fees to storage needs, we accurately account for the costs of scaling infrastructure (e.g., additional database capacity).

Network Egress Bandwidth

  • What It Covers: The outgoing traffic required to serve user requests quickly and consistently, including API calls, UI data retrieval, and integrations with third-party tools.
  • Why It Matters: A stable, high-bandwidth connection ensures that explorers, wallets, and dApps receive timely data responses, even during peak activity.

Monitoring & DevOps

  • What It Covers: Round-the-clock health checks, internal alert pipelines, CI/CD automation, and system auditing. This includes running multiple nodes, maintaining synchronization, and ensuring high availability.
  • Why It Matters: These processes help detect issues early (e.g., node crashes, indexer slowdowns) and streamline updates or deployments, minimizing service disruption for the community.

Node Status Monitoring & Notifications

  • What It Covers: Dedicated tools and alert mechanisms to track the real-time status of network nodes—particularly those relating to the Kusama Relay Chain and the associated parachains (Assethub, Coretime, Bridgehub, People).
  • Why It Matters: Quick notifications enable parachain teams, validators, and the wider ecosystem to react rapidly to performance changes, forks, or potential security incidents.

Technical Support & Troubleshooting

  • What It Covers: Responsive assistance for users, developers, and validators, including issue resolution, feature guidance, and integration help.
  • Why It Matters: Timely support keeps the ecosystem running smoothly and fosters a positive development environment—especially crucial for teams building dApps, explorers, and automation tools.

Why We Use Storage as a Pricing Metric

  • Correlation to Real Costs: Storage growth scales in tandem with block production and transaction activity, making it a more stable metric than raw API traffic.
  • Quarterly Baseline: By measuring the median storage on the 15th day of each quarter, we capture a fair snapshot of usage to determine the appropriate fee tier.
  • Predictable Billing: This approach reduces wild fluctuations tied to sudden traffic spikes and provides a more transparent cost basis for the community and treasury.

Beyond Storage: The Full Cost Landscape

Our pricing also factors in overhead for hosting and operational services such as GCP, Cloudflare, Datadog, Onfinality, Dwellir, plus Subscan’s own team efforts in maintenance, development, and user support. By pegging fees to storage usage, we ensure a straightforward, usage-based cost structure while continuing to deliver reliable, feature-rich explorer services to the Kusama ecosystem.

Fee Details

Q3/Q4 Maintenance Fees

  • Total Maintenance Fees for Q3 & Q4 (14 networks): USD 131,624
NetworkActual Usage/GBDatePackageFees/MonthBilling PeriodFees
Polkadot2569.0315/08/2024Professional10724Q3: 01/07/2024-30/09/202432,172
Polkadot2752.9815/11/2024Professional11644Q4: 01/10/2024-31/12/202434,932
Assethub-Polkadot (Statemint)242.6815/08/2024Basic+1025Q3: 01/07/2024-30/09/20243,076
Assethub-Polkadot (Statemint)268.5315/11/2024Basic+1162Q4: 01/10/2024-31/12/20243,487
Bridgehub-Polkadot11215/08/2024Basic799Q3: 01/07/2024-30/09/20242,397
Bridgehub-Polkadot139.3315/11/2024Basic799Q4: 01/10/2024-31/12/20242,397
Collectives-Polkadot132.1915/08/2024Basic799Q3: 01/07/2024-30/09/20242,397
Collectives-Polkadot148.915/11/2024Basic799Q4: 01/10/2024-31/12/20242,397
People-Polkadot3.5101/09/2024Basic799Q3: 01/08/2024-30/09/20241,598
People-Polkadot9.9415/11/2024Basic799Q4: 01/10/2024-31/12/20242,397
Coretime-Polkadot6.9115/11/2024Basic799Q4: 01/10/2024-31/12/20242,397
Westend276.5715/08/2024Basic+1205Q3: 01/07/2024-30/09/20243,614
Westend490.5115/11/2024Advanced1699Q4: 01/10/2024-31/12/20245,097
Assethub-Westend185.9915/08/2024Basic799Q3: 01/07/2024-30/09/20242,397
Assethub-Westend159.715/11/2024Basic799Q4: 01/10/2024-31/12/20242,397
Bridgehub-Westend100.915/08/2024Basic799Q3: 01/07/2024-30/09/20242,397
Bridgehub-Westend119.315/11/2024Basic799Q4: 01/10/2024-31/12/20242,397
Coretime-westend35.5115/08/2024Basic799Q3: 01/07/2024-30/09/20242,397
Coretime-westend67.5415/11/2024Basic799Q4: 01/10/2024-31/12/20242,397
Rococo1009.2515/02/2024Professional299901/07/2024-18/10/2024 (3.5 month)10,496
Assethub-Rococo(Rockmine)138.5615/02/2024Basic79901/07/2024-18/10/2024 (3.5 month)2,796
Bridgehub-Rococo93.9301/05/2024Basic79901/07/2024-18/10/2024 (3.5 month)2,796
Coretime-Rococo42.5401/05/2024Basic79901/07/2024-18/10/2024 (3.5 month)2,796

Q3 New Features Development Costs

Below are the new features implemented during Q3. Additionally, we have dedicated custom development efforts underway for Coretime and Bridgehub. Since these features have not yet reached their final milestones, the related tasks are not included in this request. We will submit a separate reimbursement proposal once the corresponding milestones are completed.

  • Completed Feature & Performance Improvements: USD 34,630 (466 hours of work with transparent hourly rates)
  • These improvements directly translate to tangible platform enhancements, already deployed and benefiting users today.
Task NumberTask NameDescriptionProduct Manager/TestDesignerBackend DeveloperFrontend DeveloperDevOps
Task 1NFT Module ExpansionOptimize the indexing and thumbnail loading logic of NFTs to improve image loading speed and reduce bandwidth consumption. By improving image compression algorithms and caching strategies, ensure that users have a smoother experience when browsing NFTs, while reducing server load and enhancing overall system performance.4 hours-26 hours10 hours-
Task 2Multi-Address Query Aggregation APIDevelop a new API that allows users to query asset, transaction, and activity information for multiple addresses at once. Optimize API performance and response speed to ensure stability under large-scale queries. Update developer documentation with detailed usage examples and parameter descriptions to facilitate third-party developer integration.4 hours-30 hours--
Task 3Platform Login and Account Management OptimizationEnhance account management features, allowing users to customize personal settings such as time zone, list display count, and fiat currency units. Strengthen account security by adding multi-factor authentication options, enhancing the security of user accounts. Optimize the free API Key acquisition process to make it easier for new users to start using our services.4 hours4 hours20 hours8 hours-
Task 4TokenCurrencyAmountTooltip Component DevelopmentDevelop a new frontend component that supports displaying detailed information such as token name, current exchange rate, and value conversion when hovering over asset amounts. Ensure the component is universal and configurable, reusable in multiple pages and scenarios. Perform cross-browser and multi-device testing to ensure compatibility and responsiveness.4 hours4 hours5 hours8 hours-
Task 5System Security EnhancementImplement real-time and post-event strict security audits on requests in gateways and backend services. This helps to timely detect and prevent potential security risks, ensuring system security and stability. At the same time, introduce detailed log recording to provide important basis for subsequent problem diagnosis, performance analysis, and security audits, allowing developers and operations personnel to clearly understand the system's operating status and request processing situations.4 hours-6 hours4 hours4 hours
Task 6Account Snapshot FunctionDevelop an account snapshot function to periodically record users' asset statuses, supporting historical data queries and comparisons. Optimize data storage methods and indexing structures to ensure high query performance even with large amounts of snapshot data. The frontend provides intuitive snapshot browsing and comparison tools to help users clearly understand changes in their account assets.4 hours4 hours10 hours8 hours2 hours
Task 7Account Search Function Field ExpansionExpand the account search function to support searching accounts through On-chain Identity. Optimize search algorithms to improve the efficiency and accuracy of new field searches, meeting users' diverse search needs. Improve the display of search results to provide richer account information.4 hours-8 hours4 hours-
Task 8Circulation Chart OptimizationAdjust the data classification and display method of the \Other\" category in the circulation pie chart to improve data readability and accuracy. Add interactive features to the chart, such as displaying detailed information on mouse hover, supporting data filtering and dynamic updates,providing a better user experience."4 hours4 hours2 hours8 hours-
Task 9Multi-Chain Token Pricing ConfigurationConfigure pricing logic for XCM and cross-chain assets to support price display for more tokens. Integrate with multiple third-party price sources to ensure the accuracy and real-time of price data. Provide interfaces to allow Token Owners or project parties to submit Token information and price data via GitHub, achieving community co-construction.2 hours-3 hours4 hours2 hours
Task 10Cross-Chain Data Time Filtering Logic FixFix the logical error of the time filter in cross-chain transfer data, ensuring that users can accurately filter and query data according to the specified time range. Add unit tests and integration tests to prevent similar issues from recurring and improve system reliability.--8 hours4 hours-
Task 11Fix Slow NFT Pagination Loading IssueOptimize backend interface query performance by improving database indexes and query statements to reduce data retrieval time. Adjust frontend loading logic by adopting lazy loading and asynchronous loading technologies to reduce initial loading time, improve page response speed, and provide users with a smoother browsing experience.-2 hours8 hours6 hours2 hours
Task 12IPFS Gateway UpdateUpdate the public IPFS gateway address to solve issues with resource loading exceptions and slow access speeds. Add support for multiple IPFS gateways, automatically selecting the fastest gateway for resource loading to improve data availability and stability.--4 hours4 hours1 hour
Task 13Optimize Voting Module Filter FunctionFix display and functionality issues of filters such as \Origins\" \"Action\" \"Proposed by\"and \"Status\" in the voting module. Optimize the response speed of filters and improve frontend interactive experiencemaking it easier for users to find and filter voting information."2 hours-4 hours6 hours-
Task 14Fix Balance Loading Delay IssueCorrect the issue where account balances are not updated in time after unlocking or changes, optimizing the data refresh mechanism. Add real-time detection to ensure that users see the latest balances, improving system reliability and user trust.--8 hours4 hours-
Task 15Fix XCM Multi-Currency Price Parsing ErrorFix the issue of price parsing errors for XCM cross-chain assets, updating price retrieval and calculation logic. Ensure that prices of different currencies can be accurately displayed, supporting more cross-chain assets and enhancing user confidence in cross-chain transactions.--10 hours4 hours-
Task 16Account Snapshot Index ReconstructionReconstruct the Elasticsearch indexing logic of account snapshots, optimizing data structures to reduce index size and improve query performance. Update index creation and update strategies to reduce system load and enhance data processing efficiency.--20 hours-4 hours
Task 17Data Cleaning Mechanism OptimizationImplement an automated data cleaning mechanism to regularly delete expired or invalid historical data, freeing up storage space. Add monitoring and logging for cleaning tasks to ensure the safety and traceability of the data cleaning process, preventing accidental deletion of important data.--14 hours-1 hour
Task 18Migration Task OptimizationOptimize the execution process of large-scale data migration tasks by adopting batch processing and parallel processing technologies to accelerate data migration speed. Add failure retry mechanisms to ensure data integrity and consistency, reducing manual intervention.--14 hours-2 hours
Task 19Performance Monitoring Metrics EnhancementAdd system performance monitoring metrics, including request response time, error rate, resource usage, etc. Implement real-time monitoring and alert mechanisms to promptly discover and handle performance issues, ensuring system stability. Improve the monitoring dashboard to provide intuitive data display and analysis tools.-2 hours8 hours-1 hour
Task 20Asset Page Pagination OptimizationOptimize the pagination loading logic of the asset detail page to reduce server pressure and improve page loading speed. Coordinate frontend and backend pagination to reduce data transmission volume and enhance user experience.-2 hours10 hours4 hours-
Task 21Voting Module Code RefactoringRefactor the code of the voting module, optimizing data structures and algorithms to improve operational efficiency. Enhance code readability and maintainability, laying the foundation for subsequent feature expansions. Add code comments and documentation to facilitate team collaboration.--8 hours8 hours-
Task 22System Resource OptimizationOptimize the system's caching mechanism to reduce disk and memory usage. Optimize database connection pools and query strategies to reduce resource consumption and improve system stability and scalability.--14 hours-1 hour
Task 23Error Log Recording OptimizationStandardize the format and content of error logs by adding error codes, occurrence times, and context information. Implement log classification and filtering functions to help developers quickly locate and resolve issues. Configure log alert mechanisms to promptly notify relevant personnel to handle severe errors.--6 hours4 hours2 hours
Task 24API Performance OptimizationOptimize API interface response speed and reduce data processing time. Conduct special optimizations on frequently used interfaces, including improving query statements, adding indexes, and using caching. Perform stress testing to ensure stability under high concurrency scenarios.--18 hours 2 hours
Task 25API Documentation UpdateUpdate the Subscan Open API documentation by adding explanations and usage examples for new interfaces. Optimize the documentation structure and format to improve readability and usability. Collect developer feedback to continuously improve documentation content, helping third parties better integrate our API.4 hours2 hours2 hours--
Task 26People Polkadot Chain SupportPeople Polkadot Chain Support--4 hours2 hours-
Task 27Page High-Concurrency Request Caching and OptimizationBy caching requests, support differentiated caching times based on the chain settings. Intercept identical high-concurrency requests and return unified results to reduce the number of duplicate requests. This optimizes server pressure, enhances page loading speed, and improves user experience.--8 hours--

Our Compensation Rates and Total Costs:

  • DevOps Engineer: $75/hour
  • Front-End Engineer: $75/hour
  • Back-End Engineer: $75/hour
  • Product Manager/Test: $70/hour
  • Designer: $70/hour

With a total of 466 hours worked, the calculated cost based on the above rates amounts to $34,630.

Advertising Revenue & Offset

From August 6 to December 18, 2024, we tested advertising as a revenue source, generating USD 2,746.12. We will deduct this from our total requested amount to reduce the Treasury’s burden.

Ads remain optional and user-controlled, and based on community feedback, we may refine or discontinue this approach. Users who opt-in may receive future benefits or premium features.

Risk Assessment & Mitigation

  • Rising Storage Costs: We employ automated data cleaning and indexing optimizations to prevent runaway growth.
  • Security & Reliability: Regular audits, real-time monitoring, and DevOps best practices minimize downtime and security threats. We remain responsive to any chain or protocol updates, ensuring compatibility and smooth operation.

Long-Term Sustainability & Vision
Our long-term goal is to reduce reliance on treasury funding through multiple channels:

  • Continuous optimization to limit infrastructure costs as chain data grows.
  • Exploring responsible revenue streams (e.g., optional premium features or partnerships).
  • Actively incorporating community suggestions to ensure value delivery aligns with user needs, increasing platform utility and potential monetization avenues without compromising openness or neutrality.

Total Requested Amount

  • Q3 & Q4 Operations: USD 131,624
  • Q3 Development: USD 34,630
  • Subtract Advertising Revenue: -USD 2,746.12
  • Total: USDT 163,507.88

We are requesting to make this payment using USDT, totaling 163,507.88 USDT.

Conclusion
This proposal reflects our commitment to delivering stable, high-quality infrastructure and valuable features to the Polkadot ecosystem. Through cost optimization, transparent reporting, continuous improvement, and a clear roadmap for future development, we strive to maintain the community’s trust and support. Our approach balances technical rigor, community engagement, and long-term sustainability—ensuring Subscan remains a cornerstone for the Polkadot ecosystem’s data needs.

A heartfelt thank-you to every one of our community members for the time, patience, and continuous feedback you’ve given. With your support, we can keep improving and make our community an even better place—together!

Read more
StatusDeciding · 20d
99%Aye
Aye (132)
20.14M DOT
Nay (8)
29.64K DOT
Decision7 / 28d
0.0%4.16%
3.33%Support Threshold
0Support Threshold
Support(0.25%)
3.82M DOT
Issuance
1.52B DOT
Vote

Kus DAO have voted AYE (first voting).

✅ Critical infrastructure for Polkadot explorers, with updated pricing for cost transparency and stability.

❌ Performance concerns during peak demand (“Spammening”)—are alternatives needed?

 

💪 Get involved: 🔗 Discord Invite or Telegram Invite

💬 Join the discussion: 🔗 Discussion Thread

~@Pieky

18:28

Dear @SUBSCAN,

Thank you for your proposal. Our vote on this proposal is AYE.

The Medium Spender track requires a 50% quorum and simple majority according to our voting policy. This proposal has received seven aye and one nay votes from ten members, with one member abstaining. Below is a summary of our members' comments:

> The referendum received strong support, with most members emphasising Subscan’s role as critical infrastructure for Polkadot and recognising its high value to users. However, some concerns were raised about its closed-source nature and the advertisement of competing ecosystems like Solana on its homepage. One member voted nay to signal dissatisfaction, and another abstained due to mixed opinions, while still acknowledging Subscan's importance. Overall, the proposal was widely supported for its indispensable contributions to the ecosystem.

The full discussion, along with individual members' votes and comments, can be found in our internal voting.

Kind regards,
Permanence DAO

Helixstreet is proud to be able to vote (including with its entrusted votes) in favor of the proposal. Subscan is a pillar of the ecosystem.

@helixstreet.foundation Thank you very much for supporting and voting for our proposal! Your support is invaluable in helping us continue to provide high-quality services to the Polkadot ecosystem.

Jan 4

Helixstreet is proud to be able to vote (including with its entrusted votes) in favor of the proposal. Subscan is a pillar of the ecosystem.

It would be better to remove these ads completely

@Le Comte de Monte-Crypto Thank you very much for your feedback! We value the community's opinions and will carefully assess the impact of ads on user experience. Currently, ads are optional and user-controlled. Based on the community's feedback, we will consider optimizing or completely removing ads to ensure that Subscan provides the best possible experience for all users.

Dec 31, 2024

It would be better to remove these ads completely

Powered by Subsocial