Aleph.im's Scoring System Update: A Look at the New Model for Node Reliability

Understanding Aleph.im's Scoring Mechanism

Aleph.im is rolling out some updates to its scoring system aimed at making node reliability more transparent. This shift is a response to the need for more clarity, especially in a decentralized cloud environment where trust and efficiency are essential. By understanding these updates, node operators can adapt their strategies accordingly in this rapidly changing crypto landscape.

Why Node Reliability Matters in Web3

In decentralized networks, like Aleph.im, the reliability of nodes is crucial. These nodes act as independent servers providing cloud computing resources. Their performance directly affects the network's functionality. Thus, ensuring that nodes operate at a high level is key to maintaining a stable and efficient ecosystem. High-performing nodes promote user trust and engagement, reinforcing the overall framework.

Recent Changes: Advancements in Web 3 Crypto

Current Node Evaluation

Previously, Aleph.im's scoring system evaluated nodes based on metrics spanning a two-week observation period. The bottom 5% of metrics were excluded to reduce noise. While this method had its merits, it also came with some issues: 1. Node operators faced a two-week wait to see if their actions would positively impact their scores. 2. The reference period for score calculations was somewhat arbitrary, making it challenging to distinguish consistently reliable nodes from those that had previously been unreliable.

Improved Metrics

In October, Aleph.im made strides in enhancing metric reliability. They reduced the number of concurrent measurements and expanded measurement locations across continents, cutting down on noise and opening doors to new scoring methodologies.

The New Scoring Model: Aiming for Enhanced Node Performance

Formula Breakdown

The new scoring model discussed in AEP-014 employs a geometric distribution to compute scores. Here's a simplified version of the formula: 1. A multiplier is computed for each hour in the past, derived from two geometric distributions: $$geometric_pmf(p, x) = (1 - p) * p ^ (x - 1)$$ $$multiplier = geometric_pmf(p1, hours_difference) * m1 + geometric_pmf(p2, hours_difference) * m2$$ The parameters $p1$ and $p2$ prioritize recent and older metrics respectively, while $m1$ and $m2$ are proportional multipliers ensuring the total stays within the range $[0…1]$. 2. For each hour, a partial score is calculated based on the measured metrics. The 67th percentile is used while ignoring the worst third. The final score aggregates the multipliers and partial scores over the last year: $$score = \sum_{h=-1}^{history} multiplier(h) * partial_score(h) * version_valid * tuning$$ A tuning number helps keep most nodes' scores between 80% and 100%.

Effects of the Update

This geometric distribution model ensures that while the value declines over time, it never fully disappears. This means that recent metrics hold more weight in influencing the score. Nodes that experience downtime will see their scores rise quickly upon recovery, while nodes that consistently perform well will be recognized through higher scores. The minimum time frame for a new node to attain a score of at least 80% is roughly two weeks.

Implications for Node Operators and Crypto Staking Rewards

The revised scoring system has direct implications for node operators and their compensation. Nodes scoring below 20% do not receive rewards, while those between 20% and 80% receive a proportional amount. Full rewards are given to nodes exceeding 80%, incentivizing operators to maintain high standards and improving overall network reliability.

Importance of Maintenance

To optimize their scores, node operators need to ensure their systems are running the latest software and are equipped with adequate hardware. This includes sufficient CPU, RAM, storage, and bandwidth, along with proper upkeep. Such maintenance is vital for sustaining a high reliability score.

Future Directions: Upcoming Airdrops and Community Engagement

Availability and Feedback

The new scores are now accessible for community feedback on the channel aleph-scoring with the type aleph-scoring-scores-beta by the address 0x4Ec8b55e73F5f32118a90B8FD555706bD5dd42e7.

Development of an HTTP API

Aleph.im is also working on an HTTP API for Core Channel Nodes, allowing for quick estimations of scores without waiting for update publications.

Rollout Timeline

Feedback from users and node operators is being collected over the next ten days. Based on this input, the new scoring system will be deployed across the network starting December 17, 2024. This enhancement is expected to strengthen node reliability and reward distribution, leading to better performance within decentralized networks.

Summary

Aleph.im's new scoring system marks a notable shift towards a more reliable and transparent metric for node performance in decentralized cryptocurrency networks. By implementing a more stable scoring mechanism and rewarding diligent node operators, Aleph.im aims to foster a more resilient and efficient ecosystem.