Sui Reveals What Caused Three Mainnet Halts After Upgrade

Trusted Editorial content material, reviewed by main trade specialists and seasoned editors. Advert Disclosure

Sui’s mainnet suffered three separate outages throughout Could 28 and Could 29 after the community’s 1.72 launch uncovered edge circumstances in fuel charging and validator restart logic, based on a postmortem from the Sui Basis. The inspiration mentioned the problems have since been resolved, community exercise has resumed, and “no person funds had been in danger.”

The incidents started on Thursday, Could 28, when Sui’s mainnet halted at round 7 a.m. PT and remained down till roughly 1:30 p.m. PT. A second outage adopted on Friday morning, beginning at about 5 a.m. PT and ending round 8:30 a.m. PT. The third halt started Friday afternoon at roughly 1:30 p.m. PT and was resolved round 7:20 p.m. PT.

In line with the muse, the primary two outages stemmed from crash bugs involving the interplay between fuel charging logic and Sui’s 1.72 improve, which launched tackle balances. The third outage was separate, triggered throughout a scheduled epoch change after validator restarts uncovered a latent bug in how randomness state was preserved.

“Throughout the outages, no person funds had been in danger, and the community didn’t revert any dedicated transactions when it resumed,” the Sui Basis mentioned. “As of now, validators have absolutely addressed the recognized points brought on by each the unique gas-charging bug and the randomness-state bug, and community exercise has resumed.”

Sui Gasoline Charging Bug Triggered Preliminary Halts

The primary downside centered on Sui’s new tackle steadiness characteristic, which permits customers to retailer funds and pay for fuel with out relying solely on coin objects. Transactions on Sui will pay fuel via tackle balances, coin objects, or a hybrid construction combining each.

The sting case emerged in that hybrid fuel path. When a transaction tried to spend from an tackle steadiness that might not cowl competing transactions, the scheduler appropriately cancelled it with an InsufficientFundsForWithdraw error. However later, throughout fuel smashing — the method of mixing enter cash right into a single gas-paying coin — the identical reservation may nonetheless try to debit funds once more.

Within the basis’s clarification, the crash didn’t happen instantly throughout fuel smashing however throughout settlement, when steadiness deltas had been reconciled by a system transaction. A damaging delta utilized to a zero steadiness brought about an underflow.

The rapid repair was conceptually easy: keep away from fuel smashing when a transaction is cancelled with InsufficientFundsForWithdraw. Validators adopted that repair on Thursday, bringing the community again on-line. However the basis acknowledged that the patch was an interim measure, chosen to revive the community whereas engineers developed a extra full answer.

“Altering fuel logic is a fragile operation,” the muse wrote. “As defined above, there are sophisticated interactions between tackle balances and cash. Aside from fixing bugs, fuel logic modifications should protect all earlier conduct or use acceptable model gating.”

That interim patch contained a recognized weak spot. If a transaction had a number of cancellation causes, one other error may masks the InsufficientFundsForWithdraw situation. When that occurred Friday morning, the unique underflow path may nonetheless be reached, inflicting a second halt.

Epoch Change Uncovered Randomness-State Bug

The third outage got here after the community had resumed regular operation Friday morning. On the subsequent scheduled epoch change, validators failed to finish the transition due to a bug tied to Sui’s distributed key era protocol, or DKG, which bootstraps randomness for transactions that rely on on-chain randomness.

Throughout the earlier restart cycle, participation was not excessive sufficient for the subsequent epoch’s DKG course of, so randomness was disabled as designed. The issue was that the failure verdict was not written to disk. As validators restarted once more, they got here again up with out remembering that DKG had failed.

“With validators not remembering DKG had failed, neither may occur, the paused queue grew, and end-of-epoch logic — which should drain that queue earlier than closing — was left ready on DKG that may by no means come,” the muse mentioned.

The repair had two elements: persisting DKG standing throughout restarts and including a mechanism that allowed validators to shut the caught epoch at a coordinated level. That mechanism was used as soon as to shut the affected epoch, after which the community moved into the subsequent epoch and randomness was restored.

The postmortem framed the outages as a broader engineering lesson for Sui. The inspiration mentioned end-of-epoch resilience wants additional funding, significantly round swish degradation and operational force-close mechanisms. It additionally mentioned fuel charging deserves the identical degree of rigor because the Transfer VM or Mysticeti consensus, given its interplay with settlement, conservation checks, and scheduling.

At press time, SUI traded at $0.8798.

Featured picture created with DALL.E, chart from TradingView.com

Editorial Course of for bitcoinist is centered on delivering completely researched, correct, and unbiased content material. We uphold strict sourcing requirements, and every web page undergoes diligent assessment by our crew of high expertise specialists and seasoned editors. This course of ensures the integrity, relevance, and worth of our content material for our readers.