Upgrade to 10002-rc1
Nov 8th 2021
The upgrade will take place via an on-chain software upgrade proposal passed by Injective governance. If passed, this proposal would commit the Injective Mainnet to halting the Canary Chain injectived
application binary at approximately 14:00 UTC on Nov 8th and starting the application binary for the Injective Canonical Chain.
In case of a failed migration via the upgrade module, the Injective Labs team will post an official injective-canonical-chain
genesis file, but it is recommended that validators should do try to export the genesis on their own node to verify the resulting genesis file.
Following proposal #65 This indicates that the upgrade procedure should be performed on block number 4,352,000.
Summary
The Injective Canary Chain will undergo a scheduled upgrade to Injective Canonical Chain on Monday, November 8th 2021.
The following is a short summary of the upgrade steps:
- Vote and wait till the node panics at block height 4,352,000.
- Backing up configs, data, and keys used for running the Injective Canary Chain.
- Install the Injective 10002-rc1 release
- Start your node with the new injectived binary to fulfill the upgrade.
Upgrade coordination and support for validators will be available on the #mainnet-validators
private channel of the Injective Discord.
The network upgrade can take the following potential pathways:
Happy path
Validators successfully migrate from the Canary chain to Canonical chain without purging the blockchain history and all validators are up within 1-2 hours of the scheduled upgrade.Not-so-happy path
Validators have trouble migrating from the Canary chain to Canonical chain. This could be some consensus breaking changes not covered in upgrade handler, or compatibility issue of the migrated state with new injectived binary, but validators can at least export the genesis.Abort path
In the rare event that the team becomes aware of unnoticed critical issues, the Injective team will attempt to patch all the breaking states and provide another official binary within 36 hours.
If the chain is not successfully resumed within 36 hours, the upgrade will be announced as aborted on the #mainnet-validators channel of Discord, and validators will need to resume running the Canary chain without any updates or changes. A new governance proposal for the upgrade will need to be issued and voted on by the community for the next upgrade.
Risks
As a validator performing the upgrade procedure on your consensus nodes carries a heightened risk of double-signing and being slashed. The most important piece of this procedure is verifying your software version and genesis file hash before starting your validator and signing.
The riskiest thing a validator can do is discover that they made a mistake and repeat the upgrade procedure again during the network startup. If you discover a mistake in the process, the best thing to do is wait for the network to start before correcting it. If the network is halted and you have started with a different genesis file than the expected one, seek advice from an Injective developer before resetting your validator.
Recovery
Prior to exporting the Canary chain state, validators are encouraged to take a full data snapshot at the
export height before proceeding. Snapshotting depends heavily on infrastructure, but generally this
can be done by backing up the .injectived
directory.
It is critically important to backup the .injectived/data/priv_validator_state.json
file after stopping your injectived process. This file is updated every block as your validator participates in a consensus rounds. It is a critical file needed to prevent double-signing, in case the upgrade fails and the previous chain needs to be restarted.
In the event that the upgrade does not succeed, validators and operators must restore the snapshot and downgrade back to Injective Chain 10001-rc7 release and continue the chain until next upgrade announcement.
Upgrade Procedure
Verify you are currently running the correct version (
b174465c
) ofinjectived
:$ injectived version
commit: b174465c
go: go1.16.8After the chain has halted, make a backup of your
.injectived
directorycp ~/.injectived ./injectived-backup
NOTE: It is recommended for validators and operators to take a full data snapshot at the export height before proceeding in case the upgrade does not go as planned or if not enough voting power comes online in a sufficient and agreed upon amount of time. In such a case, the chain will fallback to continue operating the Canary Chain. See Recovery for details on how to proceed.
Download and install the injective-chain
10002-rc1 release
wget https://github.com/InjectiveLabs/injective-chain-releases/releases/download/v1.1.0-1636178708/linux-amd64.zip
unzip linux-amd64.zip
sudo mv injectived peggo /usr/binVerify you are currently running the correct version (
eb018590
) ofinjectived
after downloading the 10002-rc1 release:$ injectived version
commit: eb018590
go: go1.17.2Coordinate to restart your injectived with other validators
injectived start
The binary will perform the upgrade automatically and continue the next consensus round if everything goes well.