Skip to main content

Upgrade to 10002-rc2

November 15th 2021

Following proposal #70 This indicates that the upgrade procedure should be performed on block number 4, 594, 100

Summary​

The Injective Canonical Chain will undergo a scheduled upgrade to Injective Canonical Chain on Monday, November 15th 2021.

The following is a short summary of the upgrade steps:

  1. Vote and wait till the node panics at block height 4, 594, 100.
  2. Backing up configs, data, and keys used for running the Injective Canary Chain.
  3. Install the Injective Chain 10002-rc2 release
  4. Start your node with the new injectived binary to fulfill the upgrade.

Upgrade coordination and support for validators will be available on the #mainnet-validators private channel of the Injective Discord.

The network upgrade can take the following potential pathways:

  1. Happy path
    Validators successfully upgrade chain without purging the blockchain history and all validators are up within 1-2 hours of the scheduled upgrade.

  2. Not-so-happy path
    Validators have trouble upgrade chain. This could be some consensus breaking changes not covered in upgrade handler, or compatibility issue of the migrated state with new injectived binary, but validators can at least export the genesis.

  3. Abort path
    In the rare event that the team becomes aware of unnoticed critical issues, the Injective team will attempt to patch all the breaking states and provide another official binary within 36 hours.
    If the chain is not successfully resumed within 36 hours, the upgrade will be announced as aborted on the #mainnet-validators channel of Discord, and validators will need to resume running the chain without any updates or changes. A new governance proposal for the upgrade will need to be issued and voted on by the community for the next upgrade.

Risks​

As a validator performing the upgrade procedure on your consensus nodes carries a heightened risk of double-signing and being slashed. The most important piece of this procedure is verifying your software version and genesis file hash before starting your validator and signing.

The riskiest thing a validator can do is discover that they made a mistake and repeat the upgrade procedure again during the network startup. If you discover a mistake in the process, the best thing to do is wait for the network to start before correcting it. If the network is halted and you have started with a different genesis file than the expected one, seek advice from an Injective developer before resetting your validator.

Recovery​

Prior to exporting thechain state, validators are encouraged to take a full data snapshot at the export height before proceeding. Snapshotting depends heavily on infrastructure, but generally this can be done by backing up the .injectived directory.

It is critically important to backup the .injectived/data/priv_validator_state.json file after stopping your injectived process. This file is updated every block as your validator participates in a consensus rounds. It is a critical file needed to prevent double-signing, in case the upgrade fails and the previous chain needs to be restarted.

In the event that the upgrade does not succeed, validators and operators must restore the snapshot and downgrade back to Injective Chain 10002-rc1 release and continue the chain until next upgrade announcement.

Upgrade Procedure​

  1. Verify you are currently running the correct version (eb018590) of injectived:

    $ injectived version
    commit: eb018590
    Compiled at 20211106-0605 using Go go1.17.2 (amd64)

  2. After the chain has halted, make a backup of your .injectived directory

    cp ~/.injectived ./injectived-backup

    NOTE: It is recommended for validators and operators to take a full data snapshot at the export height before proceeding in case the upgrade does not go as planned or if not enough voting power comes online in a sufficient and agreed upon amount of time. In such a case, the chain will fallback to continue operating. See Recovery for details on how to proceed.

  3. Download and install the injective-chain 10002-rc2 release

    wget https://github.com/InjectiveLabs/injective-chain-releases/releases/download/v1.1.1-1636733798/linux-amd64.zip
    unzip linux-amd64.zip
    sudo mv injectived peggo /usr/bin

  4. Verify you are currently running the correct version (096cbe5) of injectived after downloading the 10002-rc2 release:

    $ injectived version
    Version dev (096cbe5)
    Compiled at 20211112-1620 using Go go1.17.2 (amd64)

  5. Coordinate to restart your injectived with other validators

    injectived start

    The binary will perform the upgrade automatically and continue the next consensus round if everything goes well.