Transaction stays pending forever because of poor peering on leap node

[Joshua2Mars]

The contract is rejecting with: "assertion failure with message: validate_transaction error" when the tx is pushed by the enf.miner

The problem seems to be poor peering on our leap node, tx gets applied locally (nonce + balance increase) looks like it never reaches other nodes (old nonce + old balance when inspecting the state of the evm contract in other mainnet nodes), so the tx never gets into the eos-evm, and then metmask retries the tx and we see a lot of errors in the tx_wrapper logs.

We need to think about how to prevent it.

[heifner]

Consider using /v1/chain/send_transaction2 option of retry_trx = true with retry_trx_num_blocks to something like 13 which should be more than enough to assume it will not be forked out.