v1.1.0 progress

[dindinw]

This is a tracking issue for the QNG version v1.1.0 release

• cleanup the old code
  • fix the https://github.com/Qitmeer/qng/security/code-scanning/5 on BUG:Incorrect conversion between integer types #454
  • open the new encoding. switch to new vmtx encoding && testnet re-genesis #458
• memory alloc improvement
  • fix the alloc issue on engine/txscript.parseScriptTemplate
  • fix the alloc issue on core/types.(*Transaction).decodePrefix
  • fix the alloc issue on core/types.writeTxScriptsToMsgTx
• the CPU profile
  • [x] disable the cgo build by default disable the CGO build by default #456

    2.84s   runtime.cgocall
        github.com/ethereum/go-ethereum/crypto/secp256k1._Cfunc_secp256k1_ext_ecdsa_recover
        github.com/ethereum/go-ethereum/crypto/secp256k1.RecoverPubkey.func1
        github.com/ethereum/go-ethereum/crypto/secp256k1.RecoverPubkey
        github.com/ethereum/go-ethereum/crypto.Ecrecover
        github.com/ethereum/go-ethereum/core/types.recoverPlain
        github.com/ethereum/go-ethereum/core/types.eip2930Signer.Sender
        github.com/ethereum/go-ethereum/core/types.Sender
        github.com/Qitmeer/qng/meerevm/evm.(*VM).validateTx
    

       goos: darwin
       goarch: arm64
       pkg: github.com/ethereum/go-ethereum/crypto
                              │   cgo.txt    │               nocgo.txt               │
                              │    sec/op    │    sec/op     vs base                 │
       Sha3-10                 466.9n ±  0%    466.3n ± 0%         ~ (p=0.117 n=10)
       EcrecoverSignature-10   54.24µ ±  1%   154.16µ ± 1%  +184.25% (p=0.000 n=10)
       VerifySignature-10      44.70µ ±  1%   130.03µ ± 1%  +190.89% (p=0.000 n=10)
       DecompressPubkey-10     5.204µ ± 22%   12.319µ ± 0%  +136.73% (p=0.000 n=10)
       geomean                 8.760µ          18.42µ       +110.28%
    

  • big.nat.make

        math/big.nat.make (inline)
        math/big.nat.shl
        math/big.nat.expNNMontgomery
        math/big.nat.expNN
        math/big.(*Int).exp
        math/big.(*Int).Exp (inline)
        github.com/Qitmeer/qng/crypto/ecc/secp256k1.decompressPoint
        github.com/Qitmeer/qng/crypto/ecc/secp256k1.ParsePubKey
        github.com/Qitmeer/qng/crypto/ecc.newSecp256k1DSA.func12
        github.com/Qitmeer/qng/crypto/ecc.secp256k1DSA.ParsePubKey
        github.com/Qitmeer/qng/core/address.NewSecpPubKeyAddress
        github.com/Qitmeer/qng/core/address.NewSecpPubKeyCompressedAddress
        github.com/Qitmeer/qng/engine/txscript.ExtractPkScriptAddrs
        github.com/Qitmeer/qng/consensus/vm.(*VMTx).SetCoinbaseTx
        github.com/Qitmeer/qng/core/blockchain.CheckTransactionSanity
    

• the gbt 2.0 API && implementation.
  • revisit the gbt 2.0 API
• The gbt performance
  • empty block && duplicated tx analysis
    • 37937 fa28d86595...843fa98961 1222
    • 37936 3d36f76885...fe321c024d 1
    • 37935 83cda6c5f3...d993b3fc4b 1222
  • submit && lock time analysis
    • 4s+ submit time on 1939190 2c4ed7..181243a
• Integrated the go-ethereum v1.12 (https://github.com/ethereum/go-ethereum/releases/tag/v1.12.0)
  • merge v1.12 into V1.12.0 qng go-ethereum#27
  • ethash removed, need to maintain the latest code to the qng code base. see (all: remove ethash pow, only retain shims needed for consensus and tests ethereum/go-ethereum#27178)
  • fixed the API changes on the consensus/consensus.go Upgrade go-ethereum to v1.12.0 #455
• meerpool <-> txpool && performance
  • the already known issue BUG:hastx error #453
  • the rebroadcast issue BUG:rebroadcast remote tx #457
  • local API vs. remote API, might switch back to use txpool.AddRemote BUG:rebroadcast remote tx #457
    • the core/txpool/txpool.go:798] Setting new local account issue
  • the memory leak in the meerpool (see Memory leak on txpool priced urgent list ethereum/go-ethereum#23690) core/txpool/legacypool: reheap the priced list if london fork not enabled ethereum/go-ethereum#27481
    • txpool:reheap the priced list if london fork not enabled go-ethereum#28
    • params: testnet actives the london block on the evm height 22500 #473
• the EIP-4844 change, the bobPool and v1.21.1
  • https://eips.ethereum.org/EIPS/eip-4844#blob-transaction
  • all: move main transaction pool into a subpool ethereum/go-ethereum#27463
• support the performance metrics
  • introduce the basic metrics code && guide for the InfluxDB && Grafana integration metrics #464
  • the mingstats -> the mingstats metrics.
• replace the database layer entirely
  • might be switch to the pebble as backend, now it's the default backend. see (cmd/utils, node: switch to Pebble as the default db if none exists ethereum/go-ethereum#27136)
• support the snapshot state for qng
• improved Integrated Tests env
  • add WMEER test #164
• node Wallet support
  • Wallet modules #353