op-reth: deposit type txs are skipped when building block due to GasPriceLessThanBasefee - possibly due to revm 4/5+

[zilayo]

Describe the bug

Running op-reth on v0.1.0-alpha.18

rollup node sends engine_forkchoiceUpdatedV2 with 2 x 0x7E deposit type txs, and 5 regular txs.

Op-Reth receives, but fails to execute the 2 deposit type txs. The remaining 5 txs are successfully executed and included in the built block/payload.

2024-02-13T22:08:01.602476Z TRACE payload_builder: Error in sequencer transaction, skipping. err=GasPriceLessThanBasefee sequencer_tx=TransactionSignedEcRecovered { signer: 0xdeaddeaddeaddeaddeaddeaddeaddeaddead0001, signed_transaction: TransactionSigned { hash: 0x0e857b761b597ab9822686094f163b2854fbe8bab1605db314085598f907c633, signature: Signature { r: 0x0_U256, s: 0x0_U256, odd_y_parity: false }, transaction: Deposit(TxDeposit { source_hash: 0xa47b9fcfd83f311f99381963ddc4ed2c3dfb0237772d51aca1446efff4fd2ad1, from: 0xdeaddeaddeaddeaddeaddeaddeaddeaddead0001, to: Call(0x4200000000000000000000000000000000000015), mint: None, value: TxValue(0x0_U256), gas_limit: 1000000, is_system_transaction: false, input: 0x015d8eb90000000000000000000000000000000000000000000000000000000001252b530000000000000000000000000000000000000000000000000000000065ca47630000000000000000000000000000000000000000000000000000000905c8d3ca0e3da5fbee17c50ce24e742ebefa28907988cc116221ca539de59464a6d6b4d8000000000000000000000000000000000000000000000000000000000000000000000000000000000000000099199a22125034c808ff20f377d91187e8050f2e00000000000000000000000000000000000000000000000000000000000000bc00000000000000000000000000000000000000000000000000000000000a6fe0 }) } }
2024-02-13T22:08:01.610052Z TRACE payload_builder: Error in sequencer transaction, skipping. err=GasPriceLessThanBasefee sequencer_tx=TransactionSignedEcRecovered { signer: 0xa6ceca6c8edeb69c98bd5bd17660bacef1299b80, signed_transaction: TransactionSigned { hash: 0xa23e0e1ee8870ddc4e5c1b9c45cfd0d8f852a15ff5538df5f9299a9ebc9da2bd, signature: Signature { r: 0x0_U256, s: 0x0_U256, odd_y_parity: false }, transaction: Deposit(TxDeposit { source_hash: 0xd556217e25d9513b4eea5ae2bd9aea5eef4853caeec38d16230c42fac3eb5719, from: 0xa6ceca6c8edeb69c98bd5bd17660bacef1299b80, to: Call(0x4200000000000000000000000000000000000007), mint: Some(12000000000000000), value: TxValue(0x000000000000000000000000000000000000000000000000002aa1efb94e0000_U256), gas_limit: 288136, is_system_transaction: false, input: 0xd764ad0b000100000000000000000000000000000000000000000000000000000001b8cd000000000000000000000000735adbbe72226bd52e818e7181953f42e3b0ff210000000000000000000000004200000000000000000000000000000000000010000000000000000000000000000000000000000000000000002aa1efb94e0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000c000000000000000000000000000000000000000000000000000000000000000c41635f5fd0000000000000000000000002971b9b03e665b81a4a322eac998ce4e0693f7dc0000000000000000000000002971b9b03e665b81a4a322eac998ce4e0693f7dc000000000000000000000000000000000000000000000000002aa1efb94e00000000000000000000000000000000000000000000000000000000000000000080000000000000000000000000000000000000000000000000000000000000001e55625344576b4c56485a6f307330567a3738495446373044686d56624158000000000000000000000000000000000000000000000000000000000000 }) } }

The end result is a new payload is built that is missing the deposit txs, which is then sent to the rollup.
Subsequent derivation then fails due to the built block being an invalid parent for future blocks.

I'm still trying to figure out where this bug was introduced. Previously was running on v0.1.0-alpha.16 with no issues, so it's possible that this revm version bump caused it #6357, or the bump to revm 5.0 #6560.

This could maybe be solely an revm issue, or it may be due to reth not being configured properly for the latest revm versions.

The issue was also occurring on commit 0e166f0.

note - I'm running a very lightly modified version of op-reth to support an additional chain (mode) which is a vanilla op-stack rollup. Only reth modifications are adding the genesis, chain spec, etc and dependencies such as alloy-chains already support this chain. Reth has been working fine for this chain up until upgrading reth versions.

Steps to reproduce

can possibly replicate via reth debug build-block using an op-stack db + chain and the transaction param as follows:

0x7ef90159a0a47b9fcfd83f311f99381963ddc4ed2c3dfb0237772d51aca1446efff4fd2ad194deaddeaddeaddeaddeaddeaddeaddeaddead00019442000000000000000000000000000000000000158080830f424080b90104015d8eb90000000000000000000000000000000000000000000000000000000001252b530000000000000000000000000000000000000000000000000000000065ca47630000000000000000000000000000000000000000000000000000000905c8d3ca0e3da5fbee17c50ce24e742ebefa28907988cc116221ca539de59464a6d6b4d8000000000000000000000000000000000000000000000000000000000000000000000000000000000000000099199a22125034c808ff20f377d91187e8050f2e00000000000000000000000000000000000000000000000000000000000000bc00000000000000000000000000000000000000000000000000000000000a6fe0","0x7ef90227a0d556217e25d9513b4eea5ae2bd9aea5eef4853caeec38d16230c42fac3eb571994a6ceca6c8edeb69c98bd5bd17660bacef1299b80944200000000000000000000000000000000000007872aa1efb94e0000872aa1efb94e00008304658880b901c4d764ad0b000100000000000000000000000000000000000000000000000000000001b8cd000000000000000000000000735adbbe72226bd52e818e7181953f42e3b0ff210000000000000000000000004200000000000000000000000000000000000010000000000000000000000000000000000000000000000000002aa1efb94e0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000c000000000000000000000000000000000000000000000000000000000000000c41635f5fd0000000000000000000000002971b9b03e665b81a4a322eac998ce4e0693f7dc0000000000000000000000002971b9b03e665b81a4a322eac998ce4e0693f7dc000000000000000000000000000000000000000000000000002aa1efb94e00000000000000000000000000000000000000000000000000000000000000000080000000000000000000000000000000000000000000000000000000000000001e55625344576b4c56485a6f307330567a3738495446373044686d56624158000000000000000000000000000000000000000000000000000000000000","0x02f9015282868b188459682f00845968302e83041dc994e063be26aaeb50db3866a7534551aa789bc368b780b8e42c31b5e40000000000000000000000004200000000000000000000000000000000000006000000000000000000000000f0f161fda2712db8b566946122a5af183995e2ed0000000000000000000000000000000000000000000000000000000000b579080000000000000000000000000000000000000000000000000000000000000001000000000000000000000000000000000000000000000000000000000000000200000000000000000000000000000000000000000000000000000000000000000000000000000000000000001a32c1d56b573717af7c47720a712a5c0dc51b96c001a0e3bc60dc06e5c780b77cbc348c305e7b5066815e7a988b58e19de6a970c8a7c0a057251d4d94f5c4a9959247b58bd54de028c70d9850d10ebb76f5ed21776794a1","0x02f89182868b0e8459682f00845968302e83080f309494812f2eea03a49869f95e1b5868c6f3206ee3d380a4a0712d68000000000000000000000000000000000000000000000000000000000791ddc0c080a06226cee037ad6355b36f2937f7330bfff1df30d457b0a19c393a0d17c120570ca00b6f102cd366b2d65f7892513db67831d09bbb1ecfd81283a65f93933399d3bb","0x02f87382868b808459682f00845968302e82520894e4edb277e41dc89ab076a1f049f4a3efa700bce8871c6bf52634232a80c001a0098d5a38049f333a86509ac184cc1712f02bf3936d169213dc084f68bfe8814da0247d639d64afcd4514db8857e109184fa9e7b3fc54cab05a5a452e8bb07b2107","0x01f88a82868b23831250ae82a88494420000000000000000000000000000000000000680a42e1a7d4d000000000000000000000000000000000000000000000000007eabbe3c8fa9c7c001a0cd801a3bc4742a023a1cc03dad106a44151e164f03958f9bee6f8f88e076945ba01fc4edba17476e8ba385b3967cad5c07e7e5651f7715bb1c1a2b9ad2ec495169","0x02f87082868b8212528227108227108401ba814094bc53db1f6ac226f616355fb16b8182eee49b932f07840b040201c001a08c17dea50e7a6b4ee85b20effa0dc5d0ec69cac63dd096be2cde14066a65b3e4a057b13d4238eeec6626dba032c9bf2113b57de9a91979c3be46795c53490b4e9b

Node logs

engine receives forkchoiceUpdatedV2 message with attributes:

02-13T22:08:01.600403Z TRACE method_call{method="engine_forkchoiceUpdatedV2"}: jsonrpsee_core::tracing: recv="{\"jsonrpc\":\"2.0\",\"id\":1,\"method\":\"engine_forkchoiceUpdatedV2\",\"params\":[{\"finalizedBlockHash\":\"0xe197417a42e6e52dec0b8e7ce97d526bf6a0b67106ca66f37136ed03e887876b\",\"headBlockHash\":\"0xe197417a42e6e52dec0b8e7ce97d526bf6a0b67106ca66f37136ed03e887876b\",\"safeBlockHash\":\"0xe197417a42e6e52dec0b8e7ce97d526bf6a0b67106ca66f37136ed03e887876b\"},{\"gasLimit\":\"0x1c9c380\",\"noTxPool\":true,\"prevRandao\":\"0xcf498c744a7649a89f27ae716c880ffc35a4fff84ff0a4a0826ad7672c4864ac\",\"suggestedFeeRecipient\":\"0x4200000000000000000000000000000000000011\",\"timestamp\":\"0x65ca47a1\",\"transactions\":[\"0x7ef90159a0a47b9fcfd83f311f99381963ddc4ed2c3dfb0237772d51aca1446efff4fd2ad194deaddeaddeaddeaddeaddeaddeaddeaddead00019442000000000000000000000000000000000000158080830f424080b90104015d8eb90000000000000000000000000000000000000000000000000000000001252b530000000000000000000000000000000000000000000000000000000065ca47630000000000000000000000000000000000000000000000000000000905c8d3ca0e3da5fbee17c50ce24e742ebefa28907988cc116221ca539de59464a6d6b4d8000000000000000000000000000000000000000000000000000000000000000000000000000000000000000099199a22125034c808ff20f377d91187e8050f2e00000000000000000000000000000000000000000000000000000000000000bc00000000000000000000000000000000000000000000000000000000000a6fe0\",\"0x7ef90227a0d556217e25d9513b4eea5ae2bd9aea5eef4853caeec38d16230c42fac3eb571994a6ceca6c8edeb69c98bd5bd17660bacef1299b80944200000000000000000000000000000000000007872aa1efb94e0000872aa1efb94e00008304658880b901c4d764ad0b000100000000000000000000000000000000000000000000000000000001b8cd000000000000000000000000735adbbe72226bd52e818e7181953f42e3b0ff210000000000000000000000004200000000000000000000000000000000000010000000000000000000000000000000000000000000000000002aa1efb94e0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000c000000000000000000000000000000000000000000000000000000000000000c41635f5fd0000000000000000000000002971b9b03e665b81a4a322eac998ce4e0693f7dc0000000000000000000000002971b9b03e665b81a4a322eac998ce4e0693f7dc000000000000000000000000000000000000000000000000002aa1efb94e00000000000000000000000000000000000000000000000000000000000000000080000000000000000000000000000000000000000000000000000000000000001e55625344576b4c56485a6f307330567a3738495446373044686d56624158000000000000000000000000000000000000000000000000000000000000\",\"0x02f9015282868b188459682f00845968302e83041dc994e063be26aaeb50db3866a7534551aa789bc368b780b8e42c31b5e40000000000000000000000004200000000000000000000000000000000000006000000000000000000000000f0f161fda2712db8b566946122a5af183995e2ed0000000000000000000000000000000000000000000000000000000000b579080000000000000000000000000000000000000000000000000000000000000001000000000000000000000000000000000000000000000000000000000000000200000000000000000000000000000000000000000000000000000000000000000000000000000000000000001a32c1d56b573717af7c47720a712a5c0dc51b96c001a0e3bc60dc06e5c780b77cbc348c305e7b5066815e7a988b58e19de6a970c8a7c0a057251d4d94f5c4a9959247b58bd54de028c70d9850d10ebb76f5ed21776794a1\",\"0x02f89182868b0e8459682f00845968302e83080f309494812f2eea03a49869f95e1b5868c6f3206ee3d380a4a0712d68000000000000000000000000000000000000000000000000000000000791ddc0c080a06226cee037ad6355b36f2937f7330bfff1df30d457b0a19c393a0d17c120570ca00b6f102cd366b2d65f7892513db67831d09bbb1ecfd81283a65f93933399d3bb\",\"0x02f87382868b808459682f00845968302e82520894e4edb277e41dc89ab076a1f049f4a3efa700bce8871c6bf52634232a80c001a0098d5a38049f333a86509ac184cc1712f02bf3936d169213dc084f68bfe8814da0247d639d64afcd4514db8857e109184fa9e7b3fc54cab05a5a452e8bb07b2107\",\"0x01f88a82868b23831250ae82a88494420000000000000000000000000000000000000680a42e1a7d4d000000000000000000000000000000000000000000000000007eabbe3c8fa9c7c001a0cd801a3bc4742a023a1cc03dad106a44151e164f03958f9bee6f8f88e076945ba01fc4edba17476e8ba385b3967cad5c07e7e5651f7715bb1c1a2b9ad2ec495169\",\"0x02f87082868b8212528227108227108401ba814094bc53db1f6ac226f616355fb16b8182eee49b932f07840b040201c001a08c17dea50e7a6b4ee85b20effa0dc5d0ec69cac63dd096be2cde14066a65b3e4a057b13d4238eeec6626dba032c"

engine returns payload ID to rollup:

2024-02-13T22:08:01.601710Z  INFO reth_payload_builder::service: New payload job created id=0x1d327442f9829071 parent=0xe197417a42e6e52dec0b8e7ce97d526bf6a0b67106ca66f37136ed03e887876b
2024-02-13T22:08:01.601732Z TRACE method_call{method="engine_forkchoiceUpdatedV2"}: jsonrpsee_core::tracing: send="{\"jsonrpc\":\"2.0\",\"result\":{\"payloadStatus\":{\"status\":\"VALID\",\"latestValidHash\":\"0xe197417a42e6e52dec0b8e7ce97d526bf6a0b67106ca66f37136ed03e887876b\",\"validationError\":null},\"payloadId\":\"0x1d327442f9829071\"},\"id\":1}"

reth begins building the block:

2024-02-13T22:08:01.601786Z TRACE payload_builder: spawn new payload build task
2024-02-13T22:08:01.602351Z DEBUG payload_builder: building new payload id=0x1d327442f9829071 parent_hash=0xe197417a42e6e52dec0b8e7ce97d526bf6a0b67106ca66f37136ed03e887876b parent_number=3793920
2024-02-13T22:08:01.602476Z TRACE payload_builder: Error in sequencer transaction, skipping. err=GasPriceLessThanBasefee sequencer_tx=TransactionSignedEcRecovered { signer: 0xdeaddeaddeaddeaddeaddeaddeaddeaddead0001, signed_transaction: TransactionSigned { hash: 0x0e857b761b597ab9822686094f163b2854fbe8bab1605db314085598f907c633, signature: Signature { r: 0x0_U256, s: 0x0_U256, odd_y_parity: false }, transaction: Deposit(TxDeposit { source_hash: 0xa47b9fcfd83f311f99381963ddc4ed2c3dfb0237772d51aca1446efff4fd2ad1, from: 0xdeaddeaddeaddeaddeaddeaddeaddeaddead0001, to: Call(0x4200000000000000000000000000000000000015), mint: None, value: TxValue(0x0_U256), gas_limit: 1000000, is_system_transaction: false, input: 0x015d8eb90000000000000000000000000000000000000000000000000000000001252b530000000000000000000000000000000000000000000000000000000065ca47630000000000000000000000000000000000000000000000000000000905c8d3ca0e3da5fbee17c50ce24e742ebefa28907988cc116221ca539de59464a6d6b4d8000000000000000000000000000000000000000000000000000000000000000000000000000000000000000099199a22125034c808ff20f377d91187e8050f2e00000000000000000000000000000000000000000000000000000000000000bc00000000000000000000000000000000000000000000000000000000000a6fe0 }) } }```

Platform(s)

Linux (x86)

What version/commit are you on?

v0.1.0-alpha.18

What database version are you on?

Current database version: 1

What type of node are you running?

Full via --full flag

What prune config do you use, if any?

default

If you've built Reth from source, provide the full command you used

cargo build --profile release --locked --bin op-reth --features "optimism,jemalloc,asm-keccak"

Code of Conduct

• I agree to follow the Code of Conduct

[mattsse]

ptal @rakita

[zilayo]

The issue seems to be with the evm config

reth/crates/payload/optimism/src/lib.rs

Lines 304 to 321 in 11dbd08

	let mut evm = revm::Evm::builder()
	.with_db(&mut db)
	.with_env_with_handler_cfg(EnvWithHandlerCfg::new_with_cfg_env(
	initialized_cfg.clone(),
	initialized_block_env.clone(),
	tx_env_with_recovered(&sequencer_tx),
	))
	.build();
	let ResultAndState { result, state } = match evm.transact() {
	Ok(res) => res,
	Err(err) => {
	match err {
	EVMError::Transaction(err) => {
	trace!(target: "payload_builder", ?err, ?sequencer_tx, "Error in sequencer transaction, skipping.");
	continue
	}
	err => {

Reth creates a handler config via EnvWithHandlerCfg::new_with_cfg_env(...) - https://github.com/bluealloy/revm/blob/0651044b7ad7e8eaacf6650d64abb7a927e867f3/crates/primitives/src/env/handler_cfg.rs#L114-L130

The cfg argument being passed here (initialized_cfg) is set by Reth via PayloadConfig<Attributes>::new() -> Attributes::cfg_and_block_env -> CfgEnvWithHandlerCfg::new(): https://github.com/bluealloy/revm/blob/0651044b7ad7e8eaacf6650d64abb7a927e867f3/crates/primitives/src/env/handler_cfg.rs#L57-L69

Note is_optimism is false by default.

Going back to EnvWithHandlerCfg::new_with_cfg_env(...) - cfg.handler.is_optimism is false as above, so is_optimism is never enabled in the if statement:

if cfg.handler_cfg.is_optimism {
                    new.enable_optimism()
                }

so with_env_with_handler_cfg is passed a an EnvWithHandlerCfg where is_optimism is false.

builder::with_env_with_handler_cfg creates an EvmBuilder via handler: EvmBuilder::<'a, HandlerStage, EXT, DB>::handler(handler_cfg), with the handler_cfg from above.

EvmBuilder::handler() -> EvmHandler::Handler() -> Handler::mainnet_with_spec(cfg.spec_id) due to is_optimism being false.

ultimately it fails to call optimism_handle_register() and so validate_env() doesn't use the optimism logic which is to skip validation checks for deposit txs.

Instead it uses mainnet logic which checks the gas price against the base fee and returns a GasPriceLessThanBasefee error which is what I see in my logs.

just seen a new PR was submitted as I was typing this lol - will post anyway just in case this doesn't fix #6593

[zilayo]

#6593

reth-node-api doesn't have optimism feature. I think this is why it's still failing

[zilayo]

#6598 fixes the block/payload building issue, but now there's an error during block validation after receiving engine_newPayloadV2 with the payload param being the previously built payload.

2024-02-14T09:41:47.872380Z DEBUG payload_builder: building new payload id=0x1d327442f9829071 parent_hash=0xe197417a42e6e52dec0b8e7ce97d526bf6a0b67106ca66f37136ed03e887876b parent_number=3793920
2024-02-14T09:41:48.217934Z DEBUG payload_builder: sealed built block sealed_block=SealedBlock { header: SealedHeader { header: Header { parent_hash: 0xe197417a42e6e52dec0b8e7ce97d526bf6a0b67106ca66f37136ed03e887876b, ommers_hash: 0x1dcc4de8dec75d7aab85b567b6ccd41ad312451b948a7413f0a142fd40d49347, beneficiary: 0x4200000000000000000000000000000000000011, state_root: 0x8c1d67e0b4f0321cd5d70716d5f6bd2f5e0f89bd5067d3a7dab117581e942660, transactions_root: 0x3e760936e98de22584f54370e6f620c396986b589dbe1ac4a511ebcbd0dc5802, receipts_root: 0xf3af27b92cf7ecf2170788a36a93d37688a23c18dba1cf95d43d4dedbf121c48, withdrawals_root: Some(0x56e81f171bcc55a6ff8345e692c0f86e5b48e01b996cadc001622fb5e363b421), logs_bloom: 0x0020400040200800000100008000000002000001000040000006000000100100080040000000008101000014102200000100000000000003000100000420020004020000004400000001000810000120008080001040000000010000400000014000000c020000400000000000020a2000002012000a044408020018000000000000002000004084401000040000001901800000012010080000004000000080020000080080040020000010000000000200200000000090000100000000000000000002000000000000000100020000840002100000001000000002a000a0101010000000100040000000000000000000200000001002001000000808080000, difficulty: 0x0_U256, number: 3793921, gas_limit: 30000000, gas_used: 4778384, timestamp: 1707755425, mix_hash: 0xcf498c744a7649a89f27ae716c880ffc35a4fff84ff0a4a0826ad7672c4864ac, nonce: 0, base_fee_per_gas: Some(252), blob_gas_used: None, excess_blob_gas: None, parent_beacon_block_root: None, extra_data: 0x }, hash: 0x8cd7dbeb6972a08083d9a0edbcc7aeb0e4b0bd420fa407d5501a85779d0aaa40 }, body: [TransactionSigned { hash: 0x0e857b761b597ab9822686094f163b2854fbe8bab1605db314085598f907c633, signature: Signature { r: 0x0_U256, s: 0x0_U256, odd_y_parity: false }, transaction: Deposit(TxDeposit { source_hash: 0xa47b9fcfd83f311f99381963ddc4ed2c3dfb0237772d51aca1446efff4fd2ad1, from: 0xdeaddeaddeaddeaddeaddeaddeaddeaddead0001, to: Call(0x4200000000000000000000000000000000000015), mint: None, value: TxValue(0x0_U256), gas_limit: 1000000, is_system_transaction: false, input: 0x015d8eb90000000000000000000000000000000000000000000000000000000001252b530000000000000000000000000000000000000000000000000000000065ca47630000000000000000000000000000000000000000000000000000000905c8d3ca0e3da5fbee17c50ce24e742ebefa28907988cc116221ca539de59464a6d6b4d8000000000000000000000000000000000000000000000000000000000000000000000000000000000000000099199a22125034c808ff20f377d91187e8050f2e00000000000000000000000000000000000000000000000000000000000000bc00000000000000000000000000000000000000000000000000000000000a6fe0 }) }, TransactionSigned { hash: 0xa23e0e1ee8870ddc4e5c1b9c45cfd0d8f852a15ff5538df5f9299a9ebc9da2bd, signature: Signature { r: 0x0_U256, s: 0x0_U256, odd_y_parity: false }, transaction: Deposit(TxDeposit { source_hash: 0xd556217e25d9513b4eea5ae2bd9aea5eef4853caeec38d16230c42fac3eb5719, from: 0xa6ceca6c8edeb69c98bd5bd17660bacef1299b80, to: Call(0x4200000000000000000000000000000000000007), mint: Some(12000000000000000), value: TxValue(0x000000000000000000000000000000000000000000000000002aa1efb94e0000_U256), gas_limit: 288136, is_system_transaction: false, input: 0xd764ad0b000100000000000000000000000000000000000000000000000000000001b8cd000000000000000000000000735adbbe72226bd52e818e7181953f42e3b0ff210000000000000000000000004200000000000000000000000000000000000010000000000000000000000000000000000000000000000000002aa1efb94e0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000c000000000000000000000000000000000000000000000000000000000000000c41635f5fd0000000000000000000000002971b9b03e665b81a4a322eac998ce4e0693f7dc0000000000000000000000002971b9b03e665b81a4a322eac998ce4e0693f7dc000000000000000000000000000000000000000000000000002aa1efb94e00000000000000000000000000000000000000000000000000000000000000000080000000000000000000000000000000000000000000000000000000000000001e55625344576b4c56485a6f307330567a3738495446373044686d56624158000000000000000000000000000000000000000000000000000000000000 }) }, TransactionSigned { hash: 0xcdd1086b7dd8f7925ab9149401a9526b6ecd31da560537e5a47fc82c61163b0a, signature: Signature { r: 0xe3bc60dc06e5c780b77cbc348c305e7b5066815e7a988b58e19de6a970c8a7c0_U256, s: 0x57251d4d94f5c4a9959247b58bd54de028c70d9850d10ebb76f5ed21776794a1_U256, odd_y_parity: true }, transaction: Eip1559(TxEip1559 { chain_id: 34443, nonce: 24, gas_limit: 269769, max_fee_per_gas: 1500000302, max_priority_fee_per_gas: 1500000000, to: Call(0xe063be26aaeb50db3866a7534551aa789bc368b7), value: TxValue(0x0_U256), access_list: AccessList([]), input: 0x2c31b5e40000000000000000000000004200000000000000000000000000000000000006000000000000000000000000f0f161fda2712db8b566946122a5af183995e2ed0000000000000000000000000000000000000000000000000000000000b579080000000000000000000000000000000000000000000000000000000000000001000000000000000000000000000000000000000000000000000000000000000200000000000000000000000000000000000000000000000000000000000000000000000000000000000000001a32c1d56b573717af7c47720a712a5c0dc51b96 }) }, TransactionSigned { hash: 0xe135ddfb6913c94b003927744dfbd93588bd901f81efaca20c2469cbc6f43ae7, signature: Signature { r: 0x6226cee037ad6355b36f2937f7330bfff1df30d457b0a19c393a0d17c120570c_U256, s: 0x0b6f102cd366b2d65f7892513db67831d09bbb1ecfd81283a65f93933399d3bb_U256, odd_y_parity: false }, transaction: Eip1559(TxEip1559 { chain_id: 34443, nonce: 14, gas_limit: 528176, max_fee_per_gas: 1500000302, max_priority_fee_per_gas: 1500000000, to: Call(0x94812f2eea03a49869f95e1b5868c6f3206ee3d3), value: TxValue(0x0_U256), access_list: AccessList([]), input: 0xa0712d68000000000000000000000000000000000000000000000000000000000791ddc0 }) }, TransactionSigned { hash: 0xa0e64155b3c6b70529b2021337f99d905f9724c6c9d4d0911cc7ab3082be3cee, signature: Signature { r: 0x098d5a38049f333a86509ac184cc1712f02bf3936d169213dc084f68bfe8814d_U256, s: 0x247d639d64afcd4514db8857e109184fa9e7b3fc54cab05a5a452e8bb07b2107_U256, odd_y_parity: true }, transaction: Eip1559(TxEip1559 { chain_id: 34443, nonce: 0, gas_limit: 21000, max_fee_per_gas: 1500000302, max_priority_fee_per_gas: 1500000000, to: Call(0xe4edb277e41dc89ab076a1f049f4a3efa700bce8), value: TxValue(0x000000000000000000000000000000000000000000000000001c6bf52634232a_U256), access_list: AccessList([]), input: 0x }) }, TransactionSigned { hash: 0xffae0e0ddc5433dd24a22f8383b08b2eb28e8dab9a931a315942da6c17c8899e, signature: Signature { r: 0xcd801a3bc4742a023a1cc03dad106a44151e164f03958f9bee6f8f88e076945b_U256, s: 0x1fc4edba17476e8ba385b3967cad5c07e7e5651f7715bb1c1a2b9ad2ec495169_U256, odd_y_parity: true }, transaction: Eip2930(TxEip2930 { chain_id: 34443, nonce: 35, gas_price: 1200302, gas_limit: 43140, to: Call(0x4200000000000000000000000000000000000006), value: TxValue(0x0_U256), access_list: AccessList([]), input: 0x2e1a7d4d000000000000000000000000000000000000000000000000007eabbe3c8fa9c7 }) }, TransactionSigned { hash: 0xba64c9aced320fdaaf824a5a111296d97ba29fdcf2d968a83574ea8983d5e66c, signature: Signature { r: 0x8c17dea50e7a6b4ee85b20effa0dc5d0ec69cac63dd096be2cde14066a65b3e4_U256, s: 0x57b13d4238eeec6626dba032c9bf2113b57de9a91979c3be46795c53490b4e9b_U256, odd_y_parity: true }, transaction: Eip1559(TxEip1559 { chain_id: 34443, nonce: 4690, gas_limit: 29000000, max_fee_per_gas: 10000, max_priority_fee_per_gas: 10000, to: Call(0xbc53db1f6ac226f616355fb16b8182eee49b932f), value: TxValue(0x0000000000000000000000000000000000000000000000000000000000000007_U256), access_list: AccessList([]), input: 0x0b040201 }) }], ommers: [], withdrawals: Some(Withdrawals([])) }
2024-02-14T09:41:48.218073Z DEBUG payload_builder: resolving fallback payload as best payload id=0x1d327442f9829071
2024-02-14T09:41:48.218137Z DEBUG payload_builder: resolving best payload
2024-02-14T09:41:48.218460Z DEBUG payload_builder: building new payload id=0x1d327442f9829071 parent_hash=0xe197417a42e6e52dec0b8e7ce97d526bf6a0b67106ca66f37136ed03e887876b parent_number=3793920
2024-02-14T09:41:48.221467Z DEBUG blockchain_tree: Appending block to canonical chain head=0x8cd7dbeb6972a08083d9a0edbcc7aeb0e4b0bd420fa407d5501a85779d0aaa40 parent=(3793920, 0xe197417a42e6e52dec0b8e7ce97d526bf6a0b67106ca66f37136ed03e887876b)
2024-02-14T09:41:48.221651Z  WARN consensus::engine: Error while processing payload error=InsertBlockError { error: Execution(Validation(EVM { hash: 0x0e857b761b597ab9822686094f163b2854fbe8bab1605db314085598f907c633, error: Transaction(GasPriceLessThanBasefee) })), hash: 0x8cd7dbeb6972a08083d9a0edbcc7aeb0e4b0bd420fa407d5501a85779d0aaa40, number: 3793921, parent_hash: 0xe197417a42e6e52dec0b8e7ce97d526bf6a0b67106ca66f37136ed03e887876b, num_txs: 7, .. }
2024-02-14T09:41:48.221663Z  WARN consensus::engine: Invalid block error on new payload invalid_hash=0x8cd7dbeb6972a08083d9a0edbcc7aeb0e4b0bd420fa407d5501a85779d0aaa40 invalid_number=3793921 error=Execution(Validation(EVM { hash: 0x0e857b761b597ab9822686094f163b2854fbe8bab1605db314085598f907c633, error: Transaction(GasPriceLessThanBasefee) }))
2024-02-14T09:41:48.666549Z DEBUG payload_builder: sealed built block sealed_block=SealedBlock { header: SealedHeader { header: Header { parent_hash: 0xe197417a42e6e52dec0b8e7ce97d526bf6a0b67106ca66f37136ed03e887876b, ommers_hash: 0x1dcc4de8dec75d7aab85b567b6ccd41ad312451b948a7413f0a142fd40d49347, beneficiary: 0x4200000000000000000000000000000000000011, state_root: 0x8c1d67e0b4f0321cd5d70716d5f6bd2f5e0f89bd5067d3a7dab117581e942660, transactions_root: 0x3e760936e98de22584f54370e6f620c396986b589dbe1ac4a511ebcbd0dc5802, receipts_root: 0xf3af27b92cf7ecf2170788a36a93d37688a23c18dba1cf95d43d4dedbf121c48, withdrawals_root: Some(0x56e81f171bcc55a6ff8345e692c0f86e5b48e01b996cadc001622fb5e363b421), logs_bloom: 0x0020400040200800000100008000000002000001000040000006000000100100080040000000008101000014102200000100000000000003000100000420020004020000004400000001000810000120008080001040000000010000400000014000000c020000400000000000020a2000002012000a044408020018000000000000002000004084401000040000001901800000012010080000004000000080020000080080040020000010000000000200200000000090000100000000000000000002000000000000000100020000840002100000001000000002a000a0101010000000100040000000000000000000200000001002001000000808080000, difficulty: 0x0_U256, number: 3793921, gas_limit: 30000000, gas_used: 4778384, timestamp: 1707755425, mix_hash: 0xcf498c744a7649a89f27ae716c880ffc35a4fff84ff0a4a0826ad7672c4864ac, nonce: 0, base_fee_per_gas: Some(252), blob_gas_used: None, excess_blob_gas: None, parent_beacon_block_root: None, extra_data: 0x }, hash: 0x8cd7dbeb6972a08083d9a0edbcc7aeb0e4b0bd420fa407d5501a85779d0aaa40 }, body: [TransactionSigned { hash: 0x0e857b761b597ab9822686094f163b2854fbe8bab1605db314085598f907c633, signature: Signature { r: 0x0_U256, s: 0x0_U256, odd_y_parity: false }, transaction: Deposit(TxDeposit { source_hash: 0xa47b9fcfd83f311f99381963ddc4ed2c3dfb0237772d51aca1446efff4fd2ad1, from: 0xdeaddeaddeaddeaddeaddeaddeaddeaddead0001, to: Call(0x4200000000000000000000000000000000000015), mint: None, value: TxValue(0x0_U256), gas_limit: 1000000, is_system_transaction: false, input: 0x015d8eb90000000000000000000000000000000000000000000000000000000001252b530000000000000000000000000000000000000000000000000000000065ca47630000000000000000000000000000000000000000000000000000000905c8d3ca0e3da5fbee17c50ce24e742ebefa28907988cc116221ca539de59464a6d6b4d8000000000000000000000000000000000000000000000000000000000000000000000000000000000000000099199a22125034c808ff20f377d91187e8050f2e00000000000000000000000000000000000000000000000000000000000000bc00000000000000000000000000000000000000000000000000000000000a6fe0 }) }, TransactionSigned { hash: 0xa23e0e1ee8870ddc4e5c1b9c45cfd0d8f852a15ff5538df5f9299a9ebc9da2bd, signature: Signature { r: 0x0_U256, s: 0x0_U256, odd_y_parity: false }, transaction: Deposit(TxDeposit { source_hash: 0xd556217e25d9513b4eea5ae2bd9aea5eef4853caeec38d16230c42fac3eb5719, from: 0xa6ceca6c8edeb69c98bd5bd17660bacef1299b80, to: Call(0x4200000000000000000000000000000000000007), mint: Some(12000000000000000), value: TxValue(0x000000000000000000000000000000000000000000000000002aa1efb94e0000_U256), gas_limit: 288136, is_system_transaction: false, input: 0xd764ad0b000100000000000000000000000000000000000000000000000000000001b8cd000000000000000000000000735adbbe72226bd52e818e7181953f42e3b0ff210000000000000000000000004200000000000000000000000000000000000010000000000000000000000000000000000000000000000000002aa1efb94e0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000c000000000000000000000000000000000000000000000000000000000000000c41635f5fd0000000000000000000000002971b9b03e665b81a4a322eac998ce4e0693f7dc0000000000000000000000002971b9b03e665b81a4a322eac998ce4e0693f7dc000000000000000000000000000000000000000000000000002aa1efb94e00000000000000000000000000000000000000000000000000000000000000000080000000000000000000000000000000000000000000000000000000000000001e55625344576b4c56485a6f307330567a3738495446373044686d56624158000000000000000000000000000000000000000000000000000000000000 }) }, TransactionSigned { hash: 0xcdd1086b7dd8f7925ab9149401a9526b6ecd31da560537e5a47fc82c61163b0a, signature: Signature { r: 0xe3bc60dc06e5c780b77cbc348c305e7b5066815e7a988b58e19de6a970c8a7c0_U256, s: 0x57251d4d94f5c4a9959247b58bd54de028c70d9850d10ebb76f5ed21776794a1_U256, odd_y_parity: true }, transaction: Eip1559(TxEip1559 { chain_id: 34443, nonce: 24, gas_limit: 269769, max_fee_per_gas: 1500000302, max_priority_fee_per_gas: 1500000000, to: Call(0xe063be26aaeb50db3866a7534551aa789bc368b7), value: TxValue(0x0_U256), access_list: AccessList([]), input: 0x2c31b5e40000000000000000000000004200000000000000000000000000000000000006000000000000000000000000f0f161fda2712db8b566946122a5af183995e2ed0000000000000000000000000000000000000000000000000000000000b579080000000000000000000000000000000000000000000000000000000000000001000000000000000000000000000000000000000000000000000000000000000200000000000000000000000000000000000000000000000000000000000000000000000000000000000000001a32c1d56b573717af7c47720a712a5c0dc51b96 }) }, TransactionSigned { hash: 0xe135ddfb6913c94b003927744dfbd93588bd901f81efaca20c2469cbc6f43ae7, signature: Signature { r: 0x6226cee037ad6355b36f2937f7330bfff1df30d457b0a19c393a0d17c120570c_U256, s: 0x0b6f102cd366b2d65f7892513db67831d09bbb1ecfd81283a65f93933399d3bb_U256, odd_y_parity: false }, transaction: Eip1559(TxEip1559 { chain_id: 34443, nonce: 14, gas_limit: 528176, max_fee_per_gas: 1500000302, max_priority_fee_per_gas: 1500000000, to: Call(0x94812f2eea03a49869f95e1b5868c6f3206ee3d3), value: TxValue(0x0_U256), access_list: AccessList([]), input: 0xa0712d68000000000000000000000000000000000000000000000000000000000791ddc0 }) }, TransactionSigned { hash: 0xa0e64155b3c6b70529b2021337f99d905f9724c6c9d4d0911cc7ab3082be3cee, signature: Signature { r: 0x098d5a38049f333a86509ac184cc1712f02bf3936d169213dc084f68bfe8814d_U256, s: 0x247d639d64afcd4514db8857e109184fa9e7b3fc54cab05a5a452e8bb07b2107_U256, odd_y_parity: true }, transaction: Eip1559(TxEip1559 { chain_id: 34443, nonce: 0, gas_limit: 21000, max_fee_per_gas: 1500000302, max_priority_fee_per_gas: 1500000000, to: Call(0xe4edb277e41dc89ab076a1f049f4a3efa700bce8), value: TxValue(0x000000000000000000000000000000000000000000000000001c6bf52634232a_U256), access_list: AccessList([]), input: 0x }) }, TransactionSigned { hash: 0xffae0e0ddc5433dd24a22f8383b08b2eb28e8dab9a931a315942da6c17c8899e, signature: Signature { r: 0xcd801a3bc4742a023a1cc03dad106a44151e164f03958f9bee6f8f88e076945b_U256, s: 0x1fc4edba17476e8ba385b3967cad5c07e7e5651f7715bb1c1a2b9ad2ec495169_U256, odd_y_parity: true }, transaction: Eip2930(TxEip2930 { chain_id: 34443, nonce: 35, gas_price: 1200302, gas_limit: 43140, to: Call(0x4200000000000000000000000000000000000006), value: TxValue(0x0_U256), access_list: AccessList([]), input: 0x2e1a7d4d000000000000000000000000000000000000000000000000007eabbe3c8fa9c7 }) }, TransactionSigned { hash: 0xba64c9aced320fdaaf824a5a111296d97ba29fdcf2d968a83574ea8983d5e66c, signature: Signature { r: 0x8c17dea50e7a6b4ee85b20effa0dc5d0ec69cac63dd096be2cde14066a65b3e4_U256, s: 0x57b13d4238eeec6626dba032c9bf2113b57de9a91979c3be46795c53490b4e9b_U256, odd_y_parity: true }, transaction: Eip1559(TxEip1559 { chain_id: 34443, nonce: 4690, gas_limit: 29000000, max_fee_per_gas: 10000, max_priority_fee_per_gas: 10000, to: Call(0xbc53db1f6ac226f616355fb16b8182eee49b932f), value: TxValue(0x0000000000000000000000000000000000000000000000000000000000000007_U256), access_list: AccessList([]), input: 0x0b040201 }) }], ommers: [], withdrawals: Some(Withdrawals([])) }

here's the trace logs:

2024-02-14T10:50:16.716830Z TRACE on_new_payload{block_hash=0x8cd7dbeb6972a08083d9a0edbcc7aeb0e4b0bd420fa407d5501a85779d0aaa40 block_number=3793921 is_pipeline_idle=true}: blockchain_tree: Returning lowest buffered ancestor hash=0x8cd7dbeb6972a08083d9a0edbcc7aeb0e4b0bd420fa407d5501a85779d0aaa40
2024-02-14T10:50:16.718408Z TRACE on_new_payload{block_hash=0x8cd7dbeb6972a08083d9a0edbcc7aeb0e4b0bd420fa407d5501a85779d0aaa40 block_number=3793921 is_pipeline_idle=true}:try_insert_new_payload: blockchain_tree: Inserting block hash=0x8cd7dbeb6972a08083d9a0edbcc7aeb0e4b0bd420fa407d5501a85779d0aaa40 number=3793921 parent_hash=0xe197417a42e6e52dec0b8e7ce97d526bf6a0b67106ca66f37136ed03e887876b
2024-02-14T10:50:16.719666Z DEBUG on_new_payload{block_hash=0x8cd7dbeb6972a08083d9a0edbcc7aeb0e4b0bd420fa407d5501a85779d0aaa40 block_number=3793921 is_pipeline_idle=true}:try_insert_new_payload:try_insert_validated_block{block=(3793921, 0x8cd7dbeb6972a08083d9a0edbcc7aeb0e4b0bd420fa407d5501a85779d0aaa40)}:try_append_canonical_chain: blockchain_tree: Appending block to canonical chain head=0x8cd7dbeb6972a08083d9a0edbcc7aeb0e4b0bd420fa407d5501a85779d0aaa40 parent=(3793920, 0xe197417a42e6e52dec0b8e7ce97d526bf6a0b67106ca66f37136ed03e887876b)
2024-02-14T10:50:16.719757Z TRACE on_new_payload{block_hash=0x8cd7dbeb6972a08083d9a0edbcc7aeb0e4b0bd420fa407d5501a85779d0aaa40 block_number=3793921 is_pipeline_idle=true}:try_insert_new_payload:try_insert_validated_block{block=(3793921, 0x8cd7dbeb6972a08083d9a0edbcc7aeb0e4b0bd420fa407d5501a85779d0aaa40)}:try_append_canonical_chain: providers::db: Returning historical state provider for block number block_number=3793920
2024-02-14T10:50:16.719912Z TRACE on_new_payload{block_hash=0x8cd7dbeb6972a08083d9a0edbcc7aeb0e4b0bd420fa407d5501a85779d0aaa40 block_number=3793921 is_pipeline_idle=true}:try_insert_new_payload:try_insert_validated_block{block=(379392
1, 0x8cd7dbeb6972a08083d9a0edbcc7aeb0e4b0bd420fa407d5501a85779d0aaa40)}: blockchain_tree: return=Err(Execution(Validation(EVM { hash: 0x0e857b761b597ab9822686094f163b2854fbe8bab1605db314085598f907c633, error: Transaction(GasPriceLessThanBasefee) })))
2024-02-14T10:50:16.719970Z TRACE on_new_payload{block_hash=0x8cd7dbeb6972a08083d9a0edbcc7aeb0e4b0bd420fa407d5501a85779d0aaa40 block_number=3793921 is_pipeline_idle=true}:try_insert_new_payload: consensus::engine: return=Err(InsertBlockError { error: Execution(Validation(EVM { hash: 0x0e857b761b597ab9822686094f163b2854fbe8bab1605db314085598f907c633, error: Transaction(GasPriceLessThanBasefee) })), hash: 0x8cd7dbeb6972a08083d9a0edbcc7aeb0e4b0bd420fa407d5501a85779d0aaa40, number: 3793921, parent_hash: 0xe197417a42e6e52dec0b8e7ce97d526bf6a0b67106ca66f37136ed03e887876b, num_txs: 7, .. })
2024-02-14T10:50:16.719985Z  WARN on_new_payload{block_hash=0x8cd7dbeb6972a08083d9a0edbcc7aeb0e4b0bd420fa407d5501a85779d0aaa40 block_number=3793921 is_pipeline_idle=true}: consensus::engine: Error while processing payload error=InsertBlockError { error: Execution(Validation(EVM { hash: 0x0e857b761b597ab9822686094f163b2854fbe8bab1605db314085598f907c633, error: Transaction(GasPriceLessThanBasefee) })), hash: 0x8cd7dbeb6972a08083d9a0edbcc7aeb0e4b0bd420fa407d5501a85779d0aaa40, number: 3793921, parent_hash: 0xe197417a42e6e52dec0b8e7ce97d526bf6a0b67106ca66f37136ed03e887876b, num_txs: 7, .. }
2024-02-14T10:50:16.719998Z  WARN on_new_payload{block_hash=0x8cd7dbeb6972a08083d9a0edbcc7aeb0e4b0bd420fa407d5501a85779d0aaa40 block_number=3793921 is_pipeline_idle=true}: consensus::engine: Invalid block error on new payload invalid_hash=0x8cd7dbeb6972a08083d9a0edbcc7aeb0e4b0bd420fa407d5501a85779d0aaa40 invalid_number=3793921 error=Execution(Validation(EVM { hash: 0x0e857b761b597ab9822686094f163b2854fbe8bab1605db314085598f907c633, error: Transaction(GasPriceLessThanBasefee) }))
2024-02-14T10:50:16.720018Z  WARN on_new_payload{block_hash=0x8cd7dbeb6972a08083d9a0edbcc7aeb0e4b0bd420fa407d5501a85779d0aaa40 block_number=3793921 is_pipeline_idle=true}: consensus::engine: Bad block with hash hash=0x8cd7dbeb6972a08083d9a0edbcc7aeb0e4b0bd420fa407d5501a85779d0aaa40 header=Header { parent_hash: 0xe197417a42e6e52dec0b8e7ce97d526bf6a0b67106ca66f37136ed03e887876b, ommers_hash: 0x1dcc4de8dec75d7aab85b567b6ccd41ad312451b948a7413f0a142fd40d49347, beneficiary: 0x4200000000000000000000000000000000000011, state_root: 0x8c1d67e0b4f0321cd5d70716d5f6bd2f5e0f89bd5067d3a7dab117581e942660, transactions_root: 0x3e760936e98de22584f54370e6f620c396986b589dbe1ac4a511ebcbd0dc5802, receipts_root: 0xf3af27b92cf7ecf2170788a36a93d37688a23c18dba1cf95d43d4dedbf121c48, withdrawals_root: Some(0x56e81f171bcc55a6ff8345e692c0f86e5b48e01b996cadc001622fb5e363b421), logs_bloom: 0x0020400040200800000100008000000002000001000040000006000000100100080040000000008101000014102200000100000000000003000100000420020004020000004400000001000810000120008080001040000000010000400000014000000c020000400000000000020a2000002012000a044408020018000000000000002000004084401000040000001901800000012010080000004000000080020000080080040020000010000000000200200000000090000100000000000000000002000000000000000100020000840002100000001000000002a000a0101010000000100040000000000000000000200000001002001000000808080000, difficulty: 0x0_U256, number: 3793921, gas_limit: 30000000, gas_used: 4778384, timestamp: 1707755425, mix_hash: 0xcf498c744a7649a89f27ae716c880ffc35a4fff84ff0a4a0826ad7672c4864ac, nonce: 0, base_fee_per_gas: Some(252), blob_gas_used: None, excess_blob_gas: None, parent_beacon_block_root: None, extra_data: 0x }
2024-02-14T10:50:16.720035Z TRACE on_new_payload{block_hash=0x8cd7dbeb6972a08083d9a0edbcc7aeb0e4b0bd420fa407d5501a85779d0aaa40 block_number=3793921 is_pipeline_idle=true}: blockchain_tree: Returning header by hash hash=0xe197417a42e6e52dec0b8e7ce97d526bf6a0b67106ca66f37136ed03e887876b
2024-02-14T10:50:16.720085Z TRACE on_new_payload{block_hash=0x8cd7dbeb6972a08083d9a0edbcc7aeb0e4b0bd420fa407d5501a85779d0aaa40 block_number=3793921 is_pipeline_idle=true}: consensus::engine: Returning payload status status=Ok(PayloadStatus { status: Invalid { validation_error: "EVM reported invalid transaction (0x0e857b761b597ab9822686094f163b2854fbe8bab1605db314085598f907c633): Transaction error: GasPriceLessThanBasefee" }, latest_valid_hash: Some(0xe197417a42e6e52dec0b8e7ce97d526bf6a0b67106ca66f37136ed03e887876b) })
2024-02-14T10:50:16.720101Z TRACE blockchain_tree: Returning canonical tip
2024-02-14T10:50:16.720106Z TRACE blockchain_tree: Returning canonical tip
2024-02-14T10:50:16.720181Z TRACE method_call{method="engine_newPayloadV2"}: jsonrpsee_core::tracing: send="{\"jsonrpc\":\"2.0\",\"result\":{\"status\":\"INVALID\",\"latestValidHash\":\"0xe197417a42e6e52dec0b8e7ce97d526bf6a0b67106ca66f37136ed03e887876b\",\"validationError\":\"EVM reported invalid transaction (0x0e857b761b597ab9822686094f163b2854fbe8bab1605db314085598f907c633): Transaction error: GasPriceLessThanBasefee\"},\"id\":1}"

The stateroot, transactions root, receipts root, etc are all correct in the built sealed block.

i think the error lies in configuration of the executor (an EVMProcessor)

EVMProcessor::new_with_db(
            self.chain_spec.clone(),
            database_state,
            self.evm_config.clone(),
        )

BlockchainTree::try_append_canonical_chain() -> AppendableChain::new_canonical_fork() -> AppendableChain::validate_and_execute() -> executor.execute_and_verify_receipt() (executor == EVMProcessor) -> EVMProcessor::execute_inner() -> EVMProcessor::execute_transactions() -> EVMProcessor::transact() -> external REVM::Evm::transact()

within EVMProcessor::execute_transactions() -> EVMProcessor::init_env() the config is set up with new(), so when executing the txs is_optimism is false and it expects gas prices for deposit type txs

let mut cfg: CfgEnvWithHandlerCfg =
            CfgEnvWithHandlerCfg::new(self.evm.cfg().clone(), self.evm.spec_id());
        EvmConfig::fill_cfg_and_block_env(
            &mut cfg,
            self.evm.block_mut(),
            &self.chain_spec,
            header,
            total_difficulty,
        );

probably needs the same fix as applied in #6598

[zilayo]

happy to confirm #6609 fully fixes the issue

block/payload building + block validation working as expected.

Thanks @rakita & @mattsse for actioning this so quickly!