ethereum.forks.paris.forkethereum.forks.shanghai.fork
Ethereum Specification.
.. contents:: Table of Contents :backlinks: none :local:
Introduction
Entry point for the Ethereum specification.
BASE_FEE_MAX_CHANGE_DENOMINATOR¶
| 71 | BASE_FEE_MAX_CHANGE_DENOMINATOR = Uint(8) |
|---|
ELASTICITY_MULTIPLIER¶
| 72 | ELASTICITY_MULTIPLIER = Uint(2) |
|---|
EMPTY_OMMER_HASH¶
| 73 | EMPTY_OMMER_HASH = keccak256(rlp.encode([])) |
|---|
BlockChain ¶
History and current state of the block chain.
| 76 | @dataclass |
|---|
class BlockChain:
blocks¶
| 82 | blocks: List[Block] |
|---|
state¶
| 83 | state: State |
|---|
chain_id¶
| 84 | chain_id: U64 |
|---|
apply_fork ¶
Transforms the state from the previous hard fork (old) into the block
chain object for this hard fork and returns it.
When forks need to implement an irregular state transition, this function
is used to handle the irregularity. See the :ref:DAO Fork <dao-fork> for
an example.
Parameters
old : Previous block chain object.
Returns
new : BlockChain
Upgraded block chain object for this hard fork.
def apply_fork(old: BlockChain) -> BlockChain:
| 88 | <snip> |
|---|---|
| 107 | return old |
get_last_256_block_hashes ¶
Obtain the list of hashes of the previous 256 blocks in order of increasing block number.
This function will return less hashes for the first 256 blocks.
The BLOCKHASH opcode needs to access the latest hashes on the chain,
therefore this function retrieves them.
Parameters
chain : History and current state.
Returns
recent_block_hashes : List[Hash32]
Hashes of the recent 256 blocks in order of increasing block number.
def get_last_256_block_hashes(chain: BlockChain) -> List[Hash32]:
| 111 | <snip> |
|---|---|
| 131 | recent_blocks = chain.blocks[-255:] |
| 132 | # TODO: This function has not been tested rigorously |
| 133 | if len(recent_blocks) == 0: |
| 134 | return [] |
| 135 | |
| 136 | recent_block_hashes = [] |
| 137 | |
| 138 | for block in recent_blocks: |
| 139 | prev_block_hash = block.header.parent_hash |
| 140 | recent_block_hashes.append(prev_block_hash) |
| 141 | |
| 142 | # We are computing the hash only for the most recent block and not for |
| 143 | # the rest of the blocks as they have successors which have the hash of |
| 144 | # the current block as parent hash. |
| 145 | most_recent_block_hash = keccak256(rlp.encode(recent_blocks[-1].header)) |
| 146 | recent_block_hashes.append(most_recent_block_hash) |
| 147 | |
| 148 | return recent_block_hashes |
state_transition ¶
Attempts to apply a block to an existing block chain.
All parts of the block's contents need to be verified before being added to the chain. Blocks are verified by ensuring that the contents of the block make logical sense with the contents of the parent block. The information in the block's header must also match the corresponding information in the block.
To implement Ethereum, in theory clients are only required to store the most recent 255 blocks of the chain since as far as execution is concerned, only those blocks are accessed. Practically, however, clients should store more blocks to handle reorgs.
Parameters
chain :
History and current state.
block :
Block to apply to chain.
def state_transition(chain: BlockChain, block: Block) -> None:
| 152 | <snip> |
|---|---|
| 174 | validate_header(chain, block.header) |
| 175 | if block.ommers != (): |
| 176 | raise InvalidBlock |
| 177 | |
| 178 | block_state = BlockState(pre_state=chain.state) |
| 179 | |
| 180 | block_env = vm.BlockEnvironment( |
| 181 | chain_id=chain.chain_id, |
| 182 | state=block_state, |
| 183 | block_gas_limit=block.header.gas_limit, |
| 184 | block_hashes=get_last_256_block_hashes(chain), |
| 185 | coinbase=block.header.coinbase, |
| 186 | number=block.header.number, |
| 187 | base_fee_per_gas=block.header.base_fee_per_gas, |
| 188 | time=block.header.timestamp, |
| 189 | prev_randao=block.header.prev_randao, |
| 190 | ) |
| 191 | |
| 192 | block_output = apply_body( |
| 193 | block_env=block_env, |
| 194 | transactions=block.transactions, |
| 195 | withdrawals=block.withdrawals, |
| 196 | ) |
| 197 | block_diff = extract_block_diff(block_state) |
| 198 | block_state_root, _ = chain.state.compute_state_root_and_trie_changes( |
| 199 | block_diff.account_changes, |
| 200 | block_diff.storage_changes, |
| 201 | block_diff.storage_clears, |
| 202 | ) |
| 203 | transactions_root = root(block_output.transactions_trie) |
| 204 | receipt_root = root(block_output.receipts_trie) |
| 205 | block_logs_bloom = logs_bloom(block_output.block_logs) |
| 206 | withdrawals_root = root(block_output.withdrawals_trie) |
| 207 | |
| 208 | if block_output.block_gas_used != block.header.gas_used: |
| 209 | raise InvalidBlock( |
| 210 | f"{block_output.block_gas_used} != {block.header.gas_used}" |
| 211 | ) |
| 212 | if transactions_root != block.header.transactions_root: |
| 213 | raise InvalidBlock |
| 214 | if block_state_root != block.header.state_root: |
| 215 | raise InvalidBlock |
| 216 | if receipt_root != block.header.receipt_root: |
| 217 | raise InvalidBlock |
| 218 | if block_logs_bloom != block.header.bloom: |
| 219 | raise InvalidBlock |
| 220 | if withdrawals_root != block.header.withdrawals_root: |
| 221 | raise InvalidBlock |
| 222 | |
| 223 | apply_changes_to_state(chain.state, block_diff) |
| 224 | chain.blocks.append(block) |
| 225 | if len(chain.blocks) > 255: |
| 226 | # Real clients have to store more blocks to deal with reorgs, but the |
| 227 | # protocol only requires the last 255 |
| 228 | chain.blocks = chain.blocks[-255:] |
calculate_base_fee_per_gas ¶
Calculates the base fee per gas for the block.
Parameters
block_gas_limit : Gas limit of the block for which the base fee is being calculated. parent_gas_limit : Gas limit of the parent block. parent_gas_used : Gas used in the parent block. parent_base_fee_per_gas : Base fee per gas of the parent block.
Returns
base_fee_per_gas : Uint
Base fee per gas for the block.
def calculate_base_fee_per_gas(block_gas_limit: Uint, parent_gas_limit: Uint, parent_gas_used: Uint, parent_base_fee_per_gas: Uint) -> Uint:
| 237 | <snip> |
|---|---|
| 257 | parent_gas_target = parent_gas_limit // ELASTICITY_MULTIPLIER |
| 258 | if not check_gas_limit(block_gas_limit, parent_gas_limit): |
| 259 | raise InvalidBlock |
| 260 | |
| 261 | if parent_gas_used == parent_gas_target: |
| 262 | expected_base_fee_per_gas = parent_base_fee_per_gas |
| 263 | elif parent_gas_used > parent_gas_target: |
| 264 | gas_used_delta = parent_gas_used - parent_gas_target |
| 265 | |
| 266 | parent_fee_gas_delta = parent_base_fee_per_gas * gas_used_delta |
| 267 | target_fee_gas_delta = parent_fee_gas_delta // parent_gas_target |
| 268 | |
| 269 | base_fee_per_gas_delta = max( |
| 270 | target_fee_gas_delta // BASE_FEE_MAX_CHANGE_DENOMINATOR, |
| 271 | Uint(1), |
| 272 | ) |
| 273 | |
| 274 | expected_base_fee_per_gas = ( |
| 275 | parent_base_fee_per_gas + base_fee_per_gas_delta |
| 276 | ) |
| 277 | else: |
| 278 | gas_used_delta = parent_gas_target - parent_gas_used |
| 279 | |
| 280 | parent_fee_gas_delta = parent_base_fee_per_gas * gas_used_delta |
| 281 | target_fee_gas_delta = parent_fee_gas_delta // parent_gas_target |
| 282 | |
| 283 | base_fee_per_gas_delta = ( |
| 284 | target_fee_gas_delta // BASE_FEE_MAX_CHANGE_DENOMINATOR |
| 285 | ) |
| 286 | |
| 287 | expected_base_fee_per_gas = ( |
| 288 | parent_base_fee_per_gas - base_fee_per_gas_delta |
| 289 | ) |
| 290 | |
| 291 | return Uint(expected_base_fee_per_gas) |
validate_header ¶
Verifies a block header.
In order to consider a block's header valid, the logic for the quantities in the header should match the logic for the block itself. For example the header timestamp should be greater than the block's parent timestamp because the block was created after the parent block. Additionally, the block's number should be directly following the parent block's number since it is the next block in the sequence.
Parameters
chain : History and current state. header : Header to check for correctness.
def validate_header(chain: BlockChain, header: Header) -> None:
| 295 | <snip> |
|---|---|
| 313 | if header.number < Uint(1): |
| 314 | raise InvalidBlock |
| 315 | |
| 316 | parent_header = chain.blocks[-1].header |
| 317 | |
| 318 | if header.gas_used > header.gas_limit: |
| 319 | raise InvalidBlock |
| 320 | |
| 321 | expected_base_fee_per_gas = calculate_base_fee_per_gas( |
| 322 | header.gas_limit, |
| 323 | parent_header.gas_limit, |
| 324 | parent_header.gas_used, |
| 325 | parent_header.base_fee_per_gas, |
| 326 | ) |
| 327 | if expected_base_fee_per_gas != header.base_fee_per_gas: |
| 328 | raise InvalidBlock |
| 329 | if header.timestamp <= parent_header.timestamp: |
| 330 | raise InvalidBlock |
| 331 | if header.number != parent_header.number + Uint(1): |
| 332 | raise InvalidBlock |
| 333 | if len(header.extra_data) > 32: |
| 334 | raise InvalidBlock |
| 335 | if header.difficulty != 0: |
| 336 | raise InvalidBlock |
| 337 | if header.nonce != b"\x00\x00\x00\x00\x00\x00\x00\x00": |
| 338 | raise InvalidBlock |
| 339 | if header.ommers_hash != EMPTY_OMMER_HASH: |
| 340 | raise InvalidBlock |
| 341 | |
| 342 | block_parent_hash = keccak256(rlp.encode(parent_header)) |
| 343 | if header.parent_hash != block_parent_hash: |
| 344 | raise InvalidBlock |
check_transaction ¶
Check if the transaction is includable in the block.
Parameters
block_env : The block scoped environment. block_output : The block output for the current block. tx : The transaction. tx_state : The transaction state tracker.
Returns
sender_address : The sender of the transaction. effective_gas_price : The price to charge for gas when the transaction is executed.
Raises
InvalidBlock : If the transaction is not includable. GasUsedExceedsLimitError : If the gas used by the transaction exceeds the block's gas limit. NonceMismatchError : If the nonce of the transaction is not equal to the sender's nonce. InsufficientBalanceError : If the sender's balance is not enough to pay for the transaction. InvalidSenderError : If the transaction is from an address that does not exist anymore. PriorityFeeGreaterThanMaxFeeError : If the priority fee is greater than the maximum fee per gas. InsufficientMaxFeePerGasError : If the maximum fee per gas is insufficient for the transaction.
def check_transaction(block_env: ethereum.forks.paris.vm.BlockEnvironmentethereum.forks.shanghai.vm.BlockEnvironment, block_output: ethereum.forks.paris.vm.BlockOutputethereum.forks.shanghai.vm.BlockOutput, tx: Transaction, tx_state: TransactionState) -> Tuple[Address, Uint]:
| 353 | <snip> |
|---|---|
| 392 | gas_available = block_env.block_gas_limit - block_output.block_gas_used |
| 393 | if tx.gas > gas_available: |
| 394 | raise GasUsedExceedsLimitError("gas used exceeds limit") |
| 395 | sender_address = recover_sender(block_env.chain_id, tx) |
| 396 | sender_account = get_account(tx_state, sender_address) |
| 397 | |
| 398 | if isinstance(tx, FeeMarketTransaction): |
| 399 | if tx.max_fee_per_gas < tx.max_priority_fee_per_gas: |
| 400 | raise PriorityFeeGreaterThanMaxFeeError( |
| 401 | "priority fee greater than max fee" |
| 402 | ) |
| 403 | if tx.max_fee_per_gas < block_env.base_fee_per_gas: |
| 404 | raise InsufficientMaxFeePerGasError( |
| 405 | tx.max_fee_per_gas, block_env.base_fee_per_gas |
| 406 | ) |
| 407 | |
| 408 | priority_fee_per_gas = min( |
| 409 | tx.max_priority_fee_per_gas, |
| 410 | tx.max_fee_per_gas - block_env.base_fee_per_gas, |
| 411 | ) |
| 412 | effective_gas_price = priority_fee_per_gas + block_env.base_fee_per_gas |
| 413 | max_gas_fee = tx.gas * tx.max_fee_per_gas |
| 414 | else: |
| 415 | if tx.gas_price < block_env.base_fee_per_gas: |
| 416 | raise InvalidBlock |
| 417 | effective_gas_price = tx.gas_price |
| 418 | max_gas_fee = tx.gas * tx.gas_price |
| 419 | |
| 420 | if sender_account.nonce > Uint(tx.nonce): |
| 421 | raise NonceMismatchError("nonce too low") |
| 422 | elif sender_account.nonce < Uint(tx.nonce): |
| 423 | raise NonceMismatchError("nonce too high") |
| 424 | if Uint(sender_account.balance) < max_gas_fee + Uint(tx.value): |
| 425 | raise InsufficientBalanceError("insufficient sender balance") |
| 426 | if sender_account.code_hash != EMPTY_CODE_HASH: |
| 427 | raise InvalidSenderError("not EOA") |
| 428 | |
| 429 | return sender_address, effective_gas_price |
make_receipt ¶
Make the receipt for a transaction that was executed.
Parameters
tx : The executed transaction. error : Error in the top level frame of the transaction, if any. cumulative_gas_used : The total gas used so far in the block after the transaction was executed. logs : The logs produced by the transaction.
Returns
receipt : The receipt for the transaction.
def make_receipt(tx: Transaction, error: Optional[EthereumException], cumulative_gas_used: Uint, logs: Tuple[Log, ...]) -> Bytes | Receipt:
| 438 | <snip> |
|---|---|
| 459 | receipt = Receipt( |
| 460 | succeeded=error is None, |
| 461 | cumulative_gas_used=cumulative_gas_used, |
| 462 | bloom=logs_bloom(logs), |
| 463 | logs=logs, |
| 464 | ) |
| 465 | |
| 466 | return encode_receipt(tx, receipt) |
apply_body ¶
Executes a block.
Many of the contents of a block are stored in data structures called tries. There is a transactions trie which is similar to a ledger of the transactions stored in the current block. There is also a receipts trie which stores the results of executing a transaction, like the post state and gas used. This function creates and executes the block that is to be added to the chain.
Parameters
block_env : The block scoped environment. block_output : The block output for the current block. transactions : Transactions included in the block. withdrawals : Withdrawals to be processed in the current block.
Returns
block_output : The block output for the current block.
def apply_body(block_env: ethereum.forks.paris.vm.BlockEnvironmentethereum.forks.shanghai.vm.BlockEnvironment, transactions: Tuple[LegacyTransaction | Bytes, ...], withdrawals: Tuple[Withdrawal, ...]) -> ethereum.forks.paris.vm.BlockOutputethereum.forks.shanghai.vm.BlockOutput:
| 474 | <snip> |
|---|---|
| 501 | block_output = vm.BlockOutput() |
| 502 | |
| 503 | for i, tx in enumerate(map(decode_transaction, transactions)): |
| 504 | process_transaction(block_env, block_output, tx, Uint(i)) |
| 505 | |
| 506 | process_withdrawals(block_env, block_output, withdrawals) |
| 507 | |
| 508 | return block_output |
process_transaction ¶
Execute a transaction against the provided environment.
This function processes the actions needed to execute a transaction. It decrements the sender's account balance after calculating the gas fee and refunds them the proper amount after execution. Calling contracts, deploying code, and incrementing nonces are all examples of actions that happen within this function or from a call made within this function.
Accounts that are marked for deletion are processed and destroyed after execution.
Parameters
block_env : Environment for the Ethereum Virtual Machine. block_output : The block output for the current block. tx : Transaction to execute. index: Index of the transaction in the block.
def process_transaction(block_env: ethereum.forks.paris.vm.BlockEnvironmentethereum.forks.shanghai.vm.BlockEnvironment, block_output: ethereum.forks.paris.vm.BlockOutputethereum.forks.shanghai.vm.BlockOutput, tx: Transaction, index: Uint) -> None:
| 517 | <snip> |
|---|---|
| 541 | tx_state = TransactionState(parent=block_env.state) |
| 542 | |
| 543 | trie_set( |
| 544 | block_output.transactions_trie, |
| 545 | rlp.encode(index), |
| 546 | encode_transaction(tx), |
| 547 | ) |
| 548 | |
| 549 | intrinsic_gas = validate_transaction(tx) |
| 550 | |
| 551 | ( |
| 552 | sender, |
| 553 | effective_gas_price, |
| 554 | ) = check_transaction( |
| 555 | block_env=block_env, |
| 556 | block_output=block_output, |
| 557 | tx=tx, |
| 558 | tx_state=tx_state, |
| 559 | ) |
| 560 | |
| 561 | sender_account = get_account(tx_state, sender) |
| 562 | |
| 563 | effective_gas_fee = tx.gas * effective_gas_price |
| 564 | |
| 565 | gas = tx.gas - intrinsic_gas |
| 566 | increment_nonce(tx_state, sender) |
| 567 | |
| 568 | sender_balance_after_gas_fee = ( |
| 569 | Uint(sender_account.balance) - effective_gas_fee |
| 570 | ) |
| 571 | set_account_balance(tx_state, sender, U256(sender_balance_after_gas_fee)) |
| 572 | |
| 573 | access_list_addresses = set() |
| 574 | access_list_storage_keys = set() |
| 575 | access_list_addresses.add(block_env.coinbase) |
| 576 | if isinstance(tx, (AccessListTransaction, FeeMarketTransaction)): |
| 577 | for access in tx.access_list: |
| 578 | access_list_addresses.add(access.account) |
| 579 | for slot in access.slots: |
| 580 | access_list_storage_keys.add((access.account, slot)) |
| 581 | |
| 582 | tx_env = vm.TransactionEnvironment( |
| 583 | origin=sender, |
| 584 | gas_price=effective_gas_price, |
| 585 | gas=gas, |
| 586 | access_list_addresses=access_list_addresses, |
| 587 | access_list_storage_keys=access_list_storage_keys, |
| 588 | state=tx_state, |
| 589 | index_in_block=index, |
| 590 | tx_hash=get_transaction_hash(encode_transaction(tx)), |
| 591 | ) |
| 592 | |
| 593 | message = prepare_message(block_env, tx_env, tx) |
| 594 | |
| 595 | tx_output = process_message_call(message) |
| 596 | |
| 597 | tx_gas_used_before_refund = tx.gas - tx_output.gas_left |
| 598 | tx_gas_refund = min( |
| 599 | tx_gas_used_before_refund // Uint(5), Uint(tx_output.refund_counter) |
| 600 | ) |
| 601 | tx_gas_used_after_refund = tx_gas_used_before_refund - tx_gas_refund |
| 602 | tx_gas_left = tx.gas - tx_gas_used_after_refund |
| 603 | gas_refund_amount = tx_gas_left * effective_gas_price |
| 604 | |
| 605 | # For non-1559 transactions effective_gas_price == tx.gas_price |
| 606 | priority_fee_per_gas = effective_gas_price - block_env.base_fee_per_gas |
| 607 | transaction_fee = tx_gas_used_after_refund * priority_fee_per_gas |
| 608 | |
| 609 | # refund gas |
| 610 | sender_balance_after_refund = get_account(tx_state, sender).balance + U256( |
| 611 | gas_refund_amount |
| 612 | ) |
| 613 | set_account_balance(tx_state, sender, sender_balance_after_refund) |
| 614 | |
| 615 | # transfer miner fees |
| 616 | coinbase_balance_after_mining_fee = get_account( |
| 617 | tx_state, block_env.coinbase |
| 618 | ).balance + U256(transaction_fee) |
| 619 | set_account_balance( |
| 620 | tx_state, block_env.coinbase, coinbase_balance_after_mining_fee |
| 621 | ) |
| 622 | |
| 623 | for address in tx_output.accounts_to_delete: |
| 624 | destroy_account(tx_state, address) |
| 625 | |
| 626 | block_output.block_gas_used += tx_gas_used_after_refund |
| 627 | |
| 628 | receipt = make_receipt( |
| 629 | tx, tx_output.error, block_output.block_gas_used, tx_output.logs |
| 630 | ) |
| 631 | |
| 632 | receipt_key = rlp.encode(Uint(index)) |
| 633 | block_output.receipt_keys += (receipt_key,) |
| 634 | |
| 635 | trie_set( |
| 636 | block_output.receipts_trie, |
| 637 | receipt_key, |
| 638 | receipt, |
| 639 | ) |
| 640 | |
| 641 | block_output.block_logs += tx_output.logs |
| 642 | |
| 643 | incorporate_tx_into_block(tx_state) |
process_withdrawals ¶
Increase the balance of the withdrawing account.
def process_withdrawals(block_env: ethereum.forks.shanghai.vm.BlockEnvironment, block_output: ethereum.forks.shanghai.vm.BlockOutput, withdrawals: Tuple[Withdrawal, ...]) -> None:
| 651 | <snip> |
|---|---|
| 654 | wd_state = TransactionState(parent=block_env.state) |
| 655 | |
| 656 | for i, wd in enumerate(withdrawals): |
| 657 | trie_set( |
| 658 | block_output.withdrawals_trie, |
| 659 | rlp.encode(Uint(i)), |
| 660 | rlp.encode(wd), |
| 661 | ) |
| 662 | |
| 663 | create_ether(wd_state, wd.address, wd.amount * U256(10**9)) |
| 664 | |
| 665 | incorporate_tx_into_block(wd_state) |
check_gas_limit ¶
Validates the gas limit for a block.
The bounds of the gas limit, max_adjustment_delta, is set as the
quotient of the parent block's gas limit and the
LIMIT_ADJUSTMENT_FACTOR. Therefore, if the gas limit that is
passed through as a parameter is greater than or equal to the sum of
the parent's gas and the adjustment delta then the limit for gas is too
high and fails this function's check. Similarly, if the limit is less
than or equal to the difference of the parent's gas and the adjustment
delta or the predefined LIMIT_MINIMUM then this function's
check fails because the gas limit doesn't allow for a sufficient or
reasonable amount of gas to be used on a block.
Parameters
gas_limit : Gas limit to validate.
parent_gas_limit : Gas limit of the parent block.
Returns
check : bool
True if gas limit constraints are satisfied, False otherwise.
def check_gas_limit(gas_limit: Uint, parent_gas_limit: Uint) -> bool:
| 669 | <snip> |
|---|---|
| 697 | max_adjustment_delta = parent_gas_limit // GasCosts.LIMIT_ADJUSTMENT_FACTOR |
| 698 | if gas_limit >= parent_gas_limit + max_adjustment_delta: |
| 699 | return False |
| 700 | if gas_limit <= parent_gas_limit - max_adjustment_delta: |
| 701 | return False |
| 702 | if gas_limit < GasCosts.LIMIT_MINIMUM: |
| 703 | return False |
| 704 | |
| 705 | return True |