substitute by charge – Dropping changed transactions when watching the mempool

I’m attempting to seize all of the changed transactions. I’ve complied Bitcon Core with tracing enabled and hearken to the mempool:changed as prompt on this query.

This methodology works as anticipated and I can get the changed transactions. Nonetheless, in some circumstances (about 20% of all of the transactions I seize) the tracepoint alerts me of the transaction being changed, however then I’m not capturing the substitute of that transaction.

I can consider two explanation why that is occurring:

1. It could possibly be that among the replacements don’t enter my mempool. But when that’s the case, how does the tracepoint is aware of that the transactions is being changed? Additionally, it’s bizarre that this may occur with so many transactions (20% as defined earlier).
2. The second choice is that the script that course of the transaction is just not contemplating some circumstances, which results in dropping transactions. The script is a modified model of this instance. I’ve modified it so I can seize the kids of the changed transactions as effectively. The information I collect with this script is later saved in a pkl file, which is why it has a shared listing.

I do not know why I’m dropping so many transactions, and I used to be questioning if somebody might assist see what I’m doing unsuitable.

Listed here are the modified capabilities:

       def handle_replaced(_, information, measurement):
          # Set up a brand new RPC connection for this occasion
          rpc_connection_replaced = connection()
          occasion = bpf["replaced_events"].occasion(information)
          hash_replaced = bytes(occasion.replaced_hash)[::-1].hex()
          hash_new = bytes(occasion.replacement_hash)[::-1].hex()
          tx_time = get_timestamp()
          
          hex_tx = rpc_connection_replaced.getrawtransaction(hash_new)
          new_tx = rpc_connection_replaced.decoderawtransaction(hex_tx)
          new_tx['hex'] = hex_tx
          # Decide mum or dad transactions which might be nonetheless within the mempool and should not the transaction itself
          mother and father = set([x['txid'] for x in new_tx['vin'] if x['txid'] in mempool.keys() and x['txid'] != new_tx['txid']])
          # Retrieve the outdated transaction data from the mempool 
          outdated = mempool.get(hash_replaced, None)
          if outdated is just not None:  # Some transactions could also be lacking initially
            mempool.pop(hash_replaced, None)
            # Share the changed occasion particulars by way of list_shared queue
            list_shared.put((outdated, [new_tx, tx_time, parents]))
            # Discover all youngster transactions that reference the brand new transaction as a mum or dad
            childs = [i[0]['txid'] for i in mempool.values() if new_tx['txid'] in i[2]]
            
            # Recursive operate to gather youngster transaction IDs
            def youngster(ll):
              if len(ll) == 0:
                return []
              new_childs = [i[0]['txid'] for i in mempool.values() if ll - i[2] != ll]
              return listing(ll) + new_childs + youngster(set(new_childs))
            
            if len(childs) > 0:
              childs = youngster(set(childs))
              # Share the connection between the brand new transaction and the primary youngster
              list_shared.put(([new_tx, tx_time, parents], mempool[childs[0]]))
              # Share connections between subsequent youngster transactions
              for i in vary(len(childs)-1):
                list_shared.put((mempool[childs[i]], mempool[childs[i+1]]))

          # Add the brand new transaction to the mempool with its timestamp and mum or dad set
          mempool[new_tx['txid']] = [new_tx, tx_time, parents]
          logger.data('-----------')
          logger.data('New RBF!')        
          
      def handle_added(_, information, measurement):
          rpc_connection_added = connection()
          occasion = bpf["added_events"].occasion(information)
          hash_new = bytes(occasion.hash)[::-1].hex()
          hex_tx = rpc_connection_added.getrawtransaction(hash_new)
          tx_raw = rpc_connection_added.decoderawtransaction(hex_tx)
          tx_raw['hex'] = hex_tx
          mother and father = set([x['txid'] for x in tx_raw['vin'] if x['txid'] in mempool.keys()])
          mempool[tx_raw['txid']] = [tx_raw, get_timestamp(), parents]
          
      def handle_removed(_, information, measurement):
        occasion = bpf["removed_events"].occasion(information)
        if occasion.motive != b'changed':
            txid_rem = bytes(occasion.hash)[::-1].hex()
                    
            keys = mempool.keys()
            if txid_rem in keys:
              mempool.pop(txid_rem) 
              logger.data('-----------')
              logger.data(f'Eliminated. Purpose:{occasion.motive}')