Chapter 22, Problem 9PE

Explanation of Solution

Things that are to be done at the time of partitioning:

• The below is done based on the idea of applying map reduce to join processing.
• There are two steps:
  • Data is repartitioned
  • Performa join operation that corresponds to the map and reduce the steps.
• A failure that occurs during the repartition can be handled by re-executing the work of the failure node.
• In the end it is ensured that tuples are not being processed twice.
• In order to avoid it all the received tuples are stored at the local disk and processing is stared only after all the tuples are being received.
• If the sender fails, meanwhile the task of the new node takes over then the receiver can discard all the tuples received from the sender that are failed and make them to receive it again but this process is considerably expensive one...