The dataset contains 5,716,808 pages and 130,160,392 links and is unzipped ~1gb large.
![]()
![]()
[oracle@bda03 hama-0.6.0-SNAPSHOT]$ hadoop dfs -ls edward Found 1 items -rw-r--r-- 3 oracle hadoop 1058414409 2012-08-28 22:16 /user/oracle/edward/links-simple-sorted.txt [oracle@bda03 hama-0.6.0-SNAPSHOT]$ bin/hama jar hama-examples-0.6.0-SNAPSHOT.jar pagerank /user/oracle/edward/links-simple-sorted.txt out 12/08/29 22:57:56 INFO bsp.FileInputFormat: Total input paths to process : 1 12/08/29 22:57:56 INFO net.NetworkTopology: Adding a new node: /switch1/192.168.10.16:50010 12/08/29 22:57:56 INFO net.NetworkTopology: Adding a new node: /switch1/192.168.10.5:50010 12/08/29 22:57:56 INFO net.NetworkTopology: Adding a new node: /switch1/192.168.10.3:50010 12/08/29 22:57:56 INFO net.NetworkTopology: Adding a new node: /switch1/192.168.10.15:50010 12/08/29 22:57:56 INFO net.NetworkTopology: Adding a new node: /switch1/192.168.10.14:50010 12/08/29 22:57:56 INFO net.NetworkTopology: Adding a new node: /switch1/192.168.10.11:50010 12/08/29 22:57:56 INFO net.NetworkTopology: Adding a new node: /switch1/192.168.10.8:50010 12/08/29 22:57:56 INFO bsp.FileInputFormat: Total # of splits: 80 12/08/29 22:57:56 INFO bsp.BSPJobClient: Running job: job_201208292257_0002 12/08/29 22:57:59 INFO bsp.BSPJobClient: Current supersteps number: 0 12/08/29 22:58:02 INFO bsp.BSPJobClient: Current supersteps number: 2 12/08/29 22:58:05 INFO bsp.BSPJobClient: Current supersteps number: 3 12/08/29 22:58:11 INFO bsp.BSPJobClient: Current supersteps number: 7 12/08/29 22:58:20 INFO bsp.BSPJobClient: Current supersteps number: 9 12/08/29 22:58:26 INFO bsp.BSPJobClient: Current supersteps number: 10 12/08/29 22:58:38 INFO bsp.BSPJobClient: Current supersteps number: 11 12/08/29 22:58:56 INFO bsp.BSPJobClient: Current supersteps number: 12 12/08/29 22:59:32 INFO bsp.BSPJobClient: Current supersteps number: 13 12/08/29 22:59:35 INFO bsp.BSPJobClient: Current supersteps number: 14 12/08/29 23:00:02 INFO bsp.BSPJobClient: Current supersteps number: 18 12/08/29 23:00:05 INFO bsp.BSPJobClient: The total number of supersteps: 18 12/08/29 23:00:05 INFO bsp.BSPJobClient: Counters: 10 12/08/29 23:00:05 INFO bsp.BSPJobClient: org.apache.hama.bsp.JobInProgress$JobCounter 12/08/29 23:00:05 INFO bsp.BSPJobClient: LAUNCHED_TASKS=80 12/08/29 23:00:05 INFO bsp.BSPJobClient: org.apache.hama.bsp.BSPPeerImpl$PeerCounter 12/08/29 23:00:05 INFO bsp.BSPJobClient: SUPERSTEPS=18 12/08/29 23:00:05 INFO bsp.BSPJobClient: SUPERSTEP_SUM=1440 12/08/29 23:00:05 INFO bsp.BSPJobClient: COMPRESSED_BYTES_SENT=6869873616 12/08/29 23:00:05 INFO bsp.BSPJobClient: TIME_IN_SYNC_MS=4284753 12/08/29 23:00:05 INFO bsp.BSPJobClient: IO_BYTES_READ=1058414409 12/08/29 23:00:05 INFO bsp.BSPJobClient: COMPRESSED_BYTES_RECEIVED=6869873616 12/08/29 23:00:05 INFO bsp.BSPJobClient: TOTAL_MESSAGES_SENT=1098375134 12/08/29 23:00:05 INFO bsp.BSPJobClient: TASK_INPUT_RECORDS=5706070 12/08/29 23:00:05 INFO bsp.BSPJobClient: TOTAL_MESSAGES_RECEIVED=549187567 Job Finished in 129.384 seconds
