Details for Stage 2 (Attempt 0)

DAG Visualization
Show Additional Metrics
Event Timeline
Enable zooming
Scheduler DelayTask Deserialization TimeShuffle Read TimeExecutor Computing TimeShuffle Write TimeResult Serialization TimeGetting Result Time
?
?
?
?
?
1 / ip-172-28-9-165.ap-southeast-2.compute.internal
2 / ip-172-28-14-194.ap-southeast-2.compute.internal
3 / ip-172-28-81-133.ap-southeast-2.compute.internal
4 / ip-172-28-125-157.ap-southeast-2.compute.internal
0
0
20:42
Wed 22 June
20:43
20:44
20:45
20:46
20:47
20:48
20:49
20:50
20:51
20:52
20:53
20:54
20:55
20:56
?
?
?
?
?
1 / ip-172-28-9-165.ap-southeast-2.compute.internal
2 / ip-172-28-14-194.ap-southeast-2.compute.internal
3 / ip-172-28-81-133.ap-southeast-2.compute.internal
4 / ip-172-28-125-157.ap-southeast-2.compute.internal
0
0
20:42
20:43
20:44
20:45
20:46
Wed 22 June
20:47
20:48
20:49
20:50
20:51
20:52
20:53
20:54
20:55
20:56
?
?
?
?
?
1 / ip-172-28-9-165.ap-southeast-2.compute.internal
2 / ip-172-28-14-194.ap-southeast-2.compute.internal
3 / ip-172-28-81-133.ap-southeast-2.compute.internal
4 / ip-172-28-125-157.ap-southeast-2.compute.internal
0
0
20:42
20:43
20:44
20:45
20:46
Wed 22 June
20:47
20:48
20:49
20:50
20:51
20:52
20:53
20:54
20:55
20:56
?
?
?
?
?
1 / ip-172-28-9-165.ap-southeast-2.compute.internal
2 / ip-172-28-14-194.ap-southeast-2.compute.internal
3 / ip-172-28-81-133.ap-southeast-2.compute.internal
4 / ip-172-28-125-157.ap-southeast-2.compute.internal
0
0
20:42
20:43
20:44
20:45
20:46
Wed 22 June
20:47
20:48
20:49
20:50
20:51
20:52
20:53
20:54
20:55
20:56

Summary Metrics for 16 Completed Tasks

MetricMin25th percentileMedian75th percentileMax
Duration13 min13 min13 min14 min14 min
Scheduler Delay1 ms16 ms23 ms27 ms83 ms
Task Deserialization Time 0.1 s0.2 s0.2 s0.2 s0.2 s
GC Time 1.1 min1.2 min1.2 min1.8 min1.8 min
Result Serialization Time 0 ms0 ms0 ms0 ms1 ms
Getting Result Time 0 ms0 ms0 ms0 ms0 ms
Peak Execution Memory 0.0 B0.0 B0.0 B0.0 B0.0 B
Output Size / Records121.4 MB / 8144.0 MB / 10152.2 MB / 13166.1 MB / 19178.9 MB / 31
Shuffle Read Blocked Time 0 ms0 ms0 ms0 ms1 ms
Shuffle Read Size / Records 21.5 KB / 835.0 KB / 1037.6 KB / 1342.1 KB / 1952.5 KB / 31
Shuffle Remote Reads 2.3 KB5.9 KB16.5 KB31.1 KB40.6 KB

Aggregated Metrics by Executor

Executor ID ▾ Address Task Time Total Tasks Failed Tasks Succeeded Tasks Output Size / Records Shuffle Read Size / Records
4 ip-172-28-125-157.ap-southeast-2.compute.internal:34653 53 min 4 0 4 577.5 MB / 46 138.6 KB / 46
3 ip-172-28-81-133.ap-southeast-2.compute.internal:42276 53 min 4 0 4 609.6 MB / 68 146.7 KB / 68
2 ip-172-28-14-194.ap-southeast-2.compute.internal:35138 55 min 4 0 4 655.2 MB / 79 164.7 KB / 79
1 ip-172-28-9-165.ap-southeast-2.compute.internal:44777 52 min 4 0 4 578.9 MB / 35 145.5 KB / 35

Tasks

Index  ▴ ID Attempt Status Locality Level Executor ID / Host Launch Time Duration Scheduler Delay Task Deserialization Time GC Time Result Serialization Time Getting Result Time Peak Execution Memory Output Size / Records Shuffle Read Blocked Time Shuffle Read Size / Records Shuffle Remote Reads Errors
0 78 0 SUCCESS NODE_LOCAL 1 / ip-172-28-9-165.ap-southeast-2.compute.internal 2016/06/22 10:42:29 13 min 27 ms 0.2 s 1.8 min 0 ms 0 ms 0.0 B 121.4 MB / 8 0 ms 52.5 KB / 8 4.9 KB
1 81 0 SUCCESS NODE_LOCAL 1 / ip-172-28-9-165.ap-southeast-2.compute.internal 2016/06/22 10:42:29 13 min 27 ms 0.2 s 1.8 min 0 ms 0 ms 0.0 B 152.2 MB / 9 1 ms 21.5 KB / 9 7.5 KB
2 84 0 SUCCESS NODE_LOCAL 1 / ip-172-28-9-165.ap-southeast-2.compute.internal 2016/06/22 10:42:29 13 min 27 ms 0.2 s 1.8 min 0 ms 0 ms 0.0 B 156.0 MB / 9 0 ms 29.5 KB / 9 2.7 KB
3 87 0 SUCCESS NODE_LOCAL 1 / ip-172-28-9-165.ap-southeast-2.compute.internal 2016/06/22 10:42:29 13 min 24 ms 0.2 s 1.8 min 0 ms 0 ms 0.0 B 149.3 MB / 9 0 ms 42.1 KB / 9 2.3 KB
4 88 0 SUCCESS RACK_LOCAL 3 / ip-172-28-81-133.ap-southeast-2.compute.internal 2016/06/22 10:42:32 14 min 1 ms 0.2 s 1.2 min 0 ms 0 ms 0.0 B 145.4 MB / 10 0 ms 35.0 KB / 10 33.6 KB
5 77 0 SUCCESS NODE_LOCAL 4 / ip-172-28-125-157.ap-southeast-2.compute.internal 2016/06/22 10:42:29 14 min 27 ms 0.2 s 1.3 min 0 ms 0 ms 0.0 B 139.8 MB / 11 0 ms 28.9 KB / 11 14.6 KB
6 80 0 SUCCESS NODE_LOCAL 4 / ip-172-28-125-157.ap-southeast-2.compute.internal 2016/06/22 10:42:29 13 min 21 ms 0.2 s 1.3 min 0 ms 0 ms 0.0 B 130.5 MB / 11 0 ms 37.4 KB / 11 22.4 KB
7 83 0 SUCCESS NODE_LOCAL 4 / ip-172-28-125-157.ap-southeast-2.compute.internal 2016/06/22 10:42:29 13 min 27 ms 0.2 s 1.2 min 1 ms 0 ms 0.0 B 128.5 MB / 11 0 ms 36.3 KB / 11 3.3 KB
8 89 0 SUCCESS RACK_LOCAL 3 / ip-172-28-81-133.ap-southeast-2.compute.internal 2016/06/22 10:42:32 13 min 6 ms 0.1 s 1.2 min 1 ms 0 ms 0.0 B 169.2 MB / 13 0 ms 30.9 KB / 13 30.3 KB
9 86 0 SUCCESS NODE_LOCAL 4 / ip-172-28-125-157.ap-southeast-2.compute.internal 2016/06/22 10:42:29 14 min 23 ms 0.2 s 1.3 min 0 ms 0 ms 0.0 B 178.9 MB / 13 0 ms 36.0 KB / 13 5.9 KB
10 90 0 SUCCESS RACK_LOCAL 3 / ip-172-28-81-133.ap-southeast-2.compute.internal 2016/06/22 10:42:32 13 min 83 ms 0.2 s 1.1 min 0 ms 0 ms 0.0 B 144.0 MB / 14 0 ms 38.4 KB / 14 37.8 KB
11 76 0 SUCCESS NODE_LOCAL 2 / ip-172-28-14-194.ap-southeast-2.compute.internal 2016/06/22 10:42:29 14 min 17 ms 0.2 s 1.2 min 0 ms 0 ms 0.0 B 158.3 MB / 16 0 ms 38.0 KB / 16 16.5 KB
12 79 0 SUCCESS NODE_LOCAL 2 / ip-172-28-14-194.ap-southeast-2.compute.internal 2016/06/22 10:42:29 13 min 19 ms 0.2 s 1.2 min 0 ms 0 ms 0.0 B 155.7 MB / 19 0 ms 47.5 KB / 19 8.3 KB
13 82 0 SUCCESS NODE_LOCAL 2 / ip-172-28-14-194.ap-southeast-2.compute.internal 2016/06/22 10:42:29 14 min 14 ms 0.2 s 1.2 min 0 ms 0 ms 0.0 B 175.1 MB / 20 1 ms 41.6 KB / 20 31.1 KB
14 85 0 SUCCESS NODE_LOCAL 2 / ip-172-28-14-194.ap-southeast-2.compute.internal 2016/06/22 10:42:29 14 min 16 ms 0.2 s 1.2 min 1 ms 0 ms 0.0 B 166.1 MB / 24 0 ms 37.6 KB / 24 22.6 KB
15 91 0 SUCCESS RACK_LOCAL 3 / ip-172-28-81-133.ap-southeast-2.compute.internal 2016/06/22 10:42:32 13 min 7 ms 0.2 s 1.1 min 0 ms 0 ms 0.0 B 151.0 MB / 31 0 ms 42.4 KB / 31 40.6 KB