# ZeroSum
This example uses ZeroSum configured by TAU.

Example configuration with oneAPI:
$ ./configure -bfd=download -cc=icx -c++=icpx -level_zero -apex -zerosum -mpi
$ make install -j

To use the example:
$ make clean
$ make
$ mpirun -np 4 tau_exec -zerosum ./ring
Found ps_tool_initialize(), registering tool
Found ps_tool_initialize(), registering tool
Found ps_tool_initialize(), registering tool
Found ps_tool_initialize(), registering tool

   .-') _   ('-.  _  .-')                 .-')                _   .-')
  (  OO) )_(  OO)( \( -O )               ( OO ).             ( '.( OO )_
,(_)----.(,------.,------.  .-'),-----. (_)---\_) ,--. ,--.   ,--.   ,--.)
|       | |  .---'|   /`. '( OO'  .-.  '/    _ |  |  | |  |   |   `.'   |
'--.   /  |  |    |  /  | |/   |  | |  |\  :` `.  |  | | .-') |         |
(_/   /  (|  '--. |  |_.' |\_) |  |\|  | '..`''.) |  |_|( OO )|  |'.'|  |
 /   /___ |  .--' |  .  '.'  \ |  | |  |.-._)   \ |  | | `-' /|  |   |  |
|        ||  `---.|  |\  \    `'  '-'  '\       /('  '-'(_.-' |  |   |  |
`--------'`------'`--' '--'     `-----'  `-----'   `-----'    `--'   `--'

0 done.
1 done.
2 done.
3 done.

Duration of execution: 5.37159 s

Process Summary:
MPI 000 - PID 3833229 - Node headroom - CPUs allowed: [0,1,2,3,4,20,21,22,23,24]

LWP (thread) Summary:
LWP 3833229:       Other - stime:   0.17, utime:   0.83, nv_ctx:     4, ctx:    37, CPUs allowed: [0,1,2,3,4,20,21,22,23,24]
LWP 3833283: ZeroSum,Other - stime:   0.00, utime:  46.60, nv_ctx:     8, ctx:    10, CPUs allowed: [24]

Hardware Summary:
CPU 000 - guest:   0.00, guest_nice:   0.00, idle:  52.80, idle_all:  52.80, iowait:   0.00, irq:   0.00, nice:   0.00, softirq:   0.80, steal:   0.00, system:   0.20, system_all:   1.00, total_time:  53.80, user:   0.00, virt_all_time:   0.00
CPU 001 - guest:   0.00, guest_nice:   0.00, idle:  53.20, idle_all:  53.20, iowait:   0.00, irq:   0.00, nice:   0.00, softirq:   0.00, steal:   0.00, system:   0.20, system_all:   0.20, total_time:  53.60, user:   0.20, virt_all_time:   0.00
CPU 002 - guest:   0.00, guest_nice:   0.00, idle:  53.40, idle_all:  53.40, iowait:   0.00, irq:   0.00, nice:   0.00, softirq:   0.00, steal:   0.00, system:   0.00, system_all:   0.00, total_time:  53.40, user:   0.00, virt_all_time:   0.00
CPU 003 - guest:   0.00, guest_nice:   0.00, idle:  53.20, idle_all:  53.20, iowait:   0.00, irq:   0.00, nice:   0.00, softirq:   0.00, steal:   0.00, system:   0.00, system_all:   0.00, total_time:  53.20, user:   0.00, virt_all_time:   0.00
CPU 004 - guest:   0.00, guest_nice:   0.00, idle:  53.20, idle_all:  53.20, iowait:   0.00, irq:   0.00, nice:   0.00, softirq:   0.00, steal:   0.00, system:   0.00, system_all:   0.00, total_time:  53.20, user:   0.00, virt_all_time:   0.00
CPU 020 - guest:   0.00, guest_nice:   0.00, idle:  51.80, idle_all:  51.80, iowait:   0.00, irq:   0.00, nice:   0.00, softirq:   0.00, steal:   0.00, system:   0.20, system_all:   0.20, total_time:  53.00, user:   1.00, virt_all_time:   0.00
CPU 021 - guest:   0.00, guest_nice:   0.00, idle:  52.60, idle_all:  52.60, iowait:   0.00, irq:   0.00, nice:   0.00, softirq:   0.00, steal:   0.00, system:   0.00, system_all:   0.00, total_time:  53.20, user:   0.60, virt_all_time:   0.00
CPU 022 - guest:   0.00, guest_nice:   0.00, idle:  53.00, idle_all:  53.00, iowait:   0.00, irq:   0.00, nice:   0.00, softirq:   0.00, steal:   0.00, system:   0.00, system_all:   0.00, total_time:  53.20, user:   0.20, virt_all_time:   0.00
CPU 023 - guest:   0.00, guest_nice:   0.00, idle:  52.00, idle_all:  52.00, iowait:   0.00, irq:   0.00, nice:   0.00, softirq:   0.20, steal:   0.00, system:   0.40, system_all:   0.60, total_time:  52.60, user:   0.00, virt_all_time:   0.00
CPU 024 - guest:   0.00, guest_nice:   0.00, idle:  53.20, idle_all:  53.20, iowait:   0.00, irq:   0.00, nice:   0.00, softirq:   0.00, steal:   0.00, system:   0.20, system_all:   0.20, total_time:  53.40, user:   0.00, virt_all_time:   0.00

P2P Communication Summary:

$pprof
Reading Profile files in profile.*

NODE 0;CONTEXT 0;THREAD 0:
---------------------------------------------------------------------------------------
%Time    Exclusive    Inclusive       #Call      #Subrs  Inclusive Name
              msec   total msec                          usec/call
---------------------------------------------------------------------------------------
100.0           18        5,394           1           1    5394389 .TAU application
 99.7           14        5,375           1           4    5375525 int taupreload_main(int, char **, char **)
 99.3        5,011        5,356           1           5    5356763 main
  6.0          325          325           1           0     325837 MPI_Init()
  0.4        0.062           19           1           8      19048 func
  0.3           18           18           1           0      18812 MPI_Barrier()
  0.1            3            3           1           0       3692 pthread_join
  0.0         0.33         0.33           1           0        330 MPI_Finalize()
  0.0        0.293        0.293           1           0        293 void zerosum::ZeroSum::getProcStatus()
  0.0        0.086        0.086           3           0         29 MPI_Recv()
  0.0        0.042        0.047           1           1         47 MPI_Bcast()
  0.0        0.041        0.041           3           0         14 MPI_Send()
  0.0         0.04         0.04           1           0         40 pthread_create
  0.0         0.01         0.01           1           0         10 MPI_Comm_size()
  0.0        0.005        0.005           1           0          5 MPI Collective Sync
  0.0        0.003        0.003           1           0          3 MPI_Comm_rank()
---------------------------------------------------------------------------------------

USER EVENTS Profile :NODE 0, CONTEXT 0, THREAD 0
---------------------------------------------------------------------------------------
NumSamples   MaxValue   MinValue  MeanValue  Std. Dev.  Event Name
---------------------------------------------------------------------------------------
         1          1          1          1          0  LWP_3833229:majflt
         1       1077       1077       1077          0  LWP_3833229:minflt
         1          0          0          0          0  LWP_3833229:nonvoluntary_ctxt_switches
         1          0          0          0          0  LWP_3833229:nswap
         1         24         24         24          0  LWP_3833229:processor
         1          0          0          0          0  LWP_3833229:step
         1          0          0          0          0  LWP_3833229:stime
         1          0          0          0          0  LWP_3833229:utime
         1         15         15         15          0  LWP_3833229:voluntary_ctxt_switches
         1         40         40         40          0  Message size for broadcast
---------------------------------------------------------------------------------------

NODE 0;CONTEXT 0;THREAD 1:
---------------------------------------------------------------------------------------
%Time    Exclusive    Inclusive       #Call      #Subrs  Inclusive Name
              msec   total msec                          usec/call
---------------------------------------------------------------------------------------
100.0            1        5,366           1           1    5366868 .TAU application
100.0        0.027        5,365           1           1    5365404 [PTHREAD] addr=<7fdb6b7ebda0>
100.0        5,349        5,365           1      100008    5365377 void zerosum::ZeroSum::threadedFunction()
  0.2            8            8           6           0       1384 void zerosum::ZeroSum::doPeriodic()
  0.1            7            7      100001           0          0 bool zerosum::ZeroSum::doOnce() [THROTTLED]
  0.0        0.115        0.157           1           3        157 void zerosum::ZeroSum::getMPIinfo()
  0.0        0.018        0.018           1           0         18 MPI_Comm_rank()
  0.0        0.012        0.012           1           0         12 MPI_Comm_size()
  0.0        0.012        0.012           1           0         12 MPI_Get_processor_name()
---------------------------------------------------------------------------------------

USER EVENTS Profile :NODE 0, CONTEXT 0, THREAD 1
---------------------------------------------------------------------------------------
NumSamples   MaxValue   MinValue  MeanValue  Std. Dev.  Event Name
---------------------------------------------------------------------------------------
         6          0          0          0          0  HWT_0:guest
         6          0          0          0          0  HWT_0:guest_nice
         6  1.112E+08  1.112E+08  1.112E+08      80.04  HWT_0:idle
         6  1.113E+08  1.113E+08  1.113E+08      80.04  HWT_0:idle_all
         6  3.551E+04  3.551E+04  3.551E+04          0  HWT_0:iowait
         6          0          0          0          0  HWT_0:irq
         6   2.23E+04   2.23E+04   2.23E+04          0  HWT_0:nice
         6  7.371E+05  7.371E+05  7.371E+05      1.491  HWT_0:softirq
         6          0          0          0          0  HWT_0:steal
         6  1.722E+07  1.722E+07  1.722E+07          0  HWT_0:system
         6  1.796E+07  1.796E+07  1.796E+07       1.75  HWT_0:system_all
         6  1.978E+08  1.978E+08  1.978E+08      81.83  HWT_0:total_time
         6  6.858E+07  6.858E+07  6.858E+07          1  HWT_0:user
         6          0          0          0          0  HWT_0:virt_all_time
         6          0          0          0          0  HWT_10:guest
         6          0          0          0          0  HWT_10:guest_nice
         6  1.092E+08  1.092E+08  1.092E+08       80.8  HWT_10:idle
         6  1.093E+08  1.093E+08  1.093E+08       80.8  HWT_10:idle_all
         6  2.754E+04  2.754E+04  2.754E+04          0  HWT_10:iowait
         6          0          0          0          0  HWT_10:irq
         6   2.63E+04   2.63E+04   2.63E+04          0  HWT_10:nice
         6  3.891E+04  3.891E+04  3.891E+04          0  HWT_10:softirq
         6          0          0          0          0  HWT_10:steal
         6  1.748E+07  1.748E+07  1.748E+07          0  HWT_10:system
         6  1.752E+07  1.752E+07  1.752E+07          0  HWT_10:system_all
         6  1.975E+08  1.975E+08  1.975E+08      81.83  HWT_10:total_time
         6  7.071E+07  7.071E+07  7.071E+07          1  HWT_10:user
         6          0          0          0          0  HWT_10:virt_all_time
         6          0          0          0          0  HWT_11:guest
         6          0          0          0          0  HWT_11:guest_nice
         6  1.096E+08  1.096E+08  1.096E+08      82.11  HWT_11:idle
         6  1.096E+08  1.096E+08  1.096E+08      82.11  HWT_11:idle_all
         6  2.474E+04  2.474E+04  2.474E+04          0  HWT_11:iowait
         6          0          0          0          0  HWT_11:irq
         6  2.434E+04  2.434E+04  2.434E+04          0  HWT_11:nice
         6  3.382E+04  3.382E+04  3.382E+04          0  HWT_11:softirq
         6          0          0          0          0  HWT_11:steal
         6  1.838E+07  1.838E+07  1.838E+07          0  HWT_11:system
         6  1.841E+07  1.841E+07  1.841E+07          0  HWT_11:system_all
         6  1.976E+08  1.976E+08  1.976E+08      81.83  HWT_11:total_time
         6  6.952E+07  6.952E+07  6.952E+07          0  HWT_11:user
         6          0          0          0          0  HWT_11:virt_all_time
         6          0          0          0          0  HWT_12:guest
         6          0          0          0          0  HWT_12:guest_nice
         6   1.11E+08   1.11E+08   1.11E+08      2.449  HWT_12:idle
         6  1.111E+08  1.111E+08  1.111E+08          0  HWT_12:idle_all
         6  2.056E+04  2.056E+04  2.056E+04          0  HWT_12:iowait
         6          0          0          0          0  HWT_12:irq
         6  2.474E+04  2.474E+04  2.474E+04          0  HWT_12:nice
         6  1.029E+04  1.029E+04  1.029E+04          0  HWT_12:softirq
         6          0          0          0          0  HWT_12:steal
         6  1.819E+07  1.819E+07  1.819E+07      1.436  HWT_12:system
         6   1.82E+07   1.82E+07   1.82E+07     0.6124  HWT_12:system_all
         6  1.976E+08  1.976E+08  1.976E+08      77.56  HWT_12:total_time
         6  6.828E+07  6.828E+07  6.828E+07      79.01  HWT_12:user
         6          0          0          0          0  HWT_12:virt_all_time
         6          0          0          0          0  HWT_13:guest
         6          0          0          0          0  HWT_13:guest_nice
         6  1.103E+08  1.103E+08  1.103E+08      80.01  HWT_13:idle
         6  1.104E+08  1.104E+08  1.104E+08      80.01  HWT_13:idle_all
         6  2.318E+04  2.318E+04  2.318E+04          0  HWT_13:iowait
         6          0          0          0          0  HWT_13:irq
         6  3.101E+04  3.101E+04  3.101E+04          0  HWT_13:nice
         6       9328       9328       9328          0  HWT_13:softirq
         6          0          0          0          0  HWT_13:steal
         6  1.715E+07  1.715E+07  1.715E+07          0  HWT_13:system
         6  1.716E+07  1.716E+07  1.716E+07          0  HWT_13:system_all
         6  1.976E+08  1.976E+08  1.976E+08      82.51  HWT_13:total_time
         6  7.005E+07  7.005E+07  7.005E+07          1  HWT_13:user
         6          0          0          0          0  HWT_13:virt_all_time
         6          0          0          0          0  HWT_14:guest
         6          0          0          0          0  HWT_14:guest_nice
         6  1.102E+08  1.102E+08  1.102E+08      82.11  HWT_14:idle
         6  1.103E+08  1.103E+08  1.103E+08         80  HWT_14:idle_all
         6  2.344E+04  2.344E+04  2.344E+04          0  HWT_14:iowait
         6          0          0          0          0  HWT_14:irq
         6  2.192E+04  2.192E+04  2.192E+04          0  HWT_14:nice
         6       8455       8455       8455          0  HWT_14:softirq
         6          0          0          0          0  HWT_14:steal
         6  1.808E+07  1.808E+07  1.808E+07          0  HWT_14:system
         6  1.809E+07  1.809E+07  1.809E+07     0.8292  HWT_14:system_all
         6  1.976E+08  1.976E+08  1.976E+08         84  HWT_14:total_time
         6  6.921E+07  6.921E+07  6.921E+07          1  HWT_14:user
         6          0          0          0          0  HWT_14:virt_all_time
         6          0          0          0          0  HWT_15:guest
         6          0          0          0          0  HWT_15:guest_nice
         6  1.104E+08  1.104E+08  1.104E+08      82.11  HWT_15:idle
         6  1.104E+08  1.104E+08  1.104E+08       80.8  HWT_15:idle_all
         6  2.377E+04  2.377E+04  2.377E+04          0  HWT_15:iowait
         6          0          0          0          0  HWT_15:irq
         6  2.791E+04  2.791E+04  2.791E+04          0  HWT_15:nice
         6  1.061E+04  1.061E+04  1.061E+04          0  HWT_15:softirq
         6          0          0          0          0  HWT_15:steal
         6  1.706E+07  1.706E+07  1.706E+07          0  HWT_15:system
         6  1.707E+07  1.707E+07  1.707E+07          0  HWT_15:system_all
         6  1.976E+08  1.976E+08  1.976E+08      77.61  HWT_15:total_time
         6   7.01E+07   7.01E+07   7.01E+07          1  HWT_15:user
         6          0          0          0          0  HWT_15:virt_all_time
         6          0          0          0          0  HWT_16:guest
         6          0          0          0          0  HWT_16:guest_nice
         6  1.104E+08  1.104E+08  1.104E+08       80.8  HWT_16:idle
         6  1.105E+08  1.105E+08  1.105E+08      82.11  HWT_16:idle_all
         6  3.116E+04  3.116E+04  3.116E+04          0  HWT_16:iowait
         6          0          0          0          0  HWT_16:irq
         6  1.946E+04  1.946E+04  1.946E+04          0  HWT_16:nice
         6       8895       8895       8895          0  HWT_16:softirq
         6          0          0          0          0  HWT_16:steal
         6  1.731E+07  1.731E+07  1.731E+07          0  HWT_16:system
         6  1.732E+07  1.732E+07  1.732E+07          0  HWT_16:system_all
         6  1.976E+08  1.976E+08  1.976E+08      84.05  HWT_16:total_time
         6  6.979E+07  6.979E+07  6.979E+07          1  HWT_16:user
         6          0          0          0          0  HWT_16:virt_all_time
         6          0          0          0          0  HWT_17:guest
         6          0          0          0          0  HWT_17:guest_nice
         6  1.105E+08  1.105E+08  1.105E+08      82.11  HWT_17:idle
         6  1.105E+08  1.105E+08  1.105E+08      80.01  HWT_17:idle_all
         6  2.764E+04  2.764E+04  2.764E+04          0  HWT_17:iowait
         6          0          0          0          0  HWT_17:irq
         6  2.815E+04  2.815E+04  2.815E+04          0  HWT_17:nice
         6       9628       9628       9628          0  HWT_17:softirq
         6          0          0          0          0  HWT_17:steal
         6   1.71E+07   1.71E+07   1.71E+07          0  HWT_17:system
         6  1.711E+07  1.711E+07  1.711E+07          0  HWT_17:system_all
         6  1.976E+08  1.976E+08  1.976E+08      82.46  HWT_17:total_time
         6  6.995E+07  6.995E+07  6.995E+07          1  HWT_17:user
         6          0          0          0          0  HWT_17:virt_all_time
         6          0          0          0          0  HWT_18:guest
         6          0          0          0          0  HWT_18:guest_nice
         6  1.101E+08  1.101E+08  1.101E+08      80.51  HWT_18:idle
         6  1.101E+08  1.101E+08  1.101E+08       79.7  HWT_18:idle_all
         6   2.37E+04   2.37E+04   2.37E+04          0  HWT_18:iowait
         6          0          0          0          0  HWT_18:irq
         6  2.048E+04  2.048E+04  2.048E+04          0  HWT_18:nice
         6  3.758E+04  3.758E+04  3.758E+04          0  HWT_18:softirq
         6          0          0          0          0  HWT_18:steal
         6  1.715E+07  1.715E+07  1.715E+07          0  HWT_18:system
         6  1.719E+07  1.719E+07  1.719E+07          0  HWT_18:system_all
         6  1.976E+08  1.976E+08  1.976E+08      82.41  HWT_18:total_time
         6  7.024E+07  7.024E+07  7.024E+07          0  HWT_18:user
         6          0          0          0          0  HWT_18:virt_all_time
         6          0          0          0          0  HWT_19:guest
         6          0          0          0          0  HWT_19:guest_nice
         6  1.091E+08  1.091E+08  1.091E+08      82.11  HWT_19:idle
         6  1.091E+08  1.091E+08  1.091E+08       80.8  HWT_19:idle_all
         6  3.029E+04  3.029E+04  3.029E+04          0  HWT_19:iowait
         6          0          0          0          0  HWT_19:irq
         6   2.59E+04   2.59E+04   2.59E+04          0  HWT_19:nice
         6  3.522E+04  3.522E+04  3.522E+04          0  HWT_19:softirq
         6          0          0          0          0  HWT_19:steal
         6  1.744E+07  1.744E+07  1.744E+07          0  HWT_19:system
         6  1.747E+07  1.747E+07  1.747E+07          0  HWT_19:system_all
         6  1.976E+08  1.976E+08  1.976E+08      77.67  HWT_19:total_time
         6  7.098E+07  7.098E+07  7.098E+07          1  HWT_19:user
         6          0          0          0          0  HWT_19:virt_all_time
         6          0          0          0          0  HWT_1:guest
         6          0          0          0          0  HWT_1:guest_nice
         6  1.101E+08  1.101E+08  1.101E+08      82.11  HWT_1:idle
         6  1.101E+08  1.101E+08  1.101E+08       80.8  HWT_1:idle_all
         6  2.812E+04  2.812E+04  2.812E+04          0  HWT_1:iowait
         6          0          0          0          0  HWT_1:irq
         6   2.61E+04   2.61E+04   2.61E+04          0  HWT_1:nice
         6  1.136E+05  1.136E+05  1.136E+05          0  HWT_1:softirq
         6          0          0          0          0  HWT_1:steal
         6  1.775E+07  1.775E+07  1.775E+07          0  HWT_1:system
         6  1.786E+07  1.786E+07  1.786E+07          0  HWT_1:system_all
         6  1.975E+08  1.975E+08  1.975E+08      77.67  HWT_1:total_time
         6   6.95E+07   6.95E+07   6.95E+07          1  HWT_1:user
         6          0          0          0          0  HWT_1:virt_all_time
         6          0          0          0          0  HWT_20:guest
         6          0          0          0          0  HWT_20:guest_nice
         6  1.092E+08  1.092E+08  1.092E+08       77.7  HWT_20:idle
         6  1.093E+08  1.093E+08  1.093E+08       77.7  HWT_20:idle_all
         6  2.175E+04  2.175E+04  2.175E+04          0  HWT_20:iowait
         6          0          0          0          0  HWT_20:irq
         6  2.664E+04  2.664E+04  2.664E+04          0  HWT_20:nice
         6  2.841E+04  2.841E+04  2.841E+04          0  HWT_20:softirq
         6          0          0          0          0  HWT_20:steal
         6  1.699E+07  1.699E+07  1.699E+07          0  HWT_20:system
         6  1.701E+07  1.701E+07  1.701E+07          0  HWT_20:system_all
         6  1.976E+08  1.976E+08  1.976E+08      77.61  HWT_20:total_time
         6  7.124E+07  7.124E+07  7.124E+07          1  HWT_20:user
         6          0          0          0          0  HWT_20:virt_all_time
         6          0          0          0          0  HWT_21:guest
         6          0          0          0          0  HWT_21:guest_nice
         6  1.106E+08  1.106E+08  1.106E+08       79.7  HWT_21:idle
         6  1.106E+08  1.106E+08  1.106E+08       80.8  HWT_21:idle_all
         6   2.03E+04   2.03E+04   2.03E+04          0  HWT_21:iowait
         6          0          0          0          0  HWT_21:irq
         6  2.462E+04  2.462E+04  2.462E+04          0  HWT_21:nice
         6       6806       6806       6806          0  HWT_21:softirq
         6          0          0          0          0  HWT_21:steal
         6  1.703E+07  1.703E+07  1.703E+07          0  HWT_21:system
         6  1.704E+07  1.704E+07  1.704E+07          0  HWT_21:system_all
         6  1.976E+08  1.976E+08  1.976E+08      77.56  HWT_21:total_time
         6  6.987E+07  6.987E+07  6.987E+07          1  HWT_21:user
         6          0          0          0          0  HWT_21:virt_all_time
         6          0          0          0          0  HWT_22:guest
         6          0          0          0          0  HWT_22:guest_nice
         6  1.107E+08  1.107E+08  1.107E+08       80.8  HWT_22:idle
         6  1.107E+08  1.107E+08  1.107E+08       79.7  HWT_22:idle_all
         6  4.532E+04  4.532E+04  4.532E+04          0  HWT_22:iowait
         6          0          0          0          0  HWT_22:irq
         6  1.842E+04  1.842E+04  1.842E+04          0  HWT_22:nice
         6       9128       9128       9128          0  HWT_22:softirq
         6          0          0          0          0  HWT_22:steal
         6  1.687E+07  1.687E+07  1.687E+07          0  HWT_22:system
         6  1.688E+07  1.688E+07  1.688E+07          0  HWT_22:system_all
         6  1.974E+08  1.974E+08  1.974E+08      77.72  HWT_22:total_time
         6  6.975E+07  6.975E+07  6.975E+07          1  HWT_22:user
         6          0          0          0          0  HWT_22:virt_all_time
         6          0          0          0          0  HWT_23:guest
         6          0          0          0          0  HWT_23:guest_nice
         6   1.09E+08   1.09E+08   1.09E+08       79.7  HWT_23:idle
         6   1.09E+08   1.09E+08   1.09E+08      78.38  HWT_23:idle_all
         6  5.931E+04  5.931E+04  5.931E+04          0  HWT_23:iowait
         6          0          0          0          0  HWT_23:irq
         6   3.25E+04   3.25E+04   3.25E+04          0  HWT_23:nice
         6  9.204E+05  9.204E+05  9.204E+05     0.3729  HWT_23:softirq
         6          0          0          0          0  HWT_23:steal
         6   1.76E+07   1.76E+07   1.76E+07     0.8292  HWT_23:system
         6  1.852E+07  1.852E+07  1.852E+07      0.866  HWT_23:system_all
         6  1.965E+08  1.965E+08  1.965E+08      77.61  HWT_23:total_time
         6  6.895E+07  6.895E+07  6.895E+07          1  HWT_23:user
         6          0          0          0          0  HWT_23:virt_all_time
         6          0          0          0          0  HWT_24:guest
         6          0          0          0          0  HWT_24:guest_nice
         6  1.106E+08  1.106E+08  1.106E+08      80.01  HWT_24:idle
         6  1.107E+08  1.107E+08  1.107E+08       80.8  HWT_24:idle_all
         6  4.994E+04  4.994E+04  4.994E+04          0  HWT_24:iowait
         6          0          0          0          0  HWT_24:irq
         6  1.893E+04  1.893E+04  1.893E+04          0  HWT_24:nice
         6  2.742E+04  2.742E+04  2.742E+04          0  HWT_24:softirq
         6          0          0          0          0  HWT_24:steal
         6   1.71E+07   1.71E+07   1.71E+07          0  HWT_24:system
         6  1.713E+07  1.713E+07  1.713E+07     0.6124  HWT_24:system_all
         6  1.975E+08  1.975E+08  1.975E+08      82.46  HWT_24:total_time
         6  6.965E+07  6.965E+07  6.965E+07          0  HWT_24:user
         6          0          0          0          0  HWT_24:virt_all_time
         6          0          0          0          0  HWT_25:guest
         6          0          0          0          0  HWT_25:guest_nice
         6  1.109E+08  1.109E+08  1.109E+08      77.33  HWT_25:idle
         6   1.11E+08   1.11E+08   1.11E+08       79.7  HWT_25:idle_all
         6  3.967E+04  3.967E+04  3.967E+04          0  HWT_25:iowait
         6          0          0          0          0  HWT_25:irq
         6  2.551E+04  2.551E+04  2.551E+04          0  HWT_25:nice
         6  3.164E+04  3.164E+04  3.164E+04          0  HWT_25:softirq
         6          0          0          0          0  HWT_25:steal
         6  1.701E+07  1.701E+07  1.701E+07       3.01  HWT_25:system
         6  1.704E+07  1.704E+07  1.704E+07       3.01  HWT_25:system_all
         6  1.976E+08  1.976E+08  1.976E+08      84.05  HWT_25:total_time
         6  6.952E+07  6.952E+07  6.952E+07          1  HWT_25:user
         6          0          0          0          0  HWT_25:virt_all_time
         6          0          0          0          0  HWT_26:guest
         6          0          0          0          0  HWT_26:guest_nice
         6  1.111E+08  1.111E+08  1.111E+08       79.7  HWT_26:idle
         6  1.111E+08  1.111E+08  1.111E+08       79.7  HWT_26:idle_all
         6  2.662E+04  2.662E+04  2.662E+04          0  HWT_26:iowait
         6          0          0          0          0  HWT_26:irq
         6  1.896E+04  1.896E+04  1.896E+04          0  HWT_26:nice
         6       9599       9599       9599          0  HWT_26:softirq
         6          0          0          0          0  HWT_26:steal
         6  1.712E+07  1.712E+07  1.712E+07      1.436  HWT_26:system
         6  1.713E+07  1.713E+07  1.713E+07      1.414  HWT_26:system_all
         6  1.976E+08  1.976E+08  1.976E+08      77.61  HWT_26:total_time
         6  6.931E+07  6.931E+07  6.931E+07          1  HWT_26:user
         6          0          0          0          0  HWT_26:virt_all_time
         6          0          0          0          0  HWT_27:guest
         6          0          0          0          0  HWT_27:guest_nice
         6  1.111E+08  1.111E+08  1.111E+08      75.15  HWT_27:idle
         6  1.111E+08  1.111E+08  1.111E+08      75.17  HWT_27:idle_all
         6  2.882E+04  2.882E+04  2.882E+04          0  HWT_27:iowait
         6          0          0          0          0  HWT_27:irq
         6  3.854E+04  3.854E+04  3.854E+04          0  HWT_27:nice
         6   1.14E+04  1.139E+04  1.139E+04     0.3727  HWT_27:softirq
         6          0          0          0          0  HWT_27:steal
         6  1.697E+07  1.697E+07  1.697E+07      5.948  HWT_27:system
         6  1.698E+07  1.698E+07  1.698E+07      6.708  HWT_27:system_all
         6  1.976E+08  1.976E+08  1.976E+08      77.61  HWT_27:total_time
         6  6.949E+07  6.949E+07  6.949E+07          1  HWT_27:user
         6          0          0          0          0  HWT_27:virt_all_time
         6          0          0          0          0  HWT_28:guest
         6          0          0          0          0  HWT_28:guest_nice
         6  1.127E+08  1.127E+08  1.127E+08       79.7  HWT_28:idle
         6  1.127E+08  1.127E+08  1.127E+08       79.7  HWT_28:idle_all
         6   2.99E+04   2.99E+04   2.99E+04          0  HWT_28:iowait
         6          0          0          0          0  HWT_28:irq
         6  2.385E+04  2.385E+04  2.385E+04          0  HWT_28:nice
         6       5736       5736       5736          0  HWT_28:softirq
         6          0          0          0          0  HWT_28:steal
         6  1.756E+07  1.756E+07  1.756E+07          0  HWT_28:system
         6  1.756E+07  1.756E+07  1.756E+07          0  HWT_28:system_all
         6  1.975E+08  1.975E+08  1.975E+08      77.56  HWT_28:total_time
         6  6.717E+07  6.717E+07  6.717E+07          1  HWT_28:user
         6          0          0          0          0  HWT_28:virt_all_time
         6          0          0          0          0  HWT_29:guest
         6          0          0          0          0  HWT_29:guest_nice
         6  1.108E+08  1.108E+08  1.108E+08       78.4  HWT_29:idle
         6  1.109E+08  1.109E+08  1.109E+08       77.7  HWT_29:idle_all
         6  3.186E+04  3.186E+04  3.186E+04          0  HWT_29:iowait
         6          0          0          0          0  HWT_29:irq
         6  2.478E+04  2.478E+04  2.478E+04          0  HWT_29:nice
         6  3.074E+04  3.074E+04  3.074E+04          0  HWT_29:softirq
         6          0          0          0          0  HWT_29:steal
         6  1.717E+07  1.717E+07  1.717E+07       3.01  HWT_29:system
         6   1.72E+07   1.72E+07   1.72E+07       3.01  HWT_29:system_all
         6  1.976E+08  1.976E+08  1.976E+08      81.83  HWT_29:total_time
         6   6.95E+07   6.95E+07   6.95E+07          1  HWT_29:user
         6          0          0          0          0  HWT_29:virt_all_time
         6          0          0          0          0  HWT_2:guest
         6          0          0          0          0  HWT_2:guest_nice
         6  1.098E+08  1.098E+08  1.098E+08      82.11  HWT_2:idle
         6  1.098E+08  1.098E+08  1.098E+08       80.8  HWT_2:idle_all
         6  3.624E+04  3.624E+04  3.624E+04          0  HWT_2:iowait
         6          0          0          0          0  HWT_2:irq
         6  2.379E+04  2.379E+04  2.379E+04          0  HWT_2:nice
         6  4.544E+04  4.544E+04  4.544E+04          0  HWT_2:softirq
         6          0          0          0          0  HWT_2:steal
         6  1.765E+07  1.765E+07  1.765E+07          0  HWT_2:system
         6  1.769E+07  1.769E+07  1.769E+07          0  HWT_2:system_all
         6  1.976E+08  1.976E+08  1.976E+08         84  HWT_2:total_time
         6  7.003E+07  7.003E+07  7.003E+07          1  HWT_2:user
         6          0          0          0          0  HWT_2:virt_all_time
         6          0          0          0          0  HWT_30:guest
         6          0          0          0          0  HWT_30:guest_nice
         6  1.099E+08  1.099E+08  1.099E+08          0  HWT_30:idle
         6  1.099E+08  1.099E+08  1.099E+08          0  HWT_30:idle_all
         6  2.072E+04  2.072E+04  2.072E+04          0  HWT_30:iowait
         6          0          0          0          0  HWT_30:irq
         6  2.613E+04  2.613E+04  2.613E+04          0  HWT_30:nice
         6  3.164E+04  3.164E+04  3.164E+04          0  HWT_30:softirq
         6          0          0          0          0  HWT_30:steal
         6  1.688E+07  1.688E+07  1.688E+07      1.521  HWT_30:system
         6  1.691E+07  1.691E+07  1.691E+07      1.936  HWT_30:system_all
         6  1.976E+08  1.976E+08  1.976E+08      81.83  HWT_30:total_time
         6  7.076E+07  7.076E+07  7.076E+07      79.71  HWT_30:user
         6          0          0          0          0  HWT_30:virt_all_time
         6          0          0          0          0  HWT_31:guest
         6          0          0          0          0  HWT_31:guest_nice
         6  1.112E+08  1.112E+08  1.112E+08      80.01  HWT_31:idle
         6  1.112E+08  1.112E+08  1.112E+08      82.11  HWT_31:idle_all
         6  2.174E+04  2.173E+04  2.173E+04      1.414  HWT_31:iowait
         6          0          0          0          0  HWT_31:irq
         6  2.102E+04  2.102E+04  2.102E+04          0  HWT_31:nice
         6       8756       8756       8756          0  HWT_31:softirq
         6          0          0          0          0  HWT_31:steal
         6  1.769E+07  1.769E+07  1.769E+07          0  HWT_31:system
         6   1.77E+07   1.77E+07   1.77E+07          0  HWT_31:system_all
         6  1.976E+08  1.976E+08  1.976E+08         84  HWT_31:total_time
         6  6.866E+07  6.866E+07  6.866E+07          1  HWT_31:user
         6          0          0          0          0  HWT_31:virt_all_time
         6          0          0          0          0  HWT_32:guest
         6          0          0          0          0  HWT_32:guest_nice
         6  1.083E+08  1.083E+08  1.083E+08       79.7  HWT_32:idle
         6  1.083E+08  1.083E+08  1.083E+08       79.7  HWT_32:idle_all
         6  2.385E+04  2.385E+04  2.385E+04          0  HWT_32:iowait
         6          0          0          0          0  HWT_32:irq
         6  1.677E+04  1.677E+04  1.677E+04          0  HWT_32:nice
         6  9.694E+05  9.694E+05  9.694E+05      1.118  HWT_32:softirq
         6          0          0          0          0  HWT_32:steal
         6  1.799E+07  1.799E+07  1.799E+07          0  HWT_32:system
         6  1.896E+07  1.896E+07  1.896E+07      0.866  HWT_32:system_all
         6  1.966E+08  1.966E+08  1.966E+08      77.61  HWT_32:total_time
         6  6.926E+07  6.926E+07  6.926E+07          1  HWT_32:user
         6          0          0          0          0  HWT_32:virt_all_time
         6          0          0          0          0  HWT_33:guest
         6          0          0          0          0  HWT_33:guest_nice
         6  1.105E+08  1.105E+08  1.105E+08       80.8  HWT_33:idle
         6  1.106E+08  1.106E+08  1.106E+08       79.7  HWT_33:idle_all
         6  2.133E+04  2.133E+04  2.133E+04          0  HWT_33:iowait
         6          0          0          0          0  HWT_33:irq
         6  2.527E+04  2.527E+04  2.527E+04          0  HWT_33:nice
         6  3.184E+04  3.184E+04  3.184E+04          0  HWT_33:softirq
         6          0          0          0          0  HWT_33:steal
         6    1.7E+07    1.7E+07    1.7E+07      0.866  HWT_33:system
         6  1.703E+07  1.703E+07  1.703E+07      0.866  HWT_33:system_all
         6  1.974E+08  1.974E+08  1.974E+08      84.05  HWT_33:total_time
         6  6.982E+07  6.982E+07  6.982E+07          1  HWT_33:user
         6          0          0          0          0  HWT_33:virt_all_time
         6          0          0          0          0  HWT_34:guest
         6          0          0          0          0  HWT_34:guest_nice
         6  1.093E+08  1.093E+08  1.093E+08       80.8  HWT_34:idle
         6  1.094E+08  1.094E+08  1.094E+08      78.38  HWT_34:idle_all
         6  2.306E+04  2.306E+04  2.306E+04          0  HWT_34:iowait
         6          0          0          0          0  HWT_34:irq
         6  1.605E+04  1.605E+04  1.605E+04          0  HWT_34:nice
         6  8.483E+05  8.483E+05  8.483E+05     0.7453  HWT_34:softirq
         6          0          0          0          0  HWT_34:steal
         6  1.744E+07  1.744E+07  1.744E+07          0  HWT_34:system
         6  1.829E+07  1.829E+07  1.829E+07      1.436  HWT_34:system_all
         6  1.965E+08  1.965E+08  1.965E+08      77.56  HWT_34:total_time
         6  6.887E+07  6.887E+07  6.887E+07          1  HWT_34:user
         6          0          0          0          0  HWT_34:virt_all_time
         6          0          0          0          0  HWT_35:guest
         6          0          0          0          0  HWT_35:guest_nice
         6  1.105E+08  1.105E+08  1.105E+08       77.7  HWT_35:idle
         6  1.106E+08  1.106E+08  1.106E+08       79.7  HWT_35:idle_all
         6  2.188E+04  2.188E+04  2.188E+04          0  HWT_35:iowait
         6          0          0          0          0  HWT_35:irq
         6  2.339E+04  2.339E+04  2.339E+04          0  HWT_35:nice
         6  2.922E+04  2.922E+04  2.922E+04          0  HWT_35:softirq
         6          0          0          0          0  HWT_35:steal
         6  1.695E+07  1.695E+07  1.695E+07          0  HWT_35:system
         6  1.698E+07  1.698E+07  1.698E+07          0  HWT_35:system_all
         6  1.975E+08  1.975E+08  1.975E+08      77.56  HWT_35:total_time
         6  6.989E+07  6.989E+07  6.989E+07          1  HWT_35:user
         6          0          0          0          0  HWT_35:virt_all_time
         6          0          0          0          0  HWT_36:guest
         6          0          0          0          0  HWT_36:guest_nice
         6  1.108E+08  1.108E+08  1.108E+08       79.7  HWT_36:idle
         6  1.108E+08  1.108E+08  1.108E+08       79.7  HWT_36:idle_all
         6  2.539E+04  2.539E+04  2.539E+04          0  HWT_36:iowait
         6          0          0          0          0  HWT_36:irq
         6  2.358E+04  2.358E+04  2.358E+04          0  HWT_36:nice
         6  4.776E+04  4.776E+04  4.776E+04          0  HWT_36:softirq
         6          0          0          0          0  HWT_36:steal
         6  1.699E+07  1.699E+07  1.699E+07     0.8292  HWT_36:system
         6  1.704E+07  1.704E+07  1.704E+07          0  HWT_36:system_all
         6  1.975E+08  1.975E+08  1.975E+08      77.61  HWT_36:total_time
         6  6.963E+07  6.963E+07  6.963E+07          1  HWT_36:user
         6          0          0          0          0  HWT_36:virt_all_time
         6          0          0          0          0  HWT_37:guest
         6          0          0          0          0  HWT_37:guest_nice
         6  1.106E+08  1.106E+08  1.106E+08       79.7  HWT_37:idle
         6  1.107E+08  1.107E+08  1.107E+08       80.5  HWT_37:idle_all
         6  3.009E+04  3.009E+04  3.009E+04          0  HWT_37:iowait
         6          0          0          0          0  HWT_37:irq
         6  2.658E+04  2.658E+04  2.658E+04          0  HWT_37:nice
         6  5.836E+04  5.836E+04  5.836E+04          0  HWT_37:softirq
         6          0          0          0          0  HWT_37:steal
         6  1.691E+07  1.691E+07  1.691E+07          0  HWT_37:system
         6  1.697E+07  1.697E+07  1.697E+07          0  HWT_37:system_all
         6  1.975E+08  1.975E+08  1.975E+08      81.78  HWT_37:total_time
         6  6.983E+07  6.983E+07  6.983E+07          1  HWT_37:user
         6          0          0          0          0  HWT_37:virt_all_time
         6          0          0          0          0  HWT_38:guest
         6          0          0          0          0  HWT_38:guest_nice
         6  1.109E+08  1.109E+08  1.109E+08      82.11  HWT_38:idle
         6   1.11E+08   1.11E+08   1.11E+08       80.8  HWT_38:idle_all
         6  2.524E+04  2.524E+04  2.524E+04          0  HWT_38:iowait
         6          0          0          0          0  HWT_38:irq
         6  3.076E+04  3.076E+04  3.076E+04          0  HWT_38:nice
         6  1.321E+04  1.321E+04  1.321E+04          0  HWT_38:softirq
         6          0          0          0          0  HWT_38:steal
         6  1.688E+07  1.688E+07  1.688E+07          0  HWT_38:system
         6   1.69E+07   1.69E+07   1.69E+07          0  HWT_38:system_all
         6  1.976E+08  1.976E+08  1.976E+08      82.51  HWT_38:total_time
         6   6.97E+07   6.97E+07   6.97E+07          1  HWT_38:user
         6          0          0          0          0  HWT_38:virt_all_time
         6          0          0          0          0  HWT_39:guest
         6          0          0          0          0  HWT_39:guest_nice
         6  1.082E+08  1.082E+08  1.082E+08       80.8  HWT_39:idle
         6  1.083E+08  1.083E+08  1.083E+08      82.11  HWT_39:idle_all
         6  4.131E+04  4.131E+04  4.131E+04          0  HWT_39:iowait
         6          0          0          0          0  HWT_39:irq
         6  2.466E+04  2.466E+04  2.466E+04          0  HWT_39:nice
         6  1.034E+04  1.034E+04  1.034E+04          0  HWT_39:softirq
         6          0          0          0          0  HWT_39:steal
         6  1.787E+07  1.787E+07  1.787E+07          0  HWT_39:system
         6  1.788E+07  1.788E+07  1.788E+07          0  HWT_39:system_all
         6  1.976E+08  1.976E+08  1.976E+08      81.78  HWT_39:total_time
         6  7.143E+07  7.143E+07  7.143E+07          1  HWT_39:user
         6          0          0          0          0  HWT_39:virt_all_time
         6          0          0          0          0  HWT_3:guest
         6          0          0          0          0  HWT_3:guest_nice
         6  1.099E+08  1.099E+08  1.099E+08       80.8  HWT_3:idle
         6  1.099E+08  1.099E+08  1.099E+08      82.11  HWT_3:idle_all
         6  3.448E+04  3.448E+04  3.448E+04          0  HWT_3:iowait
         6          0          0          0          0  HWT_3:irq
         6  2.704E+04  2.704E+04  2.704E+04          0  HWT_3:nice
         6  6.833E+04  6.833E+04  6.833E+04          0  HWT_3:softirq
         6          0          0          0          0  HWT_3:steal
         6  1.835E+07  1.835E+07  1.835E+07          0  HWT_3:system
         6  1.841E+07  1.841E+07  1.841E+07          0  HWT_3:system_all
         6  1.975E+08  1.975E+08  1.975E+08      82.51  HWT_3:total_time
         6  6.909E+07  6.909E+07  6.909E+07          1  HWT_3:user
         6          0          0          0          0  HWT_3:virt_all_time
         6          0          0          0          0  HWT_4:guest
         6          0          0          0          0  HWT_4:guest_nice
         6  1.098E+08  1.098E+08  1.098E+08      82.11  HWT_4:idle
         6  1.098E+08  1.098E+08  1.098E+08         80  HWT_4:idle_all
         6  2.938E+04  2.938E+04  2.938E+04          0  HWT_4:iowait
         6          0          0          0          0  HWT_4:irq
         6   1.99E+04   1.99E+04   1.99E+04          0  HWT_4:nice
         6  2.275E+04  2.275E+04  2.275E+04          0  HWT_4:softirq
         6          0          0          0          0  HWT_4:steal
         6  1.758E+07  1.758E+07  1.758E+07          0  HWT_4:system
         6   1.76E+07   1.76E+07   1.76E+07          0  HWT_4:system_all
         6  1.975E+08  1.975E+08  1.975E+08      77.72  HWT_4:total_time
         6  7.012E+07  7.012E+07  7.012E+07          1  HWT_4:user
         6          0          0          0          0  HWT_4:virt_all_time
         6          0          0          0          0  HWT_5:guest
         6          0          0          0          0  HWT_5:guest_nice
         6  1.101E+08  1.101E+08  1.101E+08      82.11  HWT_5:idle
         6  1.101E+08  1.101E+08  1.101E+08       80.8  HWT_5:idle_all
         6  2.957E+04  2.957E+04  2.957E+04          0  HWT_5:iowait
         6          0          0          0          0  HWT_5:irq
         6  2.179E+04  2.179E+04  2.179E+04          0  HWT_5:nice
         6  2.352E+04  2.352E+04  2.352E+04          0  HWT_5:softirq
         6          0          0          0          0  HWT_5:steal
         6  1.748E+07  1.748E+07  1.748E+07          0  HWT_5:system
         6   1.75E+07   1.75E+07   1.75E+07          0  HWT_5:system_all
         6  1.976E+08  1.976E+08  1.976E+08      77.56  HWT_5:total_time
         6  6.991E+07  6.991E+07  6.991E+07          1  HWT_5:user
         6          0          0          0          0  HWT_5:virt_all_time
         6          0          0          0          0  HWT_6:guest
         6          0          0          0          0  HWT_6:guest_nice
         6  1.101E+08  1.101E+08  1.101E+08      80.01  HWT_6:idle
         6  1.102E+08  1.102E+08  1.102E+08      82.11  HWT_6:idle_all
         6  2.505E+04  2.505E+04  2.505E+04          0  HWT_6:iowait
         6          0          0          0          0  HWT_6:irq
         6  4.617E+04  4.617E+04  4.617E+04          0  HWT_6:nice
         6   5.72E+04   5.72E+04   5.72E+04          0  HWT_6:softirq
         6          0          0          0          0  HWT_6:steal
         6  1.755E+07  1.755E+07  1.755E+07          0  HWT_6:system
         6   1.76E+07   1.76E+07   1.76E+07          0  HWT_6:system_all
         6  1.975E+08  1.975E+08  1.975E+08      82.51  HWT_6:total_time
         6  6.971E+07  6.971E+07  6.971E+07          0  HWT_6:user
         6          0          0          0          0  HWT_6:virt_all_time
         6          0          0          0          0  HWT_7:guest
         6          0          0          0          0  HWT_7:guest_nice
         6    1.1E+08    1.1E+08    1.1E+08      77.33  HWT_7:idle
         6  1.101E+08  1.101E+08  1.101E+08       77.7  HWT_7:idle_all
         6  2.389E+04  2.389E+04  2.389E+04          0  HWT_7:iowait
         6          0          0          0          0  HWT_7:irq
         6  1.725E+04  1.725E+04  1.725E+04          0  HWT_7:nice
         6  2.323E+04  2.323E+04  2.323E+04          0  HWT_7:softirq
         6          0          0          0          0  HWT_7:steal
         6   1.76E+07   1.76E+07   1.76E+07       3.01  HWT_7:system
         6  1.763E+07  1.763E+07  1.763E+07        3.7  HWT_7:system_all
         6  1.976E+08  1.976E+08  1.976E+08      82.46  HWT_7:total_time
         6  6.987E+07  6.987E+07  6.987E+07          1  HWT_7:user
         6          0          0          0          0  HWT_7:virt_all_time
         6          0          0          0          0  HWT_8:guest
         6          0          0          0          0  HWT_8:guest_nice
         6  1.084E+08  1.084E+08  1.084E+08          0  HWT_8:idle
         6  1.084E+08  1.084E+08  1.084E+08          0  HWT_8:idle_all
         6  2.409E+04  2.409E+04  2.409E+04          0  HWT_8:iowait
         6          0          0          0          0  HWT_8:irq
         6  2.315E+04  2.315E+04  2.315E+04          0  HWT_8:nice
         6  1.015E+06  1.015E+06  1.015E+06      1.118  HWT_8:softirq
         6          0          0          0          0  HWT_8:steal
         6  1.818E+07  1.818E+07  1.818E+07          0  HWT_8:system
         6  1.919E+07  1.919E+07  1.919E+07      0.866  HWT_8:system_all
         6  1.966E+08  1.966E+08  1.966E+08      77.61  HWT_8:total_time
         6    6.9E+07    6.9E+07    6.9E+07      77.66  HWT_8:user
         6          0          0          0          0  HWT_8:virt_all_time
         6          0          0          0          0  HWT_9:guest
         6          0          0          0          0  HWT_9:guest_nice
         6    1.1E+08    1.1E+08    1.1E+08       75.3  HWT_9:idle
         6    1.1E+08    1.1E+08    1.1E+08      76.18  HWT_9:idle_all
         6  3.087E+04  3.087E+04  3.087E+04          0  HWT_9:iowait
         6          0          0          0          0  HWT_9:irq
         6  2.086E+04  2.086E+04  2.086E+04          0  HWT_9:nice
         6       8876       8875       8875     0.3727  HWT_9:softirq
         6          0          0          0          0  HWT_9:steal
         6  1.762E+07  1.762E+07  1.762E+07      3.708  HWT_9:system
         6  1.763E+07  1.763E+07  1.763E+07        3.7  HWT_9:system_all
         6  1.975E+08  1.975E+08  1.975E+08      82.51  HWT_9:total_time
         6  6.977E+07  6.977E+07  6.977E+07          1  HWT_9:user
         6          0          0          0          0  HWT_9:virt_all_time
         6        273        273        273          0  LWP_3833229:majflt
         6       4440       4439       4440     0.3727  LWP_3833229:minflt
         6          4          4          4          0  LWP_3833229:nonvoluntary_ctxt_switches
         6          0          0          0          0  LWP_3833229:nswap
         6          0          0          0          0  LWP_3833229:processor
         6  1.406E+14  1.406E+14  1.406E+14  2.568E+06  LWP_3833229:pthread lock calls
         6  1.406E+14  1.406E+14  1.406E+14  2.568E+06  LWP_3833229:pthread trylock calls
         6          1          1          1          0  LWP_3833229:stime
         6          5          5          5          0  LWP_3833229:utime
         6         37         37         37          0  LWP_3833229:voluntary_ctxt_switches
         6          0          0          0          0  LWP_3833283:majflt
         6        594        420      538.2      56.04  LWP_3833283:minflt
         6          8          8          8          0  LWP_3833283:nonvoluntary_ctxt_switches
         6          0          0          0          0  LWP_3833283:nswap
         6         24         24         24          0  LWP_3833283:processor
         6       1806         69       1508      643.6  LWP_3833283:pthread lock calls
         6          0          0          0          0  LWP_3833283:pthread trylock calls
         6          0          0          0          0  LWP_3833283:stime
         6        233        233        233          0  LWP_3833283:utime
         6         10          5        7.5      1.708  LWP_3833283:voluntary_ctxt_switches
---------------------------------------------------------------------------------------

NODE 1;CONTEXT 0;THREAD 0:
---------------------------------------------------------------------------------------
%Time    Exclusive    Inclusive       #Call      #Subrs  Inclusive Name
              msec   total msec                          usec/call
---------------------------------------------------------------------------------------
100.0           18        5,374           1           1    5374959 .TAU application
 99.6           12        5,356           1           4    5356014 int taupreload_main(int, char **, char **)
 99.3        5,011        5,337           1           5    5337554 main
  5.7          308          308           1           0     308280 MPI_Init()
  0.3        0.052           16           1           8      16987 func
  0.3           16           16           1           0      16737 MPI_Barrier()
  0.1            5            5           1           0       5145 pthread_join
  0.0        0.392        0.392           1           0        392 MPI_Finalize()
  0.0        0.276        0.276           1           0        276 void zerosum::ZeroSum::getProcStatus()
  0.0        0.109        0.109           3           0         36 MPI_Recv()
  0.0         0.06        0.069           1           1         69 MPI_Bcast()
  0.0        0.044        0.044           1           0         44 pthread_create
  0.0         0.02         0.02           3           0          7 MPI_Send()
  0.0        0.009        0.009           1           0          9 MPI Collective Sync
  0.0        0.008        0.008           1           0          8 MPI_Comm_size()
  0.0        0.002        0.002           1           0          2 MPI_Comm_rank()
---------------------------------------------------------------------------------------

USER EVENTS Profile :NODE 1, CONTEXT 0, THREAD 0
---------------------------------------------------------------------------------------
NumSamples   MaxValue   MinValue  MeanValue  Std. Dev.  Event Name
---------------------------------------------------------------------------------------
         1          0          0          0          0  LWP_3833282:majflt
         1       1076       1076       1076          0  LWP_3833282:minflt
         1          0          0          0          0  LWP_3833282:nonvoluntary_ctxt_switches
         1          0          0          0          0  LWP_3833282:nswap
         1          6          6          6          0  LWP_3833282:processor
         1          0          0          0          0  LWP_3833282:step
         1          0          0          0          0  LWP_3833282:stime
         1          0          0          0          0  LWP_3833282:utime
         1         10         10         10          0  LWP_3833282:voluntary_ctxt_switches
         1         40         40         40          0  Message size for broadcast
---------------------------------------------------------------------------------------

NODE 1;CONTEXT 0;THREAD 1:
---------------------------------------------------------------------------------------
%Time    Exclusive    Inclusive       #Call      #Subrs  Inclusive Name
              msec   total msec                          usec/call
---------------------------------------------------------------------------------------
100.0            1        5,347           1           1    5347122 .TAU application
100.0        0.025        5,345           1           1    5345636 [PTHREAD] addr=<7f72797ebda0>
100.0        5,325        5,345           1      100008    5345611 void zerosum::ZeroSum::threadedFunction()
  0.2           11           11      100001           0          0 bool zerosum::ZeroSum::doOnce() [THROTTLED]
  0.2            8            8           6           0       1403 void zerosum::ZeroSum::doPeriodic()
  0.0        0.059         0.09           1           3         90 void zerosum::ZeroSum::getMPIinfo()
  0.0        0.019        0.019           1           0         19 MPI_Comm_rank()
  0.0        0.009        0.009           1           0          9 MPI_Get_processor_name()
  0.0        0.003        0.003           1           0          3 MPI_Comm_size()
---------------------------------------------------------------------------------------

USER EVENTS Profile :NODE 1, CONTEXT 0, THREAD 1
---------------------------------------------------------------------------------------
NumSamples   MaxValue   MinValue  MeanValue  Std. Dev.  Event Name
---------------------------------------------------------------------------------------
         6          0          0          0          0  HWT_0:guest
         6          0          0          0          0  HWT_0:guest_nice
         6  1.112E+08  1.112E+08  1.112E+08       79.7  HWT_0:idle
         6  1.113E+08  1.113E+08  1.113E+08       79.7  HWT_0:idle_all
         6  3.551E+04  3.551E+04  3.551E+04          0  HWT_0:iowait
         6          0          0          0          0  HWT_0:irq
         6   2.23E+04   2.23E+04   2.23E+04          0  HWT_0:nice
         6  7.371E+05  7.371E+05  7.371E+05      1.491  HWT_0:softirq
         6          0          0          0          0  HWT_0:steal
         6  1.722E+07  1.722E+07  1.722E+07          0  HWT_0:system
         6  1.796E+07  1.796E+07  1.796E+07       1.75  HWT_0:system_all
         6  1.978E+08  1.978E+08  1.978E+08      81.83  HWT_0:total_time
         6  6.858E+07  6.858E+07  6.858E+07          1  HWT_0:user
         6          0          0          0          0  HWT_0:virt_all_time
         6          0          0          0          0  HWT_10:guest
         6          0          0          0          0  HWT_10:guest_nice
         6  1.092E+08  1.092E+08  1.092E+08       80.8  HWT_10:idle
         6  1.093E+08  1.093E+08  1.093E+08       80.8  HWT_10:idle_all
         6  2.754E+04  2.754E+04  2.754E+04          0  HWT_10:iowait
         6          0          0          0          0  HWT_10:irq
         6   2.63E+04   2.63E+04   2.63E+04          0  HWT_10:nice
         6  3.891E+04  3.891E+04  3.891E+04          0  HWT_10:softirq
         6          0          0          0          0  HWT_10:steal
         6  1.748E+07  1.748E+07  1.748E+07          0  HWT_10:system
         6  1.752E+07  1.752E+07  1.752E+07          0  HWT_10:system_all
         6  1.975E+08  1.975E+08  1.975E+08      81.83  HWT_10:total_time
         6  7.071E+07  7.071E+07  7.071E+07          1  HWT_10:user
         6          0          0          0          0  HWT_10:virt_all_time
         6          0          0          0          0  HWT_11:guest
         6          0          0          0          0  HWT_11:guest_nice
         6  1.096E+08  1.096E+08  1.096E+08      82.11  HWT_11:idle
         6  1.096E+08  1.096E+08  1.096E+08      82.11  HWT_11:idle_all
         6  2.474E+04  2.474E+04  2.474E+04          0  HWT_11:iowait
         6          0          0          0          0  HWT_11:irq
         6  2.434E+04  2.434E+04  2.434E+04          0  HWT_11:nice
         6  3.382E+04  3.382E+04  3.382E+04          0  HWT_11:softirq
         6          0          0          0          0  HWT_11:steal
         6  1.838E+07  1.838E+07  1.838E+07          0  HWT_11:system
         6  1.841E+07  1.841E+07  1.841E+07          0  HWT_11:system_all
         6  1.976E+08  1.976E+08  1.976E+08      81.83  HWT_11:total_time
         6  6.952E+07  6.952E+07  6.952E+07          0  HWT_11:user
         6          0          0          0          0  HWT_11:virt_all_time
         6          0          0          0          0  HWT_12:guest
         6          0          0          0          0  HWT_12:guest_nice
         6   1.11E+08   1.11E+08   1.11E+08      2.449  HWT_12:idle
         6  1.111E+08  1.111E+08  1.111E+08          0  HWT_12:idle_all
         6  2.056E+04  2.056E+04  2.056E+04          0  HWT_12:iowait
         6          0          0          0          0  HWT_12:irq
         6  2.474E+04  2.474E+04  2.474E+04          0  HWT_12:nice
         6  1.029E+04  1.029E+04  1.029E+04          0  HWT_12:softirq
         6          0          0          0          0  HWT_12:steal
         6  1.819E+07  1.819E+07  1.819E+07      1.436  HWT_12:system
         6   1.82E+07   1.82E+07   1.82E+07     0.6124  HWT_12:system_all
         6  1.976E+08  1.976E+08  1.976E+08      82.51  HWT_12:total_time
         6  6.828E+07  6.828E+07  6.828E+07      79.71  HWT_12:user
         6          0          0          0          0  HWT_12:virt_all_time
         6          0          0          0          0  HWT_13:guest
         6          0          0          0          0  HWT_13:guest_nice
         6  1.103E+08  1.103E+08  1.103E+08       80.8  HWT_13:idle
         6  1.104E+08  1.104E+08  1.104E+08       80.8  HWT_13:idle_all
         6  2.318E+04  2.318E+04  2.318E+04          0  HWT_13:iowait
         6          0          0          0          0  HWT_13:irq
         6  3.101E+04  3.101E+04  3.101E+04          0  HWT_13:nice
         6       9328       9328       9328          0  HWT_13:softirq
         6          0          0          0          0  HWT_13:steal
         6  1.715E+07  1.715E+07  1.715E+07          0  HWT_13:system
         6  1.716E+07  1.716E+07  1.716E+07          0  HWT_13:system_all
         6  1.976E+08  1.976E+08  1.976E+08      82.51  HWT_13:total_time
         6  7.005E+07  7.005E+07  7.005E+07          1  HWT_13:user
         6          0          0          0          0  HWT_13:virt_all_time
         6          0          0          0          0  HWT_14:guest
         6          0          0          0          0  HWT_14:guest_nice
         6  1.102E+08  1.102E+08  1.102E+08      82.11  HWT_14:idle
         6  1.103E+08  1.103E+08  1.103E+08       80.8  HWT_14:idle_all
         6  2.344E+04  2.344E+04  2.344E+04          0  HWT_14:iowait
         6          0          0          0          0  HWT_14:irq
         6  2.192E+04  2.192E+04  2.192E+04          0  HWT_14:nice
         6       8455       8455       8455          0  HWT_14:softirq
         6          0          0          0          0  HWT_14:steal
         6  1.808E+07  1.808E+07  1.808E+07          0  HWT_14:system
         6  1.809E+07  1.809E+07  1.809E+07     0.8292  HWT_14:system_all
         6  1.976E+08  1.976E+08  1.976E+08         84  HWT_14:total_time
         6  6.921E+07  6.921E+07  6.921E+07          1  HWT_14:user
         6          0          0          0          0  HWT_14:virt_all_time
         6          0          0          0          0  HWT_15:guest
         6          0          0          0          0  HWT_15:guest_nice
         6  1.104E+08  1.104E+08  1.104E+08      82.11  HWT_15:idle
         6  1.104E+08  1.104E+08  1.104E+08      83.23  HWT_15:idle_all
         6  2.377E+04  2.377E+04  2.377E+04          0  HWT_15:iowait
         6          0          0          0          0  HWT_15:irq
         6  2.791E+04  2.791E+04  2.791E+04          0  HWT_15:nice
         6  1.061E+04  1.061E+04  1.061E+04          0  HWT_15:softirq
         6          0          0          0          0  HWT_15:steal
         6  1.706E+07  1.706E+07  1.706E+07          0  HWT_15:system
         6  1.707E+07  1.707E+07  1.707E+07          0  HWT_15:system_all
         6  1.976E+08  1.976E+08  1.976E+08      82.46  HWT_15:total_time
         6   7.01E+07   7.01E+07   7.01E+07          1  HWT_15:user
         6          0          0          0          0  HWT_15:virt_all_time
         6          0          0          0          0  HWT_16:guest
         6          0          0          0          0  HWT_16:guest_nice
         6  1.104E+08  1.104E+08  1.104E+08       80.8  HWT_16:idle
         6  1.105E+08  1.105E+08  1.105E+08       80.8  HWT_16:idle_all
         6  3.116E+04  3.116E+04  3.116E+04          0  HWT_16:iowait
         6          0          0          0          0  HWT_16:irq
         6  1.946E+04  1.946E+04  1.946E+04          0  HWT_16:nice
         6       8895       8895       8895          0  HWT_16:softirq
         6          0          0          0          0  HWT_16:steal
         6  1.731E+07  1.731E+07  1.731E+07          0  HWT_16:system
         6  1.732E+07  1.732E+07  1.732E+07          0  HWT_16:system_all
         6  1.976E+08  1.976E+08  1.976E+08      84.05  HWT_16:total_time
         6  6.979E+07  6.979E+07  6.979E+07          1  HWT_16:user
         6          0          0          0          0  HWT_16:virt_all_time
         6          0          0          0          0  HWT_17:guest
         6          0          0          0          0  HWT_17:guest_nice
         6  1.105E+08  1.105E+08  1.105E+08       80.8  HWT_17:idle
         6  1.105E+08  1.105E+08  1.105E+08       80.8  HWT_17:idle_all
         6  2.764E+04  2.764E+04  2.764E+04          0  HWT_17:iowait
         6          0          0          0          0  HWT_17:irq
         6  2.815E+04  2.815E+04  2.815E+04          0  HWT_17:nice
         6       9628       9628       9628          0  HWT_17:softirq
         6          0          0          0          0  HWT_17:steal
         6   1.71E+07   1.71E+07   1.71E+07          0  HWT_17:system
         6  1.711E+07  1.711E+07  1.711E+07          0  HWT_17:system_all
         6  1.976E+08  1.976E+08  1.976E+08      83.95  HWT_17:total_time
         6  6.995E+07  6.995E+07  6.995E+07          1  HWT_17:user
         6          0          0          0          0  HWT_17:virt_all_time
         6          0          0          0          0  HWT_18:guest
         6          0          0          0          0  HWT_18:guest_nice
         6  1.101E+08  1.101E+08  1.101E+08       79.7  HWT_18:idle
         6  1.101E+08  1.101E+08  1.101E+08      82.11  HWT_18:idle_all
         6   2.37E+04   2.37E+04   2.37E+04          0  HWT_18:iowait
         6          0          0          0          0  HWT_18:irq
         6  2.048E+04  2.048E+04  2.048E+04          0  HWT_18:nice
         6  3.758E+04  3.758E+04  3.758E+04          0  HWT_18:softirq
         6          0          0          0          0  HWT_18:steal
         6  1.715E+07  1.715E+07  1.715E+07          0  HWT_18:system
         6  1.719E+07  1.719E+07  1.719E+07          0  HWT_18:system_all
         6  1.976E+08  1.976E+08  1.976E+08      82.41  HWT_18:total_time
         6  7.024E+07  7.024E+07  7.024E+07          0  HWT_18:user
         6          0          0          0          0  HWT_18:virt_all_time
         6          0          0          0          0  HWT_19:guest
         6          0          0          0          0  HWT_19:guest_nice
         6  1.091E+08  1.091E+08  1.091E+08      80.01  HWT_19:idle
         6  1.091E+08  1.091E+08  1.091E+08       80.8  HWT_19:idle_all
         6  3.029E+04  3.029E+04  3.029E+04          0  HWT_19:iowait
         6          0          0          0          0  HWT_19:irq
         6   2.59E+04   2.59E+04   2.59E+04          0  HWT_19:nice
         6  3.522E+04  3.522E+04  3.522E+04          0  HWT_19:softirq
         6          0          0          0          0  HWT_19:steal
         6  1.744E+07  1.744E+07  1.744E+07          0  HWT_19:system
         6  1.747E+07  1.747E+07  1.747E+07          0  HWT_19:system_all
         6  1.976E+08  1.976E+08  1.976E+08      77.67  HWT_19:total_time
         6  7.098E+07  7.098E+07  7.098E+07          1  HWT_19:user
         6          0          0          0          0  HWT_19:virt_all_time
         6          0          0          0          0  HWT_1:guest
         6          0          0          0          0  HWT_1:guest_nice
         6  1.101E+08  1.101E+08  1.101E+08      80.01  HWT_1:idle
         6  1.101E+08  1.101E+08  1.101E+08       80.8  HWT_1:idle_all
         6  2.812E+04  2.812E+04  2.812E+04          0  HWT_1:iowait
         6          0          0          0          0  HWT_1:irq
         6   2.61E+04   2.61E+04   2.61E+04          0  HWT_1:nice
         6  1.136E+05  1.136E+05  1.136E+05          0  HWT_1:softirq
         6          0          0          0          0  HWT_1:steal
         6  1.775E+07  1.775E+07  1.775E+07          0  HWT_1:system
         6  1.786E+07  1.786E+07  1.786E+07          0  HWT_1:system_all
         6  1.975E+08  1.975E+08  1.975E+08      82.46  HWT_1:total_time
         6   6.95E+07   6.95E+07   6.95E+07          1  HWT_1:user
         6          0          0          0          0  HWT_1:virt_all_time
         6          0          0          0          0  HWT_20:guest
         6          0          0          0          0  HWT_20:guest_nice
         6  1.092E+08  1.092E+08  1.092E+08       77.7  HWT_20:idle
         6  1.093E+08  1.093E+08  1.093E+08       77.7  HWT_20:idle_all
         6  2.175E+04  2.175E+04  2.175E+04          0  HWT_20:iowait
         6          0          0          0          0  HWT_20:irq
         6  2.664E+04  2.664E+04  2.664E+04          0  HWT_20:nice
         6  2.841E+04  2.841E+04  2.841E+04          0  HWT_20:softirq
         6          0          0          0          0  HWT_20:steal
         6  1.699E+07  1.699E+07  1.699E+07          0  HWT_20:system
         6  1.701E+07  1.701E+07  1.701E+07          0  HWT_20:system_all
         6  1.976E+08  1.976E+08  1.976E+08      77.61  HWT_20:total_time
         6  7.124E+07  7.124E+07  7.124E+07          1  HWT_20:user
         6          0          0          0          0  HWT_20:virt_all_time
         6          0          0          0          0  HWT_21:guest
         6          0          0          0          0  HWT_21:guest_nice
         6  1.106E+08  1.106E+08  1.106E+08      82.11  HWT_21:idle
         6  1.106E+08  1.106E+08  1.106E+08       80.8  HWT_21:idle_all
         6   2.03E+04   2.03E+04   2.03E+04          0  HWT_21:iowait
         6          0          0          0          0  HWT_21:irq
         6  2.462E+04  2.462E+04  2.462E+04          0  HWT_21:nice
         6       6806       6806       6806          0  HWT_21:softirq
         6          0          0          0          0  HWT_21:steal
         6  1.703E+07  1.703E+07  1.703E+07          0  HWT_21:system
         6  1.704E+07  1.704E+07  1.704E+07          0  HWT_21:system_all
         6  1.976E+08  1.976E+08  1.976E+08      82.51  HWT_21:total_time
         6  6.987E+07  6.987E+07  6.987E+07          1  HWT_21:user
         6          0          0          0          0  HWT_21:virt_all_time
         6          0          0          0          0  HWT_22:guest
         6          0          0          0          0  HWT_22:guest_nice
         6  1.107E+08  1.107E+08  1.107E+08       80.8  HWT_22:idle
         6  1.107E+08  1.107E+08  1.107E+08      82.11  HWT_22:idle_all
         6  4.532E+04  4.532E+04  4.532E+04          0  HWT_22:iowait
         6          0          0          0          0  HWT_22:irq
         6  1.842E+04  1.842E+04  1.842E+04          0  HWT_22:nice
         6       9128       9128       9128          0  HWT_22:softirq
         6          0          0          0          0  HWT_22:steal
         6  1.687E+07  1.687E+07  1.687E+07          0  HWT_22:system
         6  1.688E+07  1.688E+07  1.688E+07          0  HWT_22:system_all
         6  1.974E+08  1.974E+08  1.974E+08      77.72  HWT_22:total_time
         6  6.975E+07  6.975E+07  6.975E+07          1  HWT_22:user
         6          0          0          0          0  HWT_22:virt_all_time
         6          0          0          0          0  HWT_23:guest
         6          0          0          0          0  HWT_23:guest_nice
         6   1.09E+08   1.09E+08   1.09E+08       79.7  HWT_23:idle
         6   1.09E+08   1.09E+08   1.09E+08      78.38  HWT_23:idle_all
         6  5.931E+04  5.931E+04  5.931E+04          0  HWT_23:iowait
         6          0          0          0          0  HWT_23:irq
         6   3.25E+04   3.25E+04   3.25E+04          0  HWT_23:nice
         6  9.204E+05  9.204E+05  9.204E+05     0.3729  HWT_23:softirq
         6          0          0          0          0  HWT_23:steal
         6   1.76E+07   1.76E+07   1.76E+07     0.8292  HWT_23:system
         6  1.852E+07  1.852E+07  1.852E+07      0.866  HWT_23:system_all
         6  1.965E+08  1.965E+08  1.965E+08      84.05  HWT_23:total_time
         6  6.895E+07  6.895E+07  6.895E+07          1  HWT_23:user
         6          0          0          0          0  HWT_23:virt_all_time
         6          0          0          0          0  HWT_24:guest
         6          0          0          0          0  HWT_24:guest_nice
         6  1.106E+08  1.106E+08  1.106E+08       80.8  HWT_24:idle
         6  1.107E+08  1.107E+08  1.107E+08       80.8  HWT_24:idle_all
         6  4.994E+04  4.994E+04  4.994E+04          0  HWT_24:iowait
         6          0          0          0          0  HWT_24:irq
         6  1.893E+04  1.893E+04  1.893E+04          0  HWT_24:nice
         6  2.742E+04  2.742E+04  2.742E+04          0  HWT_24:softirq
         6          0          0          0          0  HWT_24:steal
         6   1.71E+07   1.71E+07   1.71E+07          0  HWT_24:system
         6  1.713E+07  1.713E+07  1.713E+07     0.6124  HWT_24:system_all
         6  1.975E+08  1.975E+08  1.975E+08      82.46  HWT_24:total_time
         6  6.965E+07  6.965E+07  6.965E+07          0  HWT_24:user
         6          0          0          0          0  HWT_24:virt_all_time
         6          0          0          0          0  HWT_25:guest
         6          0          0          0          0  HWT_25:guest_nice
         6  1.109E+08  1.109E+08  1.109E+08       79.7  HWT_25:idle
         6   1.11E+08   1.11E+08   1.11E+08       79.7  HWT_25:idle_all
         6  3.967E+04  3.967E+04  3.967E+04          0  HWT_25:iowait
         6          0          0          0          0  HWT_25:irq
         6  2.551E+04  2.551E+04  2.551E+04          0  HWT_25:nice
         6  3.164E+04  3.164E+04  3.164E+04          0  HWT_25:softirq
         6          0          0          0          0  HWT_25:steal
         6  1.701E+07  1.701E+07  1.701E+07       3.01  HWT_25:system
         6  1.704E+07  1.704E+07  1.704E+07       3.01  HWT_25:system_all
         6  1.976E+08  1.976E+08  1.976E+08      84.05  HWT_25:total_time
         6  6.952E+07  6.952E+07  6.952E+07          1  HWT_25:user
         6          0          0          0          0  HWT_25:virt_all_time
         6          0          0          0          0  HWT_26:guest
         6          0          0          0          0  HWT_26:guest_nice
         6  1.111E+08  1.111E+08  1.111E+08      82.76  HWT_26:idle
         6  1.111E+08  1.111E+08  1.111E+08       79.7  HWT_26:idle_all
         6  2.662E+04  2.662E+04  2.662E+04          0  HWT_26:iowait
         6          0          0          0          0  HWT_26:irq
         6  1.896E+04  1.896E+04  1.896E+04          0  HWT_26:nice
         6       9599       9599       9599          0  HWT_26:softirq
         6          0          0          0          0  HWT_26:steal
         6  1.712E+07  1.712E+07  1.712E+07      1.436  HWT_26:system
         6  1.713E+07  1.713E+07  1.713E+07      1.414  HWT_26:system_all
         6  1.976E+08  1.976E+08  1.976E+08      82.51  HWT_26:total_time
         6  6.931E+07  6.931E+07  6.931E+07          1  HWT_26:user
         6          0          0          0          0  HWT_26:virt_all_time
         6          0          0          0          0  HWT_27:guest
         6          0          0          0          0  HWT_27:guest_nice
         6  1.111E+08  1.111E+08  1.111E+08      75.15  HWT_27:idle
         6  1.111E+08  1.111E+08  1.111E+08      75.17  HWT_27:idle_all
         6  2.882E+04  2.882E+04  2.882E+04          0  HWT_27:iowait
         6          0          0          0          0  HWT_27:irq
         6  3.854E+04  3.854E+04  3.854E+04          0  HWT_27:nice
         6   1.14E+04  1.139E+04  1.139E+04     0.3727  HWT_27:softirq
         6          0          0          0          0  HWT_27:steal
         6  1.697E+07  1.697E+07  1.697E+07      5.948  HWT_27:system
         6  1.698E+07  1.698E+07  1.698E+07      6.708  HWT_27:system_all
         6  1.976E+08  1.976E+08  1.976E+08      77.61  HWT_27:total_time
         6  6.949E+07  6.949E+07  6.949E+07          1  HWT_27:user
         6          0          0          0          0  HWT_27:virt_all_time
         6          0          0          0          0  HWT_28:guest
         6          0          0          0          0  HWT_28:guest_nice
         6  1.127E+08  1.127E+08  1.127E+08       79.7  HWT_28:idle
         6  1.127E+08  1.127E+08  1.127E+08       79.7  HWT_28:idle_all
         6   2.99E+04   2.99E+04   2.99E+04          0  HWT_28:iowait
         6          0          0          0          0  HWT_28:irq
         6  2.385E+04  2.385E+04  2.385E+04          0  HWT_28:nice
         6       5736       5736       5736          0  HWT_28:softirq
         6          0          0          0          0  HWT_28:steal
         6  1.756E+07  1.756E+07  1.756E+07          0  HWT_28:system
         6  1.756E+07  1.756E+07  1.756E+07          0  HWT_28:system_all
         6  1.975E+08  1.975E+08  1.975E+08      77.56  HWT_28:total_time
         6  6.717E+07  6.717E+07  6.717E+07          1  HWT_28:user
         6          0          0          0          0  HWT_28:virt_all_time
         6          0          0          0          0  HWT_29:guest
         6          0          0          0          0  HWT_29:guest_nice
         6  1.108E+08  1.108E+08  1.108E+08       80.8  HWT_29:idle
         6  1.109E+08  1.109E+08  1.109E+08       78.4  HWT_29:idle_all
         6  3.186E+04  3.186E+04  3.186E+04          0  HWT_29:iowait
         6          0          0          0          0  HWT_29:irq
         6  2.478E+04  2.478E+04  2.478E+04          0  HWT_29:nice
         6  3.074E+04  3.074E+04  3.074E+04          0  HWT_29:softirq
         6          0          0          0          0  HWT_29:steal
         6  1.717E+07  1.717E+07  1.717E+07       3.01  HWT_29:system
         6   1.72E+07   1.72E+07   1.72E+07       3.01  HWT_29:system_all
         6  1.976E+08  1.976E+08  1.976E+08      81.83  HWT_29:total_time
         6   6.95E+07   6.95E+07   6.95E+07          1  HWT_29:user
         6          0          0          0          0  HWT_29:virt_all_time
         6          0          0          0          0  HWT_2:guest
         6          0          0          0          0  HWT_2:guest_nice
         6  1.098E+08  1.098E+08  1.098E+08      82.75  HWT_2:idle
         6  1.098E+08  1.098E+08  1.098E+08      80.05  HWT_2:idle_all
         6  3.624E+04  3.624E+04  3.624E+04          0  HWT_2:iowait
         6          0          0          0          0  HWT_2:irq
         6  2.379E+04  2.379E+04  2.379E+04          0  HWT_2:nice
         6  4.544E+04  4.544E+04  4.544E+04          0  HWT_2:softirq
         6          0          0          0          0  HWT_2:steal
         6  1.765E+07  1.765E+07  1.765E+07          0  HWT_2:system
         6  1.769E+07  1.769E+07  1.769E+07          0  HWT_2:system_all
         6  1.976E+08  1.976E+08  1.976E+08         84  HWT_2:total_time
         6  7.003E+07  7.003E+07  7.003E+07          1  HWT_2:user
         6          0          0          0          0  HWT_2:virt_all_time
         6          0          0          0          0  HWT_30:guest
         6          0          0          0          0  HWT_30:guest_nice
         6  1.099E+08  1.099E+08  1.099E+08          0  HWT_30:idle
         6  1.099E+08  1.099E+08  1.099E+08          0  HWT_30:idle_all
         6  2.072E+04  2.072E+04  2.072E+04          0  HWT_30:iowait
         6          0          0          0          0  HWT_30:irq
         6  2.613E+04  2.613E+04  2.613E+04          0  HWT_30:nice
         6  3.164E+04  3.164E+04  3.164E+04          0  HWT_30:softirq
         6          0          0          0          0  HWT_30:steal
         6  1.688E+07  1.688E+07  1.688E+07      1.521  HWT_30:system
         6  1.691E+07  1.691E+07  1.691E+07      1.936  HWT_30:system_all
         6  1.976E+08  1.976E+08  1.976E+08      81.83  HWT_30:total_time
         6  7.076E+07  7.076E+07  7.076E+07      82.07  HWT_30:user
         6          0          0          0          0  HWT_30:virt_all_time
         6          0          0          0          0  HWT_31:guest
         6          0          0          0          0  HWT_31:guest_nice
         6  1.112E+08  1.112E+08  1.112E+08       80.8  HWT_31:idle
         6  1.112E+08  1.112E+08  1.112E+08      82.11  HWT_31:idle_all
         6  2.174E+04  2.173E+04  2.173E+04      1.414  HWT_31:iowait
         6          0          0          0          0  HWT_31:irq
         6  2.102E+04  2.102E+04  2.102E+04          0  HWT_31:nice
         6       8756       8756       8756          0  HWT_31:softirq
         6          0          0          0          0  HWT_31:steal
         6  1.769E+07  1.769E+07  1.769E+07          0  HWT_31:system
         6   1.77E+07   1.77E+07   1.77E+07          0  HWT_31:system_all
         6  1.976E+08  1.976E+08  1.976E+08         84  HWT_31:total_time
         6  6.866E+07  6.866E+07  6.866E+07          1  HWT_31:user
         6          0          0          0          0  HWT_31:virt_all_time
         6          0          0          0          0  HWT_32:guest
         6          0          0          0          0  HWT_32:guest_nice
         6  1.083E+08  1.083E+08  1.083E+08       79.7  HWT_32:idle
         6  1.083E+08  1.083E+08  1.083E+08       79.7  HWT_32:idle_all
         6  2.385E+04  2.385E+04  2.385E+04          0  HWT_32:iowait
         6          0          0          0          0  HWT_32:irq
         6  1.677E+04  1.677E+04  1.677E+04          0  HWT_32:nice
         6  9.694E+05  9.694E+05  9.694E+05      1.118  HWT_32:softirq
         6          0          0          0          0  HWT_32:steal
         6  1.799E+07  1.799E+07  1.799E+07          0  HWT_32:system
         6  1.896E+07  1.896E+07  1.896E+07      0.866  HWT_32:system_all
         6  1.966E+08  1.966E+08  1.966E+08      77.61  HWT_32:total_time
         6  6.926E+07  6.926E+07  6.926E+07          1  HWT_32:user
         6          0          0          0          0  HWT_32:virt_all_time
         6          0          0          0          0  HWT_33:guest
         6          0          0          0          0  HWT_33:guest_nice
         6  1.105E+08  1.105E+08  1.105E+08      83.23  HWT_33:idle
         6  1.106E+08  1.106E+08  1.106E+08      82.11  HWT_33:idle_all
         6  2.133E+04  2.133E+04  2.133E+04          0  HWT_33:iowait
         6          0          0          0          0  HWT_33:irq
         6  2.527E+04  2.527E+04  2.527E+04          0  HWT_33:nice
         6  3.184E+04  3.184E+04  3.184E+04          0  HWT_33:softirq
         6          0          0          0          0  HWT_33:steal
         6    1.7E+07    1.7E+07    1.7E+07      0.866  HWT_33:system
         6  1.703E+07  1.703E+07  1.703E+07      0.866  HWT_33:system_all
         6  1.974E+08  1.974E+08  1.974E+08      84.05  HWT_33:total_time
         6  6.982E+07  6.982E+07  6.982E+07          1  HWT_33:user
         6          0          0          0          0  HWT_33:virt_all_time
         6          0          0          0          0  HWT_34:guest
         6          0          0          0          0  HWT_34:guest_nice
         6  1.093E+08  1.093E+08  1.093E+08       80.8  HWT_34:idle
         6  1.094E+08  1.094E+08  1.094E+08       80.8  HWT_34:idle_all
         6  2.306E+04  2.306E+04  2.306E+04          0  HWT_34:iowait
         6          0          0          0          0  HWT_34:irq
         6  1.605E+04  1.605E+04  1.605E+04          0  HWT_34:nice
         6  8.483E+05  8.483E+05  8.483E+05     0.7453  HWT_34:softirq
         6          0          0          0          0  HWT_34:steal
         6  1.744E+07  1.744E+07  1.744E+07          0  HWT_34:system
         6  1.829E+07  1.829E+07  1.829E+07      1.436  HWT_34:system_all
         6  1.965E+08  1.965E+08  1.965E+08      77.56  HWT_34:total_time
         6  6.887E+07  6.887E+07  6.887E+07          1  HWT_34:user
         6          0          0          0          0  HWT_34:virt_all_time
         6          0          0          0          0  HWT_35:guest
         6          0          0          0          0  HWT_35:guest_nice
         6  1.105E+08  1.105E+08  1.105E+08       80.8  HWT_35:idle
         6  1.106E+08  1.106E+08  1.106E+08       79.7  HWT_35:idle_all
         6  2.188E+04  2.188E+04  2.188E+04          0  HWT_35:iowait
         6          0          0          0          0  HWT_35:irq
         6  2.339E+04  2.339E+04  2.339E+04          0  HWT_35:nice
         6  2.922E+04  2.922E+04  2.922E+04          0  HWT_35:softirq
         6          0          0          0          0  HWT_35:steal
         6  1.695E+07  1.695E+07  1.695E+07          0  HWT_35:system
         6  1.698E+07  1.698E+07  1.698E+07      0.866  HWT_35:system_all
         6  1.975E+08  1.975E+08  1.975E+08      82.46  HWT_35:total_time
         6  6.989E+07  6.989E+07  6.989E+07          1  HWT_35:user
         6          0          0          0          0  HWT_35:virt_all_time
         6          0          0          0          0  HWT_36:guest
         6          0          0          0          0  HWT_36:guest_nice
         6  1.108E+08  1.108E+08  1.108E+08       79.7  HWT_36:idle
         6  1.108E+08  1.108E+08  1.108E+08      82.76  HWT_36:idle_all
         6  2.539E+04  2.539E+04  2.539E+04          0  HWT_36:iowait
         6          0          0          0          0  HWT_36:irq
         6  2.358E+04  2.358E+04  2.358E+04          0  HWT_36:nice
         6  4.776E+04  4.776E+04  4.776E+04          0  HWT_36:softirq
         6          0          0          0          0  HWT_36:steal
         6  1.699E+07  1.699E+07  1.699E+07     0.8292  HWT_36:system
         6  1.704E+07  1.704E+07  1.704E+07          0  HWT_36:system_all
         6  1.975E+08  1.975E+08  1.975E+08      77.61  HWT_36:total_time
         6  6.963E+07  6.963E+07  6.963E+07          1  HWT_36:user
         6          0          0          0          0  HWT_36:virt_all_time
         6          0          0          0          0  HWT_37:guest
         6          0          0          0          0  HWT_37:guest_nice
         6  1.106E+08  1.106E+08  1.106E+08      82.11  HWT_37:idle
         6  1.107E+08  1.107E+08  1.107E+08       79.7  HWT_37:idle_all
         6  3.009E+04  3.009E+04  3.009E+04          0  HWT_37:iowait
         6          0          0          0          0  HWT_37:irq
         6  2.658E+04  2.658E+04  2.658E+04          0  HWT_37:nice
         6  5.836E+04  5.836E+04  5.836E+04          0  HWT_37:softirq
         6          0          0          0          0  HWT_37:steal
         6  1.691E+07  1.691E+07  1.691E+07          0  HWT_37:system
         6  1.697E+07  1.697E+07  1.697E+07          0  HWT_37:system_all
         6  1.975E+08  1.975E+08  1.975E+08      77.67  HWT_37:total_time
         6  6.983E+07  6.983E+07  6.983E+07          1  HWT_37:user
         6          0          0          0          0  HWT_37:virt_all_time
         6          0          0          0          0  HWT_38:guest
         6          0          0          0          0  HWT_38:guest_nice
         6  1.109E+08  1.109E+08  1.109E+08      82.11  HWT_38:idle
         6   1.11E+08   1.11E+08   1.11E+08       80.8  HWT_38:idle_all
         6  2.524E+04  2.524E+04  2.524E+04          0  HWT_38:iowait
         6          0          0          0          0  HWT_38:irq
         6  3.076E+04  3.076E+04  3.076E+04          0  HWT_38:nice
         6  1.321E+04  1.321E+04  1.321E+04          0  HWT_38:softirq
         6          0          0          0          0  HWT_38:steal
         6  1.688E+07  1.688E+07  1.688E+07          0  HWT_38:system
         6   1.69E+07   1.69E+07   1.69E+07          0  HWT_38:system_all
         6  1.976E+08  1.976E+08  1.976E+08         84  HWT_38:total_time
         6   6.97E+07   6.97E+07   6.97E+07          1  HWT_38:user
         6          0          0          0          0  HWT_38:virt_all_time
         6          0          0          0          0  HWT_39:guest
         6          0          0          0          0  HWT_39:guest_nice
         6  1.082E+08  1.082E+08  1.082E+08       80.8  HWT_39:idle
         6  1.083E+08  1.083E+08  1.083E+08      82.11  HWT_39:idle_all
         6  4.131E+04  4.131E+04  4.131E+04          0  HWT_39:iowait
         6          0          0          0          0  HWT_39:irq
         6  2.466E+04  2.466E+04  2.466E+04          0  HWT_39:nice
         6  1.034E+04  1.034E+04  1.034E+04          0  HWT_39:softirq
         6          0          0          0          0  HWT_39:steal
         6  1.787E+07  1.787E+07  1.787E+07          0  HWT_39:system
         6  1.788E+07  1.788E+07  1.788E+07          0  HWT_39:system_all
         6  1.976E+08  1.976E+08  1.976E+08      81.78  HWT_39:total_time
         6  7.143E+07  7.143E+07  7.143E+07          1  HWT_39:user
         6          0          0          0          0  HWT_39:virt_all_time
         6          0          0          0          0  HWT_3:guest
         6          0          0          0          0  HWT_3:guest_nice
         6  1.099E+08  1.099E+08  1.099E+08       80.8  HWT_3:idle
         6  1.099E+08  1.099E+08  1.099E+08      82.11  HWT_3:idle_all
         6  3.448E+04  3.448E+04  3.448E+04          0  HWT_3:iowait
         6          0          0          0          0  HWT_3:irq
         6  2.704E+04  2.704E+04  2.704E+04          0  HWT_3:nice
         6  6.833E+04  6.833E+04  6.833E+04          0  HWT_3:softirq
         6          0          0          0          0  HWT_3:steal
         6  1.835E+07  1.835E+07  1.835E+07          0  HWT_3:system
         6  1.841E+07  1.841E+07  1.841E+07          0  HWT_3:system_all
         6  1.975E+08  1.975E+08  1.975E+08      83.95  HWT_3:total_time
         6  6.909E+07  6.909E+07  6.909E+07          1  HWT_3:user
         6          0          0          0          0  HWT_3:virt_all_time
         6          0          0          0          0  HWT_4:guest
         6          0          0          0          0  HWT_4:guest_nice
         6  1.098E+08  1.098E+08  1.098E+08      82.76  HWT_4:idle
         6  1.098E+08  1.098E+08  1.098E+08         80  HWT_4:idle_all
         6  2.938E+04  2.938E+04  2.938E+04          0  HWT_4:iowait
         6          0          0          0          0  HWT_4:irq
         6   1.99E+04   1.99E+04   1.99E+04          0  HWT_4:nice
         6  2.275E+04  2.275E+04  2.275E+04          0  HWT_4:softirq
         6          0          0          0          0  HWT_4:steal
         6  1.758E+07  1.758E+07  1.758E+07          0  HWT_4:system
         6   1.76E+07   1.76E+07   1.76E+07          0  HWT_4:system_all
         6  1.975E+08  1.975E+08  1.975E+08      77.72  HWT_4:total_time
         6  7.012E+07  7.012E+07  7.012E+07          1  HWT_4:user
         6          0          0          0          0  HWT_4:virt_all_time
         6          0          0          0          0  HWT_5:guest
         6          0          0          0          0  HWT_5:guest_nice
         6  1.101E+08  1.101E+08  1.101E+08      82.11  HWT_5:idle
         6  1.101E+08  1.101E+08  1.101E+08       80.8  HWT_5:idle_all
         6  2.957E+04  2.957E+04  2.957E+04          0  HWT_5:iowait
         6          0          0          0          0  HWT_5:irq
         6  2.179E+04  2.179E+04  2.179E+04          0  HWT_5:nice
         6  2.352E+04  2.352E+04  2.352E+04          0  HWT_5:softirq
         6          0          0          0          0  HWT_5:steal
         6  1.748E+07  1.748E+07  1.748E+07          0  HWT_5:system
         6   1.75E+07   1.75E+07   1.75E+07          0  HWT_5:system_all
         6  1.976E+08  1.976E+08  1.976E+08      82.51  HWT_5:total_time
         6  6.991E+07  6.991E+07  6.991E+07          1  HWT_5:user
         6          0          0          0          0  HWT_5:virt_all_time
         6          0          0          0          0  HWT_6:guest
         6          0          0          0          0  HWT_6:guest_nice
         6  1.101E+08  1.101E+08  1.101E+08      80.01  HWT_6:idle
         6  1.102E+08  1.102E+08  1.102E+08      82.11  HWT_6:idle_all
         6  2.505E+04  2.505E+04  2.505E+04          0  HWT_6:iowait
         6          0          0          0          0  HWT_6:irq
         6  4.617E+04  4.617E+04  4.617E+04          0  HWT_6:nice
         6   5.72E+04   5.72E+04   5.72E+04          0  HWT_6:softirq
         6          0          0          0          0  HWT_6:steal
         6  1.755E+07  1.755E+07  1.755E+07      0.866  HWT_6:system
         6   1.76E+07   1.76E+07   1.76E+07          0  HWT_6:system_all
         6  1.975E+08  1.975E+08  1.975E+08      82.51  HWT_6:total_time
         6  6.971E+07  6.971E+07  6.971E+07          0  HWT_6:user
         6          0          0          0          0  HWT_6:virt_all_time
         6          0          0          0          0  HWT_7:guest
         6          0          0          0          0  HWT_7:guest_nice
         6    1.1E+08    1.1E+08    1.1E+08      77.33  HWT_7:idle
         6  1.101E+08  1.101E+08  1.101E+08       78.4  HWT_7:idle_all
         6  2.389E+04  2.389E+04  2.389E+04          0  HWT_7:iowait
         6          0          0          0          0  HWT_7:irq
         6  1.725E+04  1.725E+04  1.725E+04          0  HWT_7:nice
         6  2.323E+04  2.323E+04  2.323E+04          0  HWT_7:softirq
         6          0          0          0          0  HWT_7:steal
         6   1.76E+07   1.76E+07   1.76E+07       3.01  HWT_7:system
         6  1.763E+07  1.763E+07  1.763E+07        3.7  HWT_7:system_all
         6  1.976E+08  1.976E+08  1.976E+08      84.05  HWT_7:total_time
         6  6.987E+07  6.987E+07  6.987E+07          1  HWT_7:user
         6          0          0          0          0  HWT_7:virt_all_time
         6          0          0          0          0  HWT_8:guest
         6          0          0          0          0  HWT_8:guest_nice
         6  1.084E+08  1.084E+08  1.084E+08          0  HWT_8:idle
         6  1.084E+08  1.084E+08  1.084E+08          0  HWT_8:idle_all
         6  2.409E+04  2.409E+04  2.409E+04          0  HWT_8:iowait
         6          0          0          0          0  HWT_8:irq
         6  2.315E+04  2.315E+04  2.315E+04          0  HWT_8:nice
         6  1.015E+06  1.015E+06  1.015E+06      1.118  HWT_8:softirq
         6          0          0          0          0  HWT_8:steal
         6  1.818E+07  1.818E+07  1.818E+07          0  HWT_8:system
         6  1.919E+07  1.919E+07  1.919E+07      0.866  HWT_8:system_all
         6  1.966E+08  1.966E+08  1.966E+08      82.46  HWT_8:total_time
         6    6.9E+07    6.9E+07    6.9E+07      80.06  HWT_8:user
         6          0          0          0          0  HWT_8:virt_all_time
         6          0          0          0          0  HWT_9:guest
         6          0          0          0          0  HWT_9:guest_nice
         6    1.1E+08    1.1E+08    1.1E+08       75.3  HWT_9:idle
         6    1.1E+08    1.1E+08    1.1E+08      76.18  HWT_9:idle_all
         6  3.087E+04  3.087E+04  3.087E+04          0  HWT_9:iowait
         6          0          0          0          0  HWT_9:irq
         6  2.086E+04  2.086E+04  2.086E+04          0  HWT_9:nice
         6       8876       8875       8875     0.3727  HWT_9:softirq
         6          0          0          0          0  HWT_9:steal
         6  1.762E+07  1.762E+07  1.762E+07      3.708  HWT_9:system
         6  1.763E+07  1.763E+07  1.763E+07        3.7  HWT_9:system_all
         6  1.975E+08  1.975E+08  1.975E+08         84  HWT_9:total_time
         6  6.977E+07  6.977E+07  6.977E+07          1  HWT_9:user
         6          0          0          0          0  HWT_9:virt_all_time
         6         20         20         20          0  LWP_3833282:majflt
         6       4440       4440       4440          0  LWP_3833282:minflt
         6          3          3          3          0  LWP_3833282:nonvoluntary_ctxt_switches
         6          0          0          0          0  LWP_3833282:nswap
         6          6          6          6          0  LWP_3833282:processor
         6  1.401E+14  1.401E+14  1.401E+14  2.966E+06  LWP_3833282:pthread lock calls
         6  1.401E+14  1.401E+14  1.401E+14  2.966E+06  LWP_3833282:pthread trylock calls
         6          2          2          2          0  LWP_3833282:stime
         6          5          5          5          0  LWP_3833282:utime
         6         32         32         32          0  LWP_3833282:voluntary_ctxt_switches
         6          0          0          0          0  LWP_3833285:majflt
         6        591        417      535.2      56.04  LWP_3833285:minflt
         6          5          5          5          0  LWP_3833285:nonvoluntary_ctxt_switches
         6          0          0          0          0  LWP_3833285:nswap
         6         29         29         29          0  LWP_3833285:processor
         6       1806         69       1508      643.6  LWP_3833285:pthread lock calls
         6          0          0          0          0  LWP_3833285:pthread trylock calls
         6          0          0          0          0  LWP_3833285:stime
         6        232        231      231.3     0.4714  LWP_3833285:utime
         6          8          3        5.5      1.708  LWP_3833285:voluntary_ctxt_switches
---------------------------------------------------------------------------------------

NODE 2;CONTEXT 0;THREAD 0:
---------------------------------------------------------------------------------------
%Time    Exclusive    Inclusive       #Call      #Subrs  Inclusive Name
              msec   total msec                          usec/call
---------------------------------------------------------------------------------------
100.0           20        5,379           1           1    5379468 .TAU application
 99.6           15        5,358           1           4    5358470 int taupreload_main(int, char **, char **)
 99.2        5,012        5,338           1           5    5338715 main
  6.0          325          325           1           0     325436 MPI_Init()
  0.1            3            3           1           0       3866 pthread_join
  0.0        0.044        0.602           1           8        602 func
  0.0        0.452        0.452           1           0        452 MPI_Finalize()
  0.0        0.345        0.345           1           0        345 MPI_Barrier()
  0.0        0.338        0.338           1           0        338 void zerosum::ZeroSum::getProcStatus()
  0.0         0.12         0.12           3           0         40 MPI_Recv()
  0.0        0.064        0.074           1           1         74 MPI_Bcast()
  0.0        0.061        0.061           1           0         61 pthread_create
  0.0        0.019        0.019           3           0          6 MPI_Send()
  0.0         0.01         0.01           1           0         10 MPI Collective Sync
  0.0        0.007        0.007           1           0          7 MPI_Comm_size()
  0.0        0.002        0.002           1           0          2 MPI_Comm_rank()
---------------------------------------------------------------------------------------

USER EVENTS Profile :NODE 2, CONTEXT 0, THREAD 0
---------------------------------------------------------------------------------------
NumSamples   MaxValue   MinValue  MeanValue  Std. Dev.  Event Name
---------------------------------------------------------------------------------------
         1          0          0          0          0  LWP_3833267:majflt
         1       1077       1077       1077          0  LWP_3833267:minflt
         1          1          1          1          0  LWP_3833267:nonvoluntary_ctxt_switches
         1          0          0          0          0  LWP_3833267:nswap
         1         33         33         33          0  LWP_3833267:processor
         1          0          0          0          0  LWP_3833267:step
         1          0          0          0          0  LWP_3833267:stime
         1          0          0          0          0  LWP_3833267:utime
         1         10         10         10          0  LWP_3833267:voluntary_ctxt_switches
         1         40         40         40          0  Message size for broadcast
---------------------------------------------------------------------------------------

NODE 2;CONTEXT 0;THREAD 1:
---------------------------------------------------------------------------------------
%Time    Exclusive    Inclusive       #Call      #Subrs  Inclusive Name
              msec   total msec                          usec/call
---------------------------------------------------------------------------------------
100.0            1        5,350           1           1    5350885 .TAU application
100.0        0.023        5,349           1           1    5349131 [PTHREAD] addr=<7f57e65ebda0>
100.0        5,330        5,349           1      100008    5349108 void zerosum::ZeroSum::threadedFunction()
  0.2            9            9      100001           0          0 bool zerosum::ZeroSum::doOnce() [THROTTLED]
  0.2            8            8           6           0       1478 void zerosum::ZeroSum::doPeriodic()
  0.0        0.071        0.125           1           3        125 void zerosum::ZeroSum::getMPIinfo()
  0.0        0.029        0.029           1           0         29 MPI_Comm_rank()
  0.0        0.013        0.013           1           0         13 MPI_Get_processor_name()
  0.0        0.012        0.012           1           0         12 MPI_Comm_size()
---------------------------------------------------------------------------------------

USER EVENTS Profile :NODE 2, CONTEXT 0, THREAD 1
---------------------------------------------------------------------------------------
NumSamples   MaxValue   MinValue  MeanValue  Std. Dev.  Event Name
---------------------------------------------------------------------------------------
         6          0          0          0          0  HWT_0:guest
         6          0          0          0          0  HWT_0:guest_nice
         6  1.112E+08  1.112E+08  1.112E+08       79.7  HWT_0:idle
         6  1.113E+08  1.113E+08  1.113E+08       79.7  HWT_0:idle_all
         6  3.551E+04  3.551E+04  3.551E+04          0  HWT_0:iowait
         6          0          0          0          0  HWT_0:irq
         6   2.23E+04   2.23E+04   2.23E+04          0  HWT_0:nice
         6  7.371E+05  7.371E+05  7.371E+05      1.491  HWT_0:softirq
         6          0          0          0          0  HWT_0:steal
         6  1.722E+07  1.722E+07  1.722E+07          0  HWT_0:system
         6  1.796E+07  1.796E+07  1.796E+07       1.75  HWT_0:system_all
         6  1.978E+08  1.978E+08  1.978E+08      81.83  HWT_0:total_time
         6  6.858E+07  6.858E+07  6.858E+07          1  HWT_0:user
         6          0          0          0          0  HWT_0:virt_all_time
         6          0          0          0          0  HWT_10:guest
         6          0          0          0          0  HWT_10:guest_nice
         6  1.092E+08  1.092E+08  1.092E+08       79.7  HWT_10:idle
         6  1.093E+08  1.093E+08  1.093E+08       79.7  HWT_10:idle_all
         6  2.754E+04  2.754E+04  2.754E+04          0  HWT_10:iowait
         6          0          0          0          0  HWT_10:irq
         6   2.63E+04   2.63E+04   2.63E+04          0  HWT_10:nice
         6  3.891E+04  3.891E+04  3.891E+04          0  HWT_10:softirq
         6          0          0          0          0  HWT_10:steal
         6  1.748E+07  1.748E+07  1.748E+07          0  HWT_10:system
         6  1.752E+07  1.752E+07  1.752E+07          0  HWT_10:system_all
         6  1.975E+08  1.975E+08  1.975E+08      77.61  HWT_10:total_time
         6  7.071E+07  7.071E+07  7.071E+07          1  HWT_10:user
         6          0          0          0          0  HWT_10:virt_all_time
         6          0          0          0          0  HWT_11:guest
         6          0          0          0          0  HWT_11:guest_nice
         6  1.096E+08  1.096E+08  1.096E+08      80.01  HWT_11:idle
         6  1.096E+08  1.096E+08  1.096E+08      80.01  HWT_11:idle_all
         6  2.474E+04  2.474E+04  2.474E+04          0  HWT_11:iowait
         6          0          0          0          0  HWT_11:irq
         6  2.434E+04  2.434E+04  2.434E+04          0  HWT_11:nice
         6  3.382E+04  3.382E+04  3.382E+04          0  HWT_11:softirq
         6          0          0          0          0  HWT_11:steal
         6  1.838E+07  1.838E+07  1.838E+07          0  HWT_11:system
         6  1.841E+07  1.841E+07  1.841E+07          0  HWT_11:system_all
         6  1.976E+08  1.976E+08  1.976E+08      81.83  HWT_11:total_time
         6  6.952E+07  6.952E+07  6.952E+07          0  HWT_11:user
         6          0          0          0          0  HWT_11:virt_all_time
         6          0          0          0          0  HWT_12:guest
         6          0          0          0          0  HWT_12:guest_nice
         6   1.11E+08   1.11E+08   1.11E+08      2.449  HWT_12:idle
         6  1.111E+08  1.111E+08  1.111E+08          0  HWT_12:idle_all
         6  2.056E+04  2.056E+04  2.056E+04          0  HWT_12:iowait
         6          0          0          0          0  HWT_12:irq
         6  2.474E+04  2.474E+04  2.474E+04          0  HWT_12:nice
         6  1.029E+04  1.029E+04  1.029E+04          0  HWT_12:softirq
         6          0          0          0          0  HWT_12:steal
         6  1.819E+07  1.819E+07  1.819E+07      1.436  HWT_12:system
         6   1.82E+07   1.82E+07   1.82E+07     0.6124  HWT_12:system_all
         6  1.976E+08  1.976E+08  1.976E+08      82.51  HWT_12:total_time
         6  6.828E+07  6.828E+07  6.828E+07      79.71  HWT_12:user
         6          0          0          0          0  HWT_12:virt_all_time
         6          0          0          0          0  HWT_13:guest
         6          0          0          0          0  HWT_13:guest_nice
         6  1.103E+08  1.103E+08  1.103E+08       80.8  HWT_13:idle
         6  1.104E+08  1.104E+08  1.104E+08       80.8  HWT_13:idle_all
         6  2.318E+04  2.318E+04  2.318E+04          0  HWT_13:iowait
         6          0          0          0          0  HWT_13:irq
         6  3.101E+04  3.101E+04  3.101E+04          0  HWT_13:nice
         6       9328       9328       9328          0  HWT_13:softirq
         6          0          0          0          0  HWT_13:steal
         6  1.715E+07  1.715E+07  1.715E+07          0  HWT_13:system
         6  1.716E+07  1.716E+07  1.716E+07          0  HWT_13:system_all
         6  1.976E+08  1.976E+08  1.976E+08      82.51  HWT_13:total_time
         6  7.005E+07  7.005E+07  7.005E+07          1  HWT_13:user
         6          0          0          0          0  HWT_13:virt_all_time
         6          0          0          0          0  HWT_14:guest
         6          0          0          0          0  HWT_14:guest_nice
         6  1.102E+08  1.102E+08  1.102E+08      80.01  HWT_14:idle
         6  1.103E+08  1.103E+08  1.103E+08       80.8  HWT_14:idle_all
         6  2.344E+04  2.344E+04  2.344E+04          0  HWT_14:iowait
         6          0          0          0          0  HWT_14:irq
         6  2.192E+04  2.192E+04  2.192E+04          0  HWT_14:nice
         6       8455       8455       8455          0  HWT_14:softirq
         6          0          0          0          0  HWT_14:steal
         6  1.808E+07  1.808E+07  1.808E+07          0  HWT_14:system
         6  1.809E+07  1.809E+07  1.809E+07     0.8292  HWT_14:system_all
         6  1.976E+08  1.976E+08  1.976E+08      82.66  HWT_14:total_time
         6  6.921E+07  6.921E+07  6.921E+07          1  HWT_14:user
         6          0          0          0          0  HWT_14:virt_all_time
         6          0          0          0          0  HWT_15:guest
         6          0          0          0          0  HWT_15:guest_nice
         6  1.104E+08  1.104E+08  1.104E+08      82.11  HWT_15:idle
         6  1.104E+08  1.104E+08  1.104E+08      82.11  HWT_15:idle_all
         6  2.377E+04  2.377E+04  2.377E+04          0  HWT_15:iowait
         6          0          0          0          0  HWT_15:irq
         6  2.791E+04  2.791E+04  2.791E+04          0  HWT_15:nice
         6  1.061E+04  1.061E+04  1.061E+04          0  HWT_15:softirq
         6          0          0          0          0  HWT_15:steal
         6  1.706E+07  1.706E+07  1.706E+07          0  HWT_15:system
         6  1.707E+07  1.707E+07  1.707E+07          0  HWT_15:system_all
         6  1.976E+08  1.976E+08  1.976E+08      82.46  HWT_15:total_time
         6   7.01E+07   7.01E+07   7.01E+07          1  HWT_15:user
         6          0          0          0          0  HWT_15:virt_all_time
         6          0          0          0          0  HWT_16:guest
         6          0          0          0          0  HWT_16:guest_nice
         6  1.104E+08  1.104E+08  1.104E+08       80.8  HWT_16:idle
         6  1.105E+08  1.105E+08  1.105E+08       80.8  HWT_16:idle_all
         6  3.116E+04  3.116E+04  3.116E+04          0  HWT_16:iowait
         6          0          0          0          0  HWT_16:irq
         6  1.946E+04  1.946E+04  1.946E+04          0  HWT_16:nice
         6       8895       8895       8895          0  HWT_16:softirq
         6          0          0          0          0  HWT_16:steal
         6  1.731E+07  1.731E+07  1.731E+07          0  HWT_16:system
         6  1.732E+07  1.732E+07  1.732E+07          0  HWT_16:system_all
         6  1.976E+08  1.976E+08  1.976E+08      81.78  HWT_16:total_time
         6  6.979E+07  6.979E+07  6.979E+07          1  HWT_16:user
         6          0          0          0          0  HWT_16:virt_all_time
         6          0          0          0          0  HWT_17:guest
         6          0          0          0          0  HWT_17:guest_nice
         6  1.105E+08  1.105E+08  1.105E+08       80.8  HWT_17:idle
         6  1.105E+08  1.105E+08  1.105E+08       80.8  HWT_17:idle_all
         6  2.764E+04  2.764E+04  2.764E+04          0  HWT_17:iowait
         6          0          0          0          0  HWT_17:irq
         6  2.815E+04  2.815E+04  2.815E+04          0  HWT_17:nice
         6       9628       9628       9628          0  HWT_17:softirq
         6          0          0          0          0  HWT_17:steal
         6   1.71E+07   1.71E+07   1.71E+07          0  HWT_17:system
         6  1.711E+07  1.711E+07  1.711E+07          0  HWT_17:system_all
         6  1.976E+08  1.976E+08  1.976E+08      83.95  HWT_17:total_time
         6  6.995E+07  6.995E+07  6.995E+07          1  HWT_17:user
         6          0          0          0          0  HWT_17:virt_all_time
         6          0          0          0          0  HWT_18:guest
         6          0          0          0          0  HWT_18:guest_nice
         6  1.101E+08  1.101E+08  1.101E+08       79.7  HWT_18:idle
         6  1.101E+08  1.101E+08  1.101E+08       79.7  HWT_18:idle_all
         6   2.37E+04   2.37E+04   2.37E+04          0  HWT_18:iowait
         6          0          0          0          0  HWT_18:irq
         6  2.048E+04  2.048E+04  2.048E+04          0  HWT_18:nice
         6  3.758E+04  3.758E+04  3.758E+04          0  HWT_18:softirq
         6          0          0          0          0  HWT_18:steal
         6  1.715E+07  1.715E+07  1.715E+07          0  HWT_18:system
         6  1.719E+07  1.719E+07  1.719E+07          0  HWT_18:system_all
         6  1.976E+08  1.976E+08  1.976E+08      82.41  HWT_18:total_time
         6  7.024E+07  7.024E+07  7.024E+07          0  HWT_18:user
         6          0          0          0          0  HWT_18:virt_all_time
         6          0          0          0          0  HWT_19:guest
         6          0          0          0          0  HWT_19:guest_nice
         6  1.091E+08  1.091E+08  1.091E+08      80.01  HWT_19:idle
         6  1.091E+08  1.091E+08  1.091E+08       79.7  HWT_19:idle_all
         6  3.029E+04  3.029E+04  3.029E+04          0  HWT_19:iowait
         6          0          0          0          0  HWT_19:irq
         6   2.59E+04   2.59E+04   2.59E+04          0  HWT_19:nice
         6  3.522E+04  3.522E+04  3.522E+04          0  HWT_19:softirq
         6          0          0          0          0  HWT_19:steal
         6  1.744E+07  1.744E+07  1.744E+07          0  HWT_19:system
         6  1.747E+07  1.747E+07  1.747E+07          0  HWT_19:system_all
         6  1.976E+08  1.976E+08  1.976E+08      77.67  HWT_19:total_time
         6  7.098E+07  7.098E+07  7.098E+07          1  HWT_19:user
         6          0          0          0          0  HWT_19:virt_all_time
         6          0          0          0          0  HWT_1:guest
         6          0          0          0          0  HWT_1:guest_nice
         6  1.101E+08  1.101E+08  1.101E+08      80.01  HWT_1:idle
         6  1.101E+08  1.101E+08  1.101E+08       79.7  HWT_1:idle_all
         6  2.812E+04  2.812E+04  2.812E+04          0  HWT_1:iowait
         6          0          0          0          0  HWT_1:irq
         6   2.61E+04   2.61E+04   2.61E+04          0  HWT_1:nice
         6  1.136E+05  1.136E+05  1.136E+05          0  HWT_1:softirq
         6          0          0          0          0  HWT_1:steal
         6  1.775E+07  1.775E+07  1.775E+07          0  HWT_1:system
         6  1.786E+07  1.786E+07  1.786E+07          0  HWT_1:system_all
         6  1.975E+08  1.975E+08  1.975E+08      77.67  HWT_1:total_time
         6   6.95E+07   6.95E+07   6.95E+07          1  HWT_1:user
         6          0          0          0          0  HWT_1:virt_all_time
         6          0          0          0          0  HWT_20:guest
         6          0          0          0          0  HWT_20:guest_nice
         6  1.092E+08  1.092E+08  1.092E+08       77.7  HWT_20:idle
         6  1.093E+08  1.093E+08  1.093E+08       77.7  HWT_20:idle_all
         6  2.175E+04  2.175E+04  2.175E+04          0  HWT_20:iowait
         6          0          0          0          0  HWT_20:irq
         6  2.664E+04  2.664E+04  2.664E+04          0  HWT_20:nice
         6  2.841E+04  2.841E+04  2.841E+04          0  HWT_20:softirq
         6          0          0          0          0  HWT_20:steal
         6  1.699E+07  1.699E+07  1.699E+07          0  HWT_20:system
         6  1.701E+07  1.701E+07  1.701E+07          0  HWT_20:system_all
         6  1.976E+08  1.976E+08  1.976E+08      77.61  HWT_20:total_time
         6  7.124E+07  7.124E+07  7.124E+07          1  HWT_20:user
         6          0          0          0          0  HWT_20:virt_all_time
         6          0          0          0          0  HWT_21:guest
         6          0          0          0          0  HWT_21:guest_nice
         6  1.106E+08  1.106E+08  1.106E+08       77.7  HWT_21:idle
         6  1.106E+08  1.106E+08  1.106E+08       79.7  HWT_21:idle_all
         6   2.03E+04   2.03E+04   2.03E+04          0  HWT_21:iowait
         6          0          0          0          0  HWT_21:irq
         6  2.462E+04  2.462E+04  2.462E+04          0  HWT_21:nice
         6       6806       6806       6806          0  HWT_21:softirq
         6          0          0          0          0  HWT_21:steal
         6  1.703E+07  1.703E+07  1.703E+07          0  HWT_21:system
         6  1.704E+07  1.704E+07  1.704E+07          0  HWT_21:system_all
         6  1.976E+08  1.976E+08  1.976E+08      77.56  HWT_21:total_time
         6  6.987E+07  6.987E+07  6.987E+07          1  HWT_21:user
         6          0          0          0          0  HWT_21:virt_all_time
         6          0          0          0          0  HWT_22:guest
         6          0          0          0          0  HWT_22:guest_nice
         6  1.107E+08  1.107E+08  1.107E+08       80.8  HWT_22:idle
         6  1.107E+08  1.107E+08  1.107E+08      82.11  HWT_22:idle_all
         6  4.532E+04  4.532E+04  4.532E+04          0  HWT_22:iowait
         6          0          0          0          0  HWT_22:irq
         6  1.842E+04  1.842E+04  1.842E+04          0  HWT_22:nice
         6       9128       9128       9128          0  HWT_22:softirq
         6          0          0          0          0  HWT_22:steal
         6  1.687E+07  1.687E+07  1.687E+07          0  HWT_22:system
         6  1.688E+07  1.688E+07  1.688E+07          0  HWT_22:system_all
         6  1.974E+08  1.974E+08  1.974E+08      77.72  HWT_22:total_time
         6  6.975E+07  6.975E+07  6.975E+07          1  HWT_22:user
         6          0          0          0          0  HWT_22:virt_all_time
         6          0          0          0          0  HWT_23:guest
         6          0          0          0          0  HWT_23:guest_nice
         6   1.09E+08   1.09E+08   1.09E+08       79.7  HWT_23:idle
         6   1.09E+08   1.09E+08   1.09E+08      77.33  HWT_23:idle_all
         6  5.931E+04  5.931E+04  5.931E+04          0  HWT_23:iowait
         6          0          0          0          0  HWT_23:irq
         6   3.25E+04   3.25E+04   3.25E+04          0  HWT_23:nice
         6  9.204E+05  9.204E+05  9.204E+05     0.3729  HWT_23:softirq
         6          0          0          0          0  HWT_23:steal
         6   1.76E+07   1.76E+07   1.76E+07     0.8292  HWT_23:system
         6  1.852E+07  1.852E+07  1.852E+07      0.866  HWT_23:system_all
         6  1.965E+08  1.965E+08  1.965E+08      84.05  HWT_23:total_time
         6  6.895E+07  6.895E+07  6.895E+07          1  HWT_23:user
         6          0          0          0          0  HWT_23:virt_all_time
         6          0          0          0          0  HWT_24:guest
         6          0          0          0          0  HWT_24:guest_nice
         6  1.106E+08  1.106E+08  1.106E+08       80.8  HWT_24:idle
         6  1.107E+08  1.107E+08  1.107E+08       79.7  HWT_24:idle_all
         6  4.994E+04  4.994E+04  4.994E+04          0  HWT_24:iowait
         6          0          0          0          0  HWT_24:irq
         6  1.893E+04  1.893E+04  1.893E+04          0  HWT_24:nice
         6  2.742E+04  2.742E+04  2.742E+04          0  HWT_24:softirq
         6          0          0          0          0  HWT_24:steal
         6   1.71E+07   1.71E+07   1.71E+07          0  HWT_24:system
         6  1.713E+07  1.713E+07  1.713E+07     0.6124  HWT_24:system_all
         6  1.975E+08  1.975E+08  1.975E+08      82.46  HWT_24:total_time
         6  6.965E+07  6.965E+07  6.965E+07          0  HWT_24:user
         6          0          0          0          0  HWT_24:virt_all_time
         6          0          0          0          0  HWT_25:guest
         6          0          0          0          0  HWT_25:guest_nice
         6  1.109E+08  1.109E+08  1.109E+08      77.33  HWT_25:idle
         6   1.11E+08   1.11E+08   1.11E+08       77.7  HWT_25:idle_all
         6  3.967E+04  3.967E+04  3.967E+04          0  HWT_25:iowait
         6          0          0          0          0  HWT_25:irq
         6  2.551E+04  2.551E+04  2.551E+04          0  HWT_25:nice
         6  3.164E+04  3.164E+04  3.164E+04          0  HWT_25:softirq
         6          0          0          0          0  HWT_25:steal
         6  1.701E+07  1.701E+07  1.701E+07       3.01  HWT_25:system
         6  1.704E+07  1.704E+07  1.704E+07       3.01  HWT_25:system_all
         6  1.976E+08  1.976E+08  1.976E+08      84.05  HWT_25:total_time
         6  6.952E+07  6.952E+07  6.952E+07          1  HWT_25:user
         6          0          0          0          0  HWT_25:virt_all_time
         6          0          0          0          0  HWT_26:guest
         6          0          0          0          0  HWT_26:guest_nice
         6  1.111E+08  1.111E+08  1.111E+08       80.8  HWT_26:idle
         6  1.111E+08  1.111E+08  1.111E+08       79.7  HWT_26:idle_all
         6  2.662E+04  2.662E+04  2.662E+04          0  HWT_26:iowait
         6          0          0          0          0  HWT_26:irq
         6  1.896E+04  1.896E+04  1.896E+04          0  HWT_26:nice
         6       9599       9599       9599          0  HWT_26:softirq
         6          0          0          0          0  HWT_26:steal
         6  1.712E+07  1.712E+07  1.712E+07      1.436  HWT_26:system
         6  1.713E+07  1.713E+07  1.713E+07      1.414  HWT_26:system_all
         6  1.976E+08  1.976E+08  1.976E+08      82.51  HWT_26:total_time
         6  6.931E+07  6.931E+07  6.931E+07          1  HWT_26:user
         6          0          0          0          0  HWT_26:virt_all_time
         6          0          0          0          0  HWT_27:guest
         6          0          0          0          0  HWT_27:guest_nice
         6  1.111E+08  1.111E+08  1.111E+08      72.94  HWT_27:idle
         6  1.111E+08  1.111E+08  1.111E+08      72.92  HWT_27:idle_all
         6  2.882E+04  2.882E+04  2.882E+04          0  HWT_27:iowait
         6          0          0          0          0  HWT_27:irq
         6  3.854E+04  3.854E+04  3.854E+04          0  HWT_27:nice
         6   1.14E+04  1.139E+04  1.139E+04     0.3727  HWT_27:softirq
         6          0          0          0          0  HWT_27:steal
         6  1.697E+07  1.697E+07  1.697E+07      5.948  HWT_27:system
         6  1.698E+07  1.698E+07  1.698E+07      6.708  HWT_27:system_all
         6  1.976E+08  1.976E+08  1.976E+08      77.61  HWT_27:total_time
         6  6.949E+07  6.949E+07  6.949E+07          1  HWT_27:user
         6          0          0          0          0  HWT_27:virt_all_time
         6          0          0          0          0  HWT_28:guest
         6          0          0          0          0  HWT_28:guest_nice
         6  1.127E+08  1.127E+08  1.127E+08       79.7  HWT_28:idle
         6  1.127E+08  1.127E+08  1.127E+08       79.7  HWT_28:idle_all
         6   2.99E+04   2.99E+04   2.99E+04          0  HWT_28:iowait
         6          0          0          0          0  HWT_28:irq
         6  2.385E+04  2.385E+04  2.385E+04          0  HWT_28:nice
         6       5736       5736       5736          0  HWT_28:softirq
         6          0          0          0          0  HWT_28:steal
         6  1.756E+07  1.756E+07  1.756E+07          0  HWT_28:system
         6  1.756E+07  1.756E+07  1.756E+07          0  HWT_28:system_all
         6  1.975E+08  1.975E+08  1.975E+08      77.56  HWT_28:total_time
         6  6.717E+07  6.717E+07  6.717E+07          1  HWT_28:user
         6          0          0          0          0  HWT_28:virt_all_time
         6          0          0          0          0  HWT_29:guest
         6          0          0          0          0  HWT_29:guest_nice
         6  1.108E+08  1.108E+08  1.108E+08      77.33  HWT_29:idle
         6  1.109E+08  1.109E+08  1.109E+08       78.4  HWT_29:idle_all
         6  3.186E+04  3.186E+04  3.186E+04          0  HWT_29:iowait
         6          0          0          0          0  HWT_29:irq
         6  2.478E+04  2.478E+04  2.478E+04          0  HWT_29:nice
         6  3.074E+04  3.074E+04  3.074E+04          0  HWT_29:softirq
         6          0          0          0          0  HWT_29:steal
         6  1.717E+07  1.717E+07  1.717E+07       3.01  HWT_29:system
         6   1.72E+07   1.72E+07   1.72E+07       3.01  HWT_29:system_all
         6  1.976E+08  1.976E+08  1.976E+08      77.67  HWT_29:total_time
         6   6.95E+07   6.95E+07   6.95E+07          1  HWT_29:user
         6          0          0          0          0  HWT_29:virt_all_time
         6          0          0          0          0  HWT_2:guest
         6          0          0          0          0  HWT_2:guest_nice
         6  1.098E+08  1.098E+08  1.098E+08         80  HWT_2:idle
         6  1.098E+08  1.098E+08  1.098E+08       79.7  HWT_2:idle_all
         6  3.624E+04  3.624E+04  3.624E+04          0  HWT_2:iowait
         6          0          0          0          0  HWT_2:irq
         6  2.379E+04  2.379E+04  2.379E+04          0  HWT_2:nice
         6  4.544E+04  4.544E+04  4.544E+04          0  HWT_2:softirq
         6          0          0          0          0  HWT_2:steal
         6  1.765E+07  1.765E+07  1.765E+07          0  HWT_2:system
         6  1.769E+07  1.769E+07  1.769E+07          0  HWT_2:system_all
         6  1.976E+08  1.976E+08  1.976E+08         84  HWT_2:total_time
         6  7.003E+07  7.003E+07  7.003E+07          1  HWT_2:user
         6          0          0          0          0  HWT_2:virt_all_time
         6          0          0          0          0  HWT_30:guest
         6          0          0          0          0  HWT_30:guest_nice
         6  1.099E+08  1.099E+08  1.099E+08          0  HWT_30:idle
         6  1.099E+08  1.099E+08  1.099E+08          0  HWT_30:idle_all
         6  2.072E+04  2.072E+04  2.072E+04          0  HWT_30:iowait
         6          0          0          0          0  HWT_30:irq
         6  2.613E+04  2.613E+04  2.613E+04          0  HWT_30:nice
         6  3.164E+04  3.164E+04  3.164E+04          0  HWT_30:softirq
         6          0          0          0          0  HWT_30:steal
         6  1.688E+07  1.688E+07  1.688E+07      1.521  HWT_30:system
         6  1.691E+07  1.691E+07  1.691E+07      1.936  HWT_30:system_all
         6  1.976E+08  1.976E+08  1.976E+08      81.83  HWT_30:total_time
         6  7.076E+07  7.076E+07  7.076E+07      80.06  HWT_30:user
         6          0          0          0          0  HWT_30:virt_all_time
         6          0          0          0          0  HWT_31:guest
         6          0          0          0          0  HWT_31:guest_nice
         6  1.112E+08  1.112E+08  1.112E+08       79.7  HWT_31:idle
         6  1.112E+08  1.112E+08  1.112E+08         80  HWT_31:idle_all
         6  2.174E+04  2.173E+04  2.173E+04      1.414  HWT_31:iowait
         6          0          0          0          0  HWT_31:irq
         6  2.102E+04  2.102E+04  2.102E+04          0  HWT_31:nice
         6       8756       8756       8756          0  HWT_31:softirq
         6          0          0          0          0  HWT_31:steal
         6  1.769E+07  1.769E+07  1.769E+07          0  HWT_31:system
         6   1.77E+07   1.77E+07   1.77E+07          0  HWT_31:system_all
         6  1.976E+08  1.976E+08  1.976E+08         84  HWT_31:total_time
         6  6.866E+07  6.866E+07  6.866E+07          1  HWT_31:user
         6          0          0          0          0  HWT_31:virt_all_time
         6          0          0          0          0  HWT_32:guest
         6          0          0          0          0  HWT_32:guest_nice
         6  1.083E+08  1.083E+08  1.083E+08       77.7  HWT_32:idle
         6  1.083E+08  1.083E+08  1.083E+08       79.7  HWT_32:idle_all
         6  2.385E+04  2.385E+04  2.385E+04          0  HWT_32:iowait
         6          0          0          0          0  HWT_32:irq
         6  1.677E+04  1.677E+04  1.677E+04          0  HWT_32:nice
         6  9.694E+05  9.694E+05  9.694E+05      1.118  HWT_32:softirq
         6          0          0          0          0  HWT_32:steal
         6  1.799E+07  1.799E+07  1.799E+07          0  HWT_32:system
         6  1.896E+07  1.896E+07  1.896E+07      0.866  HWT_32:system_all
         6  1.966E+08  1.966E+08  1.966E+08      77.61  HWT_32:total_time
         6  6.926E+07  6.926E+07  6.926E+07          1  HWT_32:user
         6          0          0          0          0  HWT_32:virt_all_time
         6          0          0          0          0  HWT_33:guest
         6          0          0          0          0  HWT_33:guest_nice
         6  1.105E+08  1.105E+08  1.105E+08       79.7  HWT_33:idle
         6  1.106E+08  1.106E+08  1.106E+08      82.11  HWT_33:idle_all
         6  2.133E+04  2.133E+04  2.133E+04          0  HWT_33:iowait
         6          0          0          0          0  HWT_33:irq
         6  2.527E+04  2.527E+04  2.527E+04          0  HWT_33:nice
         6  3.184E+04  3.184E+04  3.184E+04          0  HWT_33:softirq
         6          0          0          0          0  HWT_33:steal
         6    1.7E+07    1.7E+07    1.7E+07      0.866  HWT_33:system
         6  1.703E+07  1.703E+07  1.703E+07      0.866  HWT_33:system_all
         6  1.974E+08  1.974E+08  1.974E+08      81.83  HWT_33:total_time
         6  6.982E+07  6.982E+07  6.982E+07          1  HWT_33:user
         6          0          0          0          0  HWT_33:virt_all_time
         6          0          0          0          0  HWT_34:guest
         6          0          0          0          0  HWT_34:guest_nice
         6  1.093E+08  1.093E+08  1.093E+08       79.7  HWT_34:idle
         6  1.094E+08  1.094E+08  1.094E+08       79.7  HWT_34:idle_all
         6  2.306E+04  2.306E+04  2.306E+04          0  HWT_34:iowait
         6          0          0          0          0  HWT_34:irq
         6  1.605E+04  1.605E+04  1.605E+04          0  HWT_34:nice
         6  8.483E+05  8.483E+05  8.483E+05     0.7453  HWT_34:softirq
         6          0          0          0          0  HWT_34:steal
         6  1.744E+07  1.744E+07  1.744E+07          0  HWT_34:system
         6  1.829E+07  1.829E+07  1.829E+07      1.436  HWT_34:system_all
         6  1.965E+08  1.965E+08  1.965E+08      77.56  HWT_34:total_time
         6  6.887E+07  6.887E+07  6.887E+07          1  HWT_34:user
         6          0          0          0          0  HWT_34:virt_all_time
         6          0          0          0          0  HWT_35:guest
         6          0          0          0          0  HWT_35:guest_nice
         6  1.105E+08  1.105E+08  1.105E+08       80.8  HWT_35:idle
         6  1.106E+08  1.106E+08  1.106E+08       79.7  HWT_35:idle_all
         6  2.188E+04  2.188E+04  2.188E+04          0  HWT_35:iowait
         6          0          0          0          0  HWT_35:irq
         6  2.339E+04  2.339E+04  2.339E+04          0  HWT_35:nice
         6  2.922E+04  2.922E+04  2.922E+04          0  HWT_35:softirq
         6          0          0          0          0  HWT_35:steal
         6  1.695E+07  1.695E+07  1.695E+07          0  HWT_35:system
         6  1.698E+07  1.698E+07  1.698E+07      0.866  HWT_35:system_all
         6  1.975E+08  1.975E+08  1.975E+08      82.46  HWT_35:total_time
         6  6.989E+07  6.989E+07  6.989E+07          1  HWT_35:user
         6          0          0          0          0  HWT_35:virt_all_time
         6          0          0          0          0  HWT_36:guest
         6          0          0          0          0  HWT_36:guest_nice
         6  1.108E+08  1.108E+08  1.108E+08       77.7  HWT_36:idle
         6  1.108E+08  1.108E+08  1.108E+08       80.8  HWT_36:idle_all
         6  2.539E+04  2.539E+04  2.539E+04          0  HWT_36:iowait
         6          0          0          0          0  HWT_36:irq
         6  2.358E+04  2.358E+04  2.358E+04          0  HWT_36:nice
         6  4.776E+04  4.776E+04  4.776E+04          0  HWT_36:softirq
         6          0          0          0          0  HWT_36:steal
         6  1.699E+07  1.699E+07  1.699E+07     0.8292  HWT_36:system
         6  1.704E+07  1.704E+07  1.704E+07          0  HWT_36:system_all
         6  1.975E+08  1.975E+08  1.975E+08      77.61  HWT_36:total_time
         6  6.963E+07  6.963E+07  6.963E+07          1  HWT_36:user
         6          0          0          0          0  HWT_36:virt_all_time
         6          0          0          0          0  HWT_37:guest
         6          0          0          0          0  HWT_37:guest_nice
         6  1.106E+08  1.106E+08  1.106E+08      80.01  HWT_37:idle
         6  1.107E+08  1.107E+08  1.107E+08       79.7  HWT_37:idle_all
         6  3.009E+04  3.009E+04  3.009E+04          0  HWT_37:iowait
         6          0          0          0          0  HWT_37:irq
         6  2.658E+04  2.658E+04  2.658E+04          0  HWT_37:nice
         6  5.836E+04  5.836E+04  5.836E+04          0  HWT_37:softirq
         6          0          0          0          0  HWT_37:steal
         6  1.691E+07  1.691E+07  1.691E+07          0  HWT_37:system
         6  1.697E+07  1.697E+07  1.697E+07          0  HWT_37:system_all
         6  1.975E+08  1.975E+08  1.975E+08      77.67  HWT_37:total_time
         6  6.983E+07  6.983E+07  6.983E+07          1  HWT_37:user
         6          0          0          0          0  HWT_37:virt_all_time
         6          0          0          0          0  HWT_38:guest
         6          0          0          0          0  HWT_38:guest_nice
         6  1.109E+08  1.109E+08  1.109E+08      80.01  HWT_38:idle
         6   1.11E+08   1.11E+08   1.11E+08       79.7  HWT_38:idle_all
         6  2.524E+04  2.524E+04  2.524E+04          0  HWT_38:iowait
         6          0          0          0          0  HWT_38:irq
         6  3.076E+04  3.076E+04  3.076E+04          0  HWT_38:nice
         6  1.321E+04  1.321E+04  1.321E+04          0  HWT_38:softirq
         6          0          0          0          0  HWT_38:steal
         6  1.688E+07  1.688E+07  1.688E+07          0  HWT_38:system
         6   1.69E+07   1.69E+07   1.69E+07          0  HWT_38:system_all
         6  1.976E+08  1.976E+08  1.976E+08         84  HWT_38:total_time
         6   6.97E+07   6.97E+07   6.97E+07          1  HWT_38:user
         6          0          0          0          0  HWT_38:virt_all_time
         6          0          0          0          0  HWT_39:guest
         6          0          0          0          0  HWT_39:guest_nice
         6  1.082E+08  1.082E+08  1.082E+08       79.7  HWT_39:idle
         6  1.083E+08  1.083E+08  1.083E+08      82.11  HWT_39:idle_all
         6  4.131E+04  4.131E+04  4.131E+04          0  HWT_39:iowait
         6          0          0          0          0  HWT_39:irq
         6  2.466E+04  2.466E+04  2.466E+04          0  HWT_39:nice
         6  1.034E+04  1.034E+04  1.034E+04          0  HWT_39:softirq
         6          0          0          0          0  HWT_39:steal
         6  1.787E+07  1.787E+07  1.787E+07          0  HWT_39:system
         6  1.788E+07  1.788E+07  1.788E+07          0  HWT_39:system_all
         6  1.976E+08  1.976E+08  1.976E+08      77.61  HWT_39:total_time
         6  7.143E+07  7.143E+07  7.143E+07          1  HWT_39:user
         6          0          0          0          0  HWT_39:virt_all_time
         6          0          0          0          0  HWT_3:guest
         6          0          0          0          0  HWT_3:guest_nice
         6  1.099E+08  1.099E+08  1.099E+08      80.05  HWT_3:idle
         6  1.099E+08  1.099E+08  1.099E+08      82.11  HWT_3:idle_all
         6  3.448E+04  3.448E+04  3.448E+04          0  HWT_3:iowait
         6          0          0          0          0  HWT_3:irq
         6  2.704E+04  2.704E+04  2.704E+04          0  HWT_3:nice
         6  6.833E+04  6.833E+04  6.833E+04          0  HWT_3:softirq
         6          0          0          0          0  HWT_3:steal
         6  1.835E+07  1.835E+07  1.835E+07          0  HWT_3:system
         6  1.841E+07  1.841E+07  1.841E+07          0  HWT_3:system_all
         6  1.975E+08  1.975E+08  1.975E+08      83.95  HWT_3:total_time
         6  6.909E+07  6.909E+07  6.909E+07          1  HWT_3:user
         6          0          0          0          0  HWT_3:virt_all_time
         6          0          0          0          0  HWT_4:guest
         6          0          0          0          0  HWT_4:guest_nice
         6  1.098E+08  1.098E+08  1.098E+08       80.8  HWT_4:idle
         6  1.098E+08  1.098E+08  1.098E+08         80  HWT_4:idle_all
         6  2.938E+04  2.938E+04  2.938E+04          0  HWT_4:iowait
         6          0          0          0          0  HWT_4:irq
         6   1.99E+04   1.99E+04   1.99E+04          0  HWT_4:nice
         6  2.275E+04  2.275E+04  2.275E+04          0  HWT_4:softirq
         6          0          0          0          0  HWT_4:steal
         6  1.758E+07  1.758E+07  1.758E+07          0  HWT_4:system
         6   1.76E+07   1.76E+07   1.76E+07          0  HWT_4:system_all
         6  1.975E+08  1.975E+08  1.975E+08      77.72  HWT_4:total_time
         6  7.012E+07  7.012E+07  7.012E+07          1  HWT_4:user
         6          0          0          0          0  HWT_4:virt_all_time
         6          0          0          0          0  HWT_5:guest
         6          0          0          0          0  HWT_5:guest_nice
         6  1.101E+08  1.101E+08  1.101E+08         80  HWT_5:idle
         6  1.101E+08  1.101E+08  1.101E+08       80.8  HWT_5:idle_all
         6  2.957E+04  2.957E+04  2.957E+04          0  HWT_5:iowait
         6          0          0          0          0  HWT_5:irq
         6  2.179E+04  2.179E+04  2.179E+04          0  HWT_5:nice
         6  2.352E+04  2.352E+04  2.352E+04          0  HWT_5:softirq
         6          0          0          0          0  HWT_5:steal
         6  1.748E+07  1.748E+07  1.748E+07          0  HWT_5:system
         6   1.75E+07   1.75E+07   1.75E+07          0  HWT_5:system_all
         6  1.976E+08  1.976E+08  1.976E+08      77.56  HWT_5:total_time
         6  6.991E+07  6.991E+07  6.991E+07          1  HWT_5:user
         6          0          0          0          0  HWT_5:virt_all_time
         6          0          0          0          0  HWT_6:guest
         6          0          0          0          0  HWT_6:guest_nice
         6  1.101E+08  1.101E+08  1.101E+08      80.01  HWT_6:idle
         6  1.102E+08  1.102E+08  1.102E+08         80  HWT_6:idle_all
         6  2.505E+04  2.505E+04  2.505E+04          0  HWT_6:iowait
         6          0          0          0          0  HWT_6:irq
         6  4.617E+04  4.617E+04  4.617E+04          0  HWT_6:nice
         6   5.72E+04   5.72E+04   5.72E+04          0  HWT_6:softirq
         6          0          0          0          0  HWT_6:steal
         6  1.755E+07  1.755E+07  1.755E+07      0.866  HWT_6:system
         6   1.76E+07   1.76E+07   1.76E+07          0  HWT_6:system_all
         6  1.975E+08  1.975E+08  1.975E+08      82.51  HWT_6:total_time
         6  6.971E+07  6.971E+07  6.971E+07          0  HWT_6:user
         6          0          0          0          0  HWT_6:virt_all_time
         6          0          0          0          0  HWT_7:guest
         6          0          0          0          0  HWT_7:guest_nice
         6    1.1E+08    1.1E+08    1.1E+08      77.33  HWT_7:idle
         6  1.101E+08  1.101E+08  1.101E+08       78.4  HWT_7:idle_all
         6  2.389E+04  2.389E+04  2.389E+04          0  HWT_7:iowait
         6          0          0          0          0  HWT_7:irq
         6  1.725E+04  1.725E+04  1.725E+04          0  HWT_7:nice
         6  2.323E+04  2.323E+04  2.323E+04          0  HWT_7:softirq
         6          0          0          0          0  HWT_7:steal
         6   1.76E+07   1.76E+07   1.76E+07       3.01  HWT_7:system
         6  1.763E+07  1.763E+07  1.763E+07        3.7  HWT_7:system_all
         6  1.976E+08  1.976E+08  1.976E+08      84.05  HWT_7:total_time
         6  6.987E+07  6.987E+07  6.987E+07          1  HWT_7:user
         6          0          0          0          0  HWT_7:virt_all_time
         6          0          0          0          0  HWT_8:guest
         6          0          0          0          0  HWT_8:guest_nice
         6  1.084E+08  1.084E+08  1.084E+08          0  HWT_8:idle
         6  1.084E+08  1.084E+08  1.084E+08          0  HWT_8:idle_all
         6  2.409E+04  2.409E+04  2.409E+04          0  HWT_8:iowait
         6          0          0          0          0  HWT_8:irq
         6  2.315E+04  2.315E+04  2.315E+04          0  HWT_8:nice
         6  1.015E+06  1.015E+06  1.015E+06      1.118  HWT_8:softirq
         6          0          0          0          0  HWT_8:steal
         6  1.818E+07  1.818E+07  1.818E+07          0  HWT_8:system
         6  1.919E+07  1.919E+07  1.919E+07      0.866  HWT_8:system_all
         6  1.966E+08  1.966E+08  1.966E+08      82.46  HWT_8:total_time
         6    6.9E+07    6.9E+07    6.9E+07      80.06  HWT_8:user
         6          0          0          0          0  HWT_8:virt_all_time
         6          0          0          0          0  HWT_9:guest
         6          0          0          0          0  HWT_9:guest_nice
         6    1.1E+08    1.1E+08    1.1E+08       75.3  HWT_9:idle
         6    1.1E+08    1.1E+08    1.1E+08      75.17  HWT_9:idle_all
         6  3.087E+04  3.087E+04  3.087E+04          0  HWT_9:iowait
         6          0          0          0          0  HWT_9:irq
         6  2.086E+04  2.086E+04  2.086E+04          0  HWT_9:nice
         6       8876       8875       8875     0.3727  HWT_9:softirq
         6          0          0          0          0  HWT_9:steal
         6  1.762E+07  1.762E+07  1.762E+07      3.708  HWT_9:system
         6  1.763E+07  1.763E+07  1.763E+07        3.7  HWT_9:system_all
         6  1.975E+08  1.975E+08  1.975E+08         84  HWT_9:total_time
         6  6.977E+07  6.977E+07  6.977E+07          1  HWT_9:user
         6          0          0          0          0  HWT_9:virt_all_time
         6         17         17         17          0  LWP_3833267:majflt
         6       4447       4447       4447          0  LWP_3833267:minflt
         6          5          5          5          0  LWP_3833267:nonvoluntary_ctxt_switches
         6          0          0          0          0  LWP_3833267:nswap
         6         13         13         13          0  LWP_3833267:processor
         6    1.4E+14    1.4E+14    1.4E+14  2.568E+06  LWP_3833267:pthread lock calls
         6    1.4E+14    1.4E+14    1.4E+14  2.568E+06  LWP_3833267:pthread trylock calls
         6          3          3          3          0  LWP_3833267:stime
         6          6          6          6          0  LWP_3833267:utime
         6         44         44         44          0  LWP_3833267:voluntary_ctxt_switches
         6          0          0          0          0  LWP_3833284:majflt
         6        592        418      536.2      56.04  LWP_3833284:minflt
         6        127        127        127          0  LWP_3833284:nonvoluntary_ctxt_switches
         6          0          0          0          0  LWP_3833284:nswap
         6         34         34         34          0  LWP_3833284:processor
         6       1806         69       1508      643.6  LWP_3833284:pthread lock calls
         6          0          0          0          0  LWP_3833284:pthread trylock calls
         6          4          4          4          0  LWP_3833284:stime
         6        230        229      229.7     0.4714  LWP_3833284:utime
         6          8          3        5.5      1.708  LWP_3833284:voluntary_ctxt_switches
---------------------------------------------------------------------------------------

NODE 3;CONTEXT 0;THREAD 0:
---------------------------------------------------------------------------------------
%Time    Exclusive    Inclusive       #Call      #Subrs  Inclusive Name
              msec   total msec                          usec/call
---------------------------------------------------------------------------------------
100.0           22        5,377           1           1    5377314 .TAU application
 99.6           15        5,354           1           4    5354699 int taupreload_main(int, char **, char **)
 99.2        5,013        5,335           1           5    5335198 main
  5.7          309          309           1           0     309028 MPI_Init()
  0.2         0.05           12           1           8      12427 func
  0.2           12           12           1           0      12171 MPI_Barrier()
  0.1            3            3           1           0       3906 pthread_join
  0.0        0.486        0.486           1           0        486 MPI_Finalize()
  0.0        0.298        0.298           1           0        298 void zerosum::ZeroSum::getProcStatus()
  0.0        0.115        0.115           3           0         38 MPI_Recv()
  0.0        0.062         0.07           1           1         70 MPI_Bcast()
  0.0         0.04         0.04           1           0         40 pthread_create
  0.0        0.021        0.021           3           0          7 MPI_Send()
  0.0        0.008        0.008           1           0          8 MPI Collective Sync
  0.0        0.008        0.008           1           0          8 MPI_Comm_size()
  0.0        0.002        0.002           1           0          2 MPI_Comm_rank()
---------------------------------------------------------------------------------------

USER EVENTS Profile :NODE 3, CONTEXT 0, THREAD 0
---------------------------------------------------------------------------------------
NumSamples   MaxValue   MinValue  MeanValue  Std. Dev.  Event Name
---------------------------------------------------------------------------------------
         1          0          0          0          0  LWP_3833275:majflt
         1       1077       1077       1077          0  LWP_3833275:minflt
         1          0          0          0          0  LWP_3833275:nonvoluntary_ctxt_switches
         1          0          0          0          0  LWP_3833275:nswap
         1         38         38         38          0  LWP_3833275:processor
         1          0          0          0          0  LWP_3833275:step
         1          0          0          0          0  LWP_3833275:stime
         1          0          0          0          0  LWP_3833275:utime
         1         10         10         10          0  LWP_3833275:voluntary_ctxt_switches
         1         40         40         40          0  Message size for broadcast
---------------------------------------------------------------------------------------

NODE 3;CONTEXT 0;THREAD 1:
---------------------------------------------------------------------------------------
%Time    Exclusive    Inclusive       #Call      #Subrs  Inclusive Name
              msec   total msec                          usec/call
---------------------------------------------------------------------------------------
100.0            1        5,347           1           1    5347040 .TAU application
100.0        0.025        5,345           1           1    5345169 [PTHREAD] addr=<7fadb5febda0>
100.0        5,330        5,345           1      100008    5345144 void zerosum::ZeroSum::threadedFunction()
  0.1            7            7      100001           0          0 bool zerosum::ZeroSum::doOnce() [THROTTLED]
  0.1            7            7           6           0       1179 void zerosum::ZeroSum::doPeriodic()
  0.0         0.07        0.116           1           3        116 void zerosum::ZeroSum::getMPIinfo()
  0.0        0.026        0.026           1           0         26 MPI_Comm_rank()
  0.0        0.011        0.011           1           0         11 MPI_Comm_size()
  0.0        0.009        0.009           1           0          9 MPI_Get_processor_name()
---------------------------------------------------------------------------------------

USER EVENTS Profile :NODE 3, CONTEXT 0, THREAD 1
---------------------------------------------------------------------------------------
NumSamples   MaxValue   MinValue  MeanValue  Std. Dev.  Event Name
---------------------------------------------------------------------------------------
         6          0          0          0          0  HWT_0:guest
         6          0          0          0          0  HWT_0:guest_nice
         6  1.112E+08  1.112E+08  1.112E+08       79.7  HWT_0:idle
         6  1.113E+08  1.113E+08  1.113E+08       79.7  HWT_0:idle_all
         6  3.551E+04  3.551E+04  3.551E+04          0  HWT_0:iowait
         6          0          0          0          0  HWT_0:irq
         6   2.23E+04   2.23E+04   2.23E+04          0  HWT_0:nice
         6  7.371E+05  7.371E+05  7.371E+05      1.491  HWT_0:softirq
         6          0          0          0          0  HWT_0:steal
         6  1.722E+07  1.722E+07  1.722E+07          0  HWT_0:system
         6  1.796E+07  1.796E+07  1.796E+07       1.75  HWT_0:system_all
         6  1.978E+08  1.978E+08  1.978E+08      81.83  HWT_0:total_time
         6  6.858E+07  6.858E+07  6.858E+07          1  HWT_0:user
         6          0          0          0          0  HWT_0:virt_all_time
         6          0          0          0          0  HWT_10:guest
         6          0          0          0          0  HWT_10:guest_nice
         6  1.092E+08  1.092E+08  1.092E+08       80.8  HWT_10:idle
         6  1.093E+08  1.093E+08  1.093E+08       80.8  HWT_10:idle_all
         6  2.754E+04  2.754E+04  2.754E+04          0  HWT_10:iowait
         6          0          0          0          0  HWT_10:irq
         6   2.63E+04   2.63E+04   2.63E+04          0  HWT_10:nice
         6  3.891E+04  3.891E+04  3.891E+04          0  HWT_10:softirq
         6          0          0          0          0  HWT_10:steal
         6  1.748E+07  1.748E+07  1.748E+07          0  HWT_10:system
         6  1.752E+07  1.752E+07  1.752E+07          0  HWT_10:system_all
         6  1.975E+08  1.975E+08  1.975E+08      77.61  HWT_10:total_time
         6  7.071E+07  7.071E+07  7.071E+07          1  HWT_10:user
         6          0          0          0          0  HWT_10:virt_all_time
         6          0          0          0          0  HWT_11:guest
         6          0          0          0          0  HWT_11:guest_nice
         6  1.096E+08  1.096E+08  1.096E+08      82.76  HWT_11:idle
         6  1.096E+08  1.096E+08  1.096E+08      82.76  HWT_11:idle_all
         6  2.474E+04  2.474E+04  2.474E+04          0  HWT_11:iowait
         6          0          0          0          0  HWT_11:irq
         6  2.434E+04  2.434E+04  2.434E+04          0  HWT_11:nice
         6  3.382E+04  3.382E+04  3.382E+04          0  HWT_11:softirq
         6          0          0          0          0  HWT_11:steal
         6  1.838E+07  1.838E+07  1.838E+07          0  HWT_11:system
         6  1.841E+07  1.841E+07  1.841E+07          0  HWT_11:system_all
         6  1.976E+08  1.976E+08  1.976E+08      81.83  HWT_11:total_time
         6  6.952E+07  6.952E+07  6.952E+07          0  HWT_11:user
         6          0          0          0          0  HWT_11:virt_all_time
         6          0          0          0          0  HWT_12:guest
         6          0          0          0          0  HWT_12:guest_nice
         6   1.11E+08   1.11E+08   1.11E+08      2.449  HWT_12:idle
         6  1.111E+08  1.111E+08  1.111E+08          0  HWT_12:idle_all
         6  2.056E+04  2.056E+04  2.056E+04          0  HWT_12:iowait
         6          0          0          0          0  HWT_12:irq
         6  2.474E+04  2.474E+04  2.474E+04          0  HWT_12:nice
         6  1.029E+04  1.029E+04  1.029E+04          0  HWT_12:softirq
         6          0          0          0          0  HWT_12:steal
         6  1.819E+07  1.819E+07  1.819E+07      1.436  HWT_12:system
         6   1.82E+07   1.82E+07   1.82E+07     0.6124  HWT_12:system_all
         6  1.976E+08  1.976E+08  1.976E+08      82.51  HWT_12:total_time
         6  6.828E+07  6.828E+07  6.828E+07      79.71  HWT_12:user
         6          0          0          0          0  HWT_12:virt_all_time
         6          0          0          0          0  HWT_13:guest
         6          0          0          0          0  HWT_13:guest_nice
         6  1.103E+08  1.103E+08  1.103E+08       80.8  HWT_13:idle
         6  1.104E+08  1.104E+08  1.104E+08       80.8  HWT_13:idle_all
         6  2.318E+04  2.318E+04  2.318E+04          0  HWT_13:iowait
         6          0          0          0          0  HWT_13:irq
         6  3.101E+04  3.101E+04  3.101E+04          0  HWT_13:nice
         6       9328       9328       9328          0  HWT_13:softirq
         6          0          0          0          0  HWT_13:steal
         6  1.715E+07  1.715E+07  1.715E+07          0  HWT_13:system
         6  1.716E+07  1.716E+07  1.716E+07          0  HWT_13:system_all
         6  1.976E+08  1.976E+08  1.976E+08      82.51  HWT_13:total_time
         6  7.005E+07  7.005E+07  7.005E+07          1  HWT_13:user
         6          0          0          0          0  HWT_13:virt_all_time
         6          0          0          0          0  HWT_14:guest
         6          0          0          0          0  HWT_14:guest_nice
         6  1.102E+08  1.102E+08  1.102E+08      82.11  HWT_14:idle
         6  1.103E+08  1.103E+08  1.103E+08       80.8  HWT_14:idle_all
         6  2.344E+04  2.344E+04  2.344E+04          0  HWT_14:iowait
         6          0          0          0          0  HWT_14:irq
         6  2.192E+04  2.192E+04  2.192E+04          0  HWT_14:nice
         6       8455       8455       8455          0  HWT_14:softirq
         6          0          0          0          0  HWT_14:steal
         6  1.808E+07  1.808E+07  1.808E+07          0  HWT_14:system
         6  1.809E+07  1.809E+07  1.809E+07     0.8292  HWT_14:system_all
         6  1.976E+08  1.976E+08  1.976E+08         84  HWT_14:total_time
         6  6.921E+07  6.921E+07  6.921E+07          1  HWT_14:user
         6          0          0          0          0  HWT_14:virt_all_time
         6          0          0          0          0  HWT_15:guest
         6          0          0          0          0  HWT_15:guest_nice
         6  1.104E+08  1.104E+08  1.104E+08      82.11  HWT_15:idle
         6  1.104E+08  1.104E+08  1.104E+08      83.23  HWT_15:idle_all
         6  2.377E+04  2.377E+04  2.377E+04          0  HWT_15:iowait
         6          0          0          0          0  HWT_15:irq
         6  2.791E+04  2.791E+04  2.791E+04          0  HWT_15:nice
         6  1.061E+04  1.061E+04  1.061E+04          0  HWT_15:softirq
         6          0          0          0          0  HWT_15:steal
         6  1.706E+07  1.706E+07  1.706E+07          0  HWT_15:system
         6  1.707E+07  1.707E+07  1.707E+07          0  HWT_15:system_all
         6  1.976E+08  1.976E+08  1.976E+08      82.46  HWT_15:total_time
         6   7.01E+07   7.01E+07   7.01E+07          1  HWT_15:user
         6          0          0          0          0  HWT_15:virt_all_time
         6          0          0          0          0  HWT_16:guest
         6          0          0          0          0  HWT_16:guest_nice
         6  1.104E+08  1.104E+08  1.104E+08       80.8  HWT_16:idle
         6  1.105E+08  1.105E+08  1.105E+08       80.8  HWT_16:idle_all
         6  3.116E+04  3.116E+04  3.116E+04          0  HWT_16:iowait
         6          0          0          0          0  HWT_16:irq
         6  1.946E+04  1.946E+04  1.946E+04          0  HWT_16:nice
         6       8895       8895       8895          0  HWT_16:softirq
         6          0          0          0          0  HWT_16:steal
         6  1.731E+07  1.731E+07  1.731E+07          0  HWT_16:system
         6  1.732E+07  1.732E+07  1.732E+07          0  HWT_16:system_all
         6  1.976E+08  1.976E+08  1.976E+08      84.05  HWT_16:total_time
         6  6.979E+07  6.979E+07  6.979E+07          1  HWT_16:user
         6          0          0          0          0  HWT_16:virt_all_time
         6          0          0          0          0  HWT_17:guest
         6          0          0          0          0  HWT_17:guest_nice
         6  1.105E+08  1.105E+08  1.105E+08       80.8  HWT_17:idle
         6  1.105E+08  1.105E+08  1.105E+08       80.8  HWT_17:idle_all
         6  2.764E+04  2.764E+04  2.764E+04          0  HWT_17:iowait
         6          0          0          0          0  HWT_17:irq
         6  2.815E+04  2.815E+04  2.815E+04          0  HWT_17:nice
         6       9628       9628       9628          0  HWT_17:softirq
         6          0          0          0          0  HWT_17:steal
         6   1.71E+07   1.71E+07   1.71E+07          0  HWT_17:system
         6  1.711E+07  1.711E+07  1.711E+07          0  HWT_17:system_all
         6  1.976E+08  1.976E+08  1.976E+08      83.95  HWT_17:total_time
         6  6.995E+07  6.995E+07  6.995E+07          1  HWT_17:user
         6          0          0          0          0  HWT_17:virt_all_time
         6          0          0          0          0  HWT_18:guest
         6          0          0          0          0  HWT_18:guest_nice
         6  1.101E+08  1.101E+08  1.101E+08       79.7  HWT_18:idle
         6  1.101E+08  1.101E+08  1.101E+08      82.11  HWT_18:idle_all
         6   2.37E+04   2.37E+04   2.37E+04          0  HWT_18:iowait
         6          0          0          0          0  HWT_18:irq
         6  2.048E+04  2.048E+04  2.048E+04          0  HWT_18:nice
         6  3.758E+04  3.758E+04  3.758E+04          0  HWT_18:softirq
         6          0          0          0          0  HWT_18:steal
         6  1.715E+07  1.715E+07  1.715E+07          0  HWT_18:system
         6  1.719E+07  1.719E+07  1.719E+07          0  HWT_18:system_all
         6  1.976E+08  1.976E+08  1.976E+08      82.41  HWT_18:total_time
         6  7.024E+07  7.024E+07  7.024E+07          0  HWT_18:user
         6          0          0          0          0  HWT_18:virt_all_time
         6          0          0          0          0  HWT_19:guest
         6          0          0          0          0  HWT_19:guest_nice
         6  1.091E+08  1.091E+08  1.091E+08      80.01  HWT_19:idle
         6  1.091E+08  1.091E+08  1.091E+08       80.8  HWT_19:idle_all
         6  3.029E+04  3.029E+04  3.029E+04          0  HWT_19:iowait
         6          0          0          0          0  HWT_19:irq
         6   2.59E+04   2.59E+04   2.59E+04          0  HWT_19:nice
         6  3.522E+04  3.522E+04  3.522E+04          0  HWT_19:softirq
         6          0          0          0          0  HWT_19:steal
         6  1.744E+07  1.744E+07  1.744E+07          0  HWT_19:system
         6  1.747E+07  1.747E+07  1.747E+07          0  HWT_19:system_all
         6  1.976E+08  1.976E+08  1.976E+08      77.67  HWT_19:total_time
         6  7.098E+07  7.098E+07  7.098E+07          1  HWT_19:user
         6          0          0          0          0  HWT_19:virt_all_time
         6          0          0          0          0  HWT_1:guest
         6          0          0          0          0  HWT_1:guest_nice
         6  1.101E+08  1.101E+08  1.101E+08      80.01  HWT_1:idle
         6  1.101E+08  1.101E+08  1.101E+08       80.8  HWT_1:idle_all
         6  2.812E+04  2.812E+04  2.812E+04          0  HWT_1:iowait
         6          0          0          0          0  HWT_1:irq
         6   2.61E+04   2.61E+04   2.61E+04          0  HWT_1:nice
         6  1.136E+05  1.136E+05  1.136E+05          0  HWT_1:softirq
         6          0          0          0          0  HWT_1:steal
         6  1.775E+07  1.775E+07  1.775E+07          0  HWT_1:system
         6  1.786E+07  1.786E+07  1.786E+07          0  HWT_1:system_all
         6  1.975E+08  1.975E+08  1.975E+08      82.46  HWT_1:total_time
         6   6.95E+07   6.95E+07   6.95E+07          1  HWT_1:user
         6          0          0          0          0  HWT_1:virt_all_time
         6          0          0          0          0  HWT_20:guest
         6          0          0          0          0  HWT_20:guest_nice
         6  1.092E+08  1.092E+08  1.092E+08       77.7  HWT_20:idle
         6  1.093E+08  1.093E+08  1.093E+08       77.7  HWT_20:idle_all
         6  2.175E+04  2.175E+04  2.175E+04          0  HWT_20:iowait
         6          0          0          0          0  HWT_20:irq
         6  2.664E+04  2.664E+04  2.664E+04          0  HWT_20:nice
         6  2.841E+04  2.841E+04  2.841E+04          0  HWT_20:softirq
         6          0          0          0          0  HWT_20:steal
         6  1.699E+07  1.699E+07  1.699E+07          0  HWT_20:system
         6  1.701E+07  1.701E+07  1.701E+07          0  HWT_20:system_all
         6  1.976E+08  1.976E+08  1.976E+08      77.61  HWT_20:total_time
         6  7.124E+07  7.124E+07  7.124E+07          1  HWT_20:user
         6          0          0          0          0  HWT_20:virt_all_time
         6          0          0          0          0  HWT_21:guest
         6          0          0          0          0  HWT_21:guest_nice
         6  1.106E+08  1.106E+08  1.106E+08      82.11  HWT_21:idle
         6  1.106E+08  1.106E+08  1.106E+08       80.8  HWT_21:idle_all
         6   2.03E+04   2.03E+04   2.03E+04          0  HWT_21:iowait
         6          0          0          0          0  HWT_21:irq
         6  2.462E+04  2.462E+04  2.462E+04          0  HWT_21:nice
         6       6806       6806       6806          0  HWT_21:softirq
         6          0          0          0          0  HWT_21:steal
         6  1.703E+07  1.703E+07  1.703E+07          0  HWT_21:system
         6  1.704E+07  1.704E+07  1.704E+07          0  HWT_21:system_all
         6  1.976E+08  1.976E+08  1.976E+08      82.51  HWT_21:total_time
         6  6.987E+07  6.987E+07  6.987E+07          1  HWT_21:user
         6          0          0          0          0  HWT_21:virt_all_time
         6          0          0          0          0  HWT_22:guest
         6          0          0          0          0  HWT_22:guest_nice
         6  1.107E+08  1.107E+08  1.107E+08       80.8  HWT_22:idle
         6  1.107E+08  1.107E+08  1.107E+08      82.11  HWT_22:idle_all
         6  4.532E+04  4.532E+04  4.532E+04          0  HWT_22:iowait
         6          0          0          0          0  HWT_22:irq
         6  1.842E+04  1.842E+04  1.842E+04          0  HWT_22:nice
         6       9128       9128       9128          0  HWT_22:softirq
         6          0          0          0          0  HWT_22:steal
         6  1.687E+07  1.687E+07  1.687E+07          0  HWT_22:system
         6  1.688E+07  1.688E+07  1.688E+07          0  HWT_22:system_all
         6  1.974E+08  1.974E+08  1.974E+08      77.72  HWT_22:total_time
         6  6.975E+07  6.975E+07  6.975E+07          1  HWT_22:user
         6          0          0          0          0  HWT_22:virt_all_time
         6          0          0          0          0  HWT_23:guest
         6          0          0          0          0  HWT_23:guest_nice
         6   1.09E+08   1.09E+08   1.09E+08       79.7  HWT_23:idle
         6   1.09E+08   1.09E+08   1.09E+08      78.38  HWT_23:idle_all
         6  5.931E+04  5.931E+04  5.931E+04          0  HWT_23:iowait
         6          0          0          0          0  HWT_23:irq
         6   3.25E+04   3.25E+04   3.25E+04          0  HWT_23:nice
         6  9.204E+05  9.204E+05  9.204E+05     0.3729  HWT_23:softirq
         6          0          0          0          0  HWT_23:steal
         6   1.76E+07   1.76E+07   1.76E+07     0.8292  HWT_23:system
         6  1.852E+07  1.852E+07  1.852E+07      0.866  HWT_23:system_all
         6  1.965E+08  1.965E+08  1.965E+08      84.05  HWT_23:total_time
         6  6.895E+07  6.895E+07  6.895E+07          1  HWT_23:user
         6          0          0          0          0  HWT_23:virt_all_time
         6          0          0          0          0  HWT_24:guest
         6          0          0          0          0  HWT_24:guest_nice
         6  1.106E+08  1.106E+08  1.106E+08       80.8  HWT_24:idle
         6  1.107E+08  1.107E+08  1.107E+08       80.8  HWT_24:idle_all
         6  4.994E+04  4.994E+04  4.994E+04          0  HWT_24:iowait
         6          0          0          0          0  HWT_24:irq
         6  1.893E+04  1.893E+04  1.893E+04          0  HWT_24:nice
         6  2.742E+04  2.742E+04  2.742E+04          0  HWT_24:softirq
         6          0          0          0          0  HWT_24:steal
         6   1.71E+07   1.71E+07   1.71E+07          0  HWT_24:system
         6  1.713E+07  1.713E+07  1.713E+07     0.6124  HWT_24:system_all
         6  1.975E+08  1.975E+08  1.975E+08      82.46  HWT_24:total_time
         6  6.965E+07  6.965E+07  6.965E+07          0  HWT_24:user
         6          0          0          0          0  HWT_24:virt_all_time
         6          0          0          0          0  HWT_25:guest
         6          0          0          0          0  HWT_25:guest_nice
         6  1.109E+08  1.109E+08  1.109E+08       79.7  HWT_25:idle
         6   1.11E+08   1.11E+08   1.11E+08      80.54  HWT_25:idle_all
         6  3.967E+04  3.967E+04  3.967E+04          0  HWT_25:iowait
         6          0          0          0          0  HWT_25:irq
         6  2.551E+04  2.551E+04  2.551E+04          0  HWT_25:nice
         6  3.164E+04  3.164E+04  3.164E+04          0  HWT_25:softirq
         6          0          0          0          0  HWT_25:steal
         6  1.701E+07  1.701E+07  1.701E+07       3.01  HWT_25:system
         6  1.704E+07  1.704E+07  1.704E+07       3.01  HWT_25:system_all
         6  1.976E+08  1.976E+08  1.976E+08      84.05  HWT_25:total_time
         6  6.952E+07  6.952E+07  6.952E+07          1  HWT_25:user
         6          0          0          0          0  HWT_25:virt_all_time
         6          0          0          0          0  HWT_26:guest
         6          0          0          0          0  HWT_26:guest_nice
         6  1.111E+08  1.111E+08  1.111E+08      82.76  HWT_26:idle
         6  1.111E+08  1.111E+08  1.111E+08       79.7  HWT_26:idle_all
         6  2.662E+04  2.662E+04  2.662E+04          0  HWT_26:iowait
         6          0          0          0          0  HWT_26:irq
         6  1.896E+04  1.896E+04  1.896E+04          0  HWT_26:nice
         6       9599       9599       9599          0  HWT_26:softirq
         6          0          0          0          0  HWT_26:steal
         6  1.712E+07  1.712E+07  1.712E+07      1.436  HWT_26:system
         6  1.713E+07  1.713E+07  1.713E+07      1.414  HWT_26:system_all
         6  1.976E+08  1.976E+08  1.976E+08      82.51  HWT_26:total_time
         6  6.931E+07  6.931E+07  6.931E+07          1  HWT_26:user
         6          0          0          0          0  HWT_26:virt_all_time
         6          0          0          0          0  HWT_27:guest
         6          0          0          0          0  HWT_27:guest_nice
         6  1.111E+08  1.111E+08  1.111E+08      75.15  HWT_27:idle
         6  1.111E+08  1.111E+08  1.111E+08      75.17  HWT_27:idle_all
         6  2.882E+04  2.882E+04  2.882E+04          0  HWT_27:iowait
         6          0          0          0          0  HWT_27:irq
         6  3.854E+04  3.854E+04  3.854E+04          0  HWT_27:nice
         6   1.14E+04  1.139E+04  1.139E+04     0.3727  HWT_27:softirq
         6          0          0          0          0  HWT_27:steal
         6  1.697E+07  1.697E+07  1.697E+07      5.948  HWT_27:system
         6  1.698E+07  1.698E+07  1.698E+07      6.708  HWT_27:system_all
         6  1.976E+08  1.976E+08  1.976E+08      77.61  HWT_27:total_time
         6  6.949E+07  6.949E+07  6.949E+07          1  HWT_27:user
         6          0          0          0          0  HWT_27:virt_all_time
         6          0          0          0          0  HWT_28:guest
         6          0          0          0          0  HWT_28:guest_nice
         6  1.127E+08  1.127E+08  1.127E+08       79.7  HWT_28:idle
         6  1.127E+08  1.127E+08  1.127E+08       79.7  HWT_28:idle_all
         6   2.99E+04   2.99E+04   2.99E+04          0  HWT_28:iowait
         6          0          0          0          0  HWT_28:irq
         6  2.385E+04  2.385E+04  2.385E+04          0  HWT_28:nice
         6       5736       5736       5736          0  HWT_28:softirq
         6          0          0          0          0  HWT_28:steal
         6  1.756E+07  1.756E+07  1.756E+07          0  HWT_28:system
         6  1.756E+07  1.756E+07  1.756E+07          0  HWT_28:system_all
         6  1.975E+08  1.975E+08  1.975E+08      77.56  HWT_28:total_time
         6  6.717E+07  6.717E+07  6.717E+07          1  HWT_28:user
         6          0          0          0          0  HWT_28:virt_all_time
         6          0          0          0          0  HWT_29:guest
         6          0          0          0          0  HWT_29:guest_nice
         6  1.108E+08  1.108E+08  1.108E+08       80.8  HWT_29:idle
         6  1.109E+08  1.109E+08  1.109E+08       78.4  HWT_29:idle_all
         6  3.186E+04  3.186E+04  3.186E+04          0  HWT_29:iowait
         6          0          0          0          0  HWT_29:irq
         6  2.478E+04  2.478E+04  2.478E+04          0  HWT_29:nice
         6  3.074E+04  3.074E+04  3.074E+04          0  HWT_29:softirq
         6          0          0          0          0  HWT_29:steal
         6  1.717E+07  1.717E+07  1.717E+07       3.01  HWT_29:system
         6   1.72E+07   1.72E+07   1.72E+07       3.01  HWT_29:system_all
         6  1.976E+08  1.976E+08  1.976E+08      81.83  HWT_29:total_time
         6   6.95E+07   6.95E+07   6.95E+07          1  HWT_29:user
         6          0          0          0          0  HWT_29:virt_all_time
         6          0          0          0          0  HWT_2:guest
         6          0          0          0          0  HWT_2:guest_nice
         6  1.098E+08  1.098E+08  1.098E+08      82.75  HWT_2:idle
         6  1.098E+08  1.098E+08  1.098E+08       79.7  HWT_2:idle_all
         6  3.624E+04  3.624E+04  3.624E+04          0  HWT_2:iowait
         6          0          0          0          0  HWT_2:irq
         6  2.379E+04  2.379E+04  2.379E+04          0  HWT_2:nice
         6  4.544E+04  4.544E+04  4.544E+04          0  HWT_2:softirq
         6          0          0          0          0  HWT_2:steal
         6  1.765E+07  1.765E+07  1.765E+07          0  HWT_2:system
         6  1.769E+07  1.769E+07  1.769E+07          0  HWT_2:system_all
         6  1.976E+08  1.976E+08  1.976E+08         84  HWT_2:total_time
         6  7.003E+07  7.003E+07  7.003E+07          1  HWT_2:user
         6          0          0          0          0  HWT_2:virt_all_time
         6          0          0          0          0  HWT_30:guest
         6          0          0          0          0  HWT_30:guest_nice
         6  1.099E+08  1.099E+08  1.099E+08          0  HWT_30:idle
         6  1.099E+08  1.099E+08  1.099E+08          0  HWT_30:idle_all
         6  2.072E+04  2.072E+04  2.072E+04          0  HWT_30:iowait
         6          0          0          0          0  HWT_30:irq
         6  2.613E+04  2.613E+04  2.613E+04          0  HWT_30:nice
         6  3.164E+04  3.164E+04  3.164E+04          0  HWT_30:softirq
         6          0          0          0          0  HWT_30:steal
         6  1.688E+07  1.688E+07  1.688E+07      1.521  HWT_30:system
         6  1.691E+07  1.691E+07  1.691E+07      1.936  HWT_30:system_all
         6  1.976E+08  1.976E+08  1.976E+08      81.83  HWT_30:total_time
         6  7.076E+07  7.076E+07  7.076E+07      82.07  HWT_30:user
         6          0          0          0          0  HWT_30:virt_all_time
         6          0          0          0          0  HWT_31:guest
         6          0          0          0          0  HWT_31:guest_nice
         6  1.112E+08  1.112E+08  1.112E+08       80.8  HWT_31:idle
         6  1.112E+08  1.112E+08  1.112E+08         80  HWT_31:idle_all
         6  2.174E+04  2.173E+04  2.173E+04      1.414  HWT_31:iowait
         6          0          0          0          0  HWT_31:irq
         6  2.102E+04  2.102E+04  2.102E+04          0  HWT_31:nice
         6       8756       8756       8756          0  HWT_31:softirq
         6          0          0          0          0  HWT_31:steal
         6  1.769E+07  1.769E+07  1.769E+07          0  HWT_31:system
         6   1.77E+07   1.77E+07   1.77E+07          0  HWT_31:system_all
         6  1.976E+08  1.976E+08  1.976E+08         84  HWT_31:total_time
         6  6.866E+07  6.866E+07  6.866E+07          1  HWT_31:user
         6          0          0          0          0  HWT_31:virt_all_time
         6          0          0          0          0  HWT_32:guest
         6          0          0          0          0  HWT_32:guest_nice
         6  1.083E+08  1.083E+08  1.083E+08       79.7  HWT_32:idle
         6  1.083E+08  1.083E+08  1.083E+08       79.7  HWT_32:idle_all
         6  2.385E+04  2.385E+04  2.385E+04          0  HWT_32:iowait
         6          0          0          0          0  HWT_32:irq
         6  1.677E+04  1.677E+04  1.677E+04          0  HWT_32:nice
         6  9.694E+05  9.694E+05  9.694E+05      1.118  HWT_32:softirq
         6          0          0          0          0  HWT_32:steal
         6  1.799E+07  1.799E+07  1.799E+07          0  HWT_32:system
         6  1.896E+07  1.896E+07  1.896E+07      0.866  HWT_32:system_all
         6  1.966E+08  1.966E+08  1.966E+08      77.61  HWT_32:total_time
         6  6.926E+07  6.926E+07  6.926E+07          1  HWT_32:user
         6          0          0          0          0  HWT_32:virt_all_time
         6          0          0          0          0  HWT_33:guest
         6          0          0          0          0  HWT_33:guest_nice
         6  1.105E+08  1.105E+08  1.105E+08      82.11  HWT_33:idle
         6  1.106E+08  1.106E+08  1.106E+08      82.11  HWT_33:idle_all
         6  2.133E+04  2.133E+04  2.133E+04          0  HWT_33:iowait
         6          0          0          0          0  HWT_33:irq
         6  2.527E+04  2.527E+04  2.527E+04          0  HWT_33:nice
         6  3.184E+04  3.184E+04  3.184E+04          0  HWT_33:softirq
         6          0          0          0          0  HWT_33:steal
         6    1.7E+07    1.7E+07    1.7E+07      0.866  HWT_33:system
         6  1.703E+07  1.703E+07  1.703E+07      0.866  HWT_33:system_all
         6  1.974E+08  1.974E+08  1.974E+08      84.05  HWT_33:total_time
         6  6.982E+07  6.982E+07  6.982E+07          1  HWT_33:user
         6          0          0          0          0  HWT_33:virt_all_time
         6          0          0          0          0  HWT_34:guest
         6          0          0          0          0  HWT_34:guest_nice
         6  1.093E+08  1.093E+08  1.093E+08       79.7  HWT_34:idle
         6  1.094E+08  1.094E+08  1.094E+08       80.8  HWT_34:idle_all
         6  2.306E+04  2.306E+04  2.306E+04          0  HWT_34:iowait
         6          0          0          0          0  HWT_34:irq
         6  1.605E+04  1.605E+04  1.605E+04          0  HWT_34:nice
         6  8.483E+05  8.483E+05  8.483E+05     0.7453  HWT_34:softirq
         6          0          0          0          0  HWT_34:steal
         6  1.744E+07  1.744E+07  1.744E+07          0  HWT_34:system
         6  1.829E+07  1.829E+07  1.829E+07      1.436  HWT_34:system_all
         6  1.965E+08  1.965E+08  1.965E+08      77.56  HWT_34:total_time
         6  6.887E+07  6.887E+07  6.887E+07          1  HWT_34:user
         6          0          0          0          0  HWT_34:virt_all_time
         6          0          0          0          0  HWT_35:guest
         6          0          0          0          0  HWT_35:guest_nice
         6  1.105E+08  1.105E+08  1.105E+08       80.8  HWT_35:idle
         6  1.106E+08  1.106E+08  1.106E+08       79.7  HWT_35:idle_all
         6  2.188E+04  2.188E+04  2.188E+04          0  HWT_35:iowait
         6          0          0          0          0  HWT_35:irq
         6  2.339E+04  2.339E+04  2.339E+04          0  HWT_35:nice
         6  2.922E+04  2.922E+04  2.922E+04          0  HWT_35:softirq
         6          0          0          0          0  HWT_35:steal
         6  1.695E+07  1.695E+07  1.695E+07          0  HWT_35:system
         6  1.698E+07  1.698E+07  1.698E+07      0.866  HWT_35:system_all
         6  1.975E+08  1.975E+08  1.975E+08      82.46  HWT_35:total_time
         6  6.989E+07  6.989E+07  6.989E+07          1  HWT_35:user
         6          0          0          0          0  HWT_35:virt_all_time
         6          0          0          0          0  HWT_36:guest
         6          0          0          0          0  HWT_36:guest_nice
         6  1.108E+08  1.108E+08  1.108E+08       79.7  HWT_36:idle
         6  1.108E+08  1.108E+08  1.108E+08      82.76  HWT_36:idle_all
         6  2.539E+04  2.539E+04  2.539E+04          0  HWT_36:iowait
         6          0          0          0          0  HWT_36:irq
         6  2.358E+04  2.358E+04  2.358E+04          0  HWT_36:nice
         6  4.776E+04  4.776E+04  4.776E+04          0  HWT_36:softirq
         6          0          0          0          0  HWT_36:steal
         6  1.699E+07  1.699E+07  1.699E+07     0.8292  HWT_36:system
         6  1.704E+07  1.704E+07  1.704E+07          0  HWT_36:system_all
         6  1.975E+08  1.975E+08  1.975E+08      77.61  HWT_36:total_time
         6  6.963E+07  6.963E+07  6.963E+07          1  HWT_36:user
         6          0          0          0          0  HWT_36:virt_all_time
         6          0          0          0          0  HWT_37:guest
         6          0          0          0          0  HWT_37:guest_nice
         6  1.106E+08  1.106E+08  1.106E+08      82.11  HWT_37:idle
         6  1.107E+08  1.107E+08  1.107E+08       79.7  HWT_37:idle_all
         6  3.009E+04  3.009E+04  3.009E+04          0  HWT_37:iowait
         6          0          0          0          0  HWT_37:irq
         6  2.658E+04  2.658E+04  2.658E+04          0  HWT_37:nice
         6  5.836E+04  5.836E+04  5.836E+04          0  HWT_37:softirq
         6          0          0          0          0  HWT_37:steal
         6  1.691E+07  1.691E+07  1.691E+07          0  HWT_37:system
         6  1.697E+07  1.697E+07  1.697E+07          0  HWT_37:system_all
         6  1.975E+08  1.975E+08  1.975E+08      77.67  HWT_37:total_time
         6  6.983E+07  6.983E+07  6.983E+07          1  HWT_37:user
         6          0          0          0          0  HWT_37:virt_all_time
         6          0          0          0          0  HWT_38:guest
         6          0          0          0          0  HWT_38:guest_nice
         6  1.109E+08  1.109E+08  1.109E+08      82.11  HWT_38:idle
         6   1.11E+08   1.11E+08   1.11E+08       80.8  HWT_38:idle_all
         6  2.524E+04  2.524E+04  2.524E+04          0  HWT_38:iowait
         6          0          0          0          0  HWT_38:irq
         6  3.076E+04  3.076E+04  3.076E+04          0  HWT_38:nice
         6  1.321E+04  1.321E+04  1.321E+04          0  HWT_38:softirq
         6          0          0          0          0  HWT_38:steal
         6  1.688E+07  1.688E+07  1.688E+07          0  HWT_38:system
         6   1.69E+07   1.69E+07   1.69E+07          0  HWT_38:system_all
         6  1.976E+08  1.976E+08  1.976E+08         84  HWT_38:total_time
         6   6.97E+07   6.97E+07   6.97E+07          1  HWT_38:user
         6          0          0          0          0  HWT_38:virt_all_time
         6          0          0          0          0  HWT_39:guest
         6          0          0          0          0  HWT_39:guest_nice
         6  1.082E+08  1.082E+08  1.082E+08       80.8  HWT_39:idle
         6  1.083E+08  1.083E+08  1.083E+08      82.11  HWT_39:idle_all
         6  4.131E+04  4.131E+04  4.131E+04          0  HWT_39:iowait
         6          0          0          0          0  HWT_39:irq
         6  2.466E+04  2.466E+04  2.466E+04          0  HWT_39:nice
         6  1.034E+04  1.034E+04  1.034E+04          0  HWT_39:softirq
         6          0          0          0          0  HWT_39:steal
         6  1.787E+07  1.787E+07  1.787E+07          0  HWT_39:system
         6  1.788E+07  1.788E+07  1.788E+07          0  HWT_39:system_all
         6  1.976E+08  1.976E+08  1.976E+08      81.78  HWT_39:total_time
         6  7.143E+07  7.143E+07  7.143E+07          1  HWT_39:user
         6          0          0          0          0  HWT_39:virt_all_time
         6          0          0          0          0  HWT_3:guest
         6          0          0          0          0  HWT_3:guest_nice
         6  1.099E+08  1.099E+08  1.099E+08       80.8  HWT_3:idle
         6  1.099E+08  1.099E+08  1.099E+08      82.11  HWT_3:idle_all
         6  3.448E+04  3.448E+04  3.448E+04          0  HWT_3:iowait
         6          0          0          0          0  HWT_3:irq
         6  2.704E+04  2.704E+04  2.704E+04          0  HWT_3:nice
         6  6.833E+04  6.833E+04  6.833E+04          0  HWT_3:softirq
         6          0          0          0          0  HWT_3:steal
         6  1.835E+07  1.835E+07  1.835E+07          0  HWT_3:system
         6  1.841E+07  1.841E+07  1.841E+07          0  HWT_3:system_all
         6  1.975E+08  1.975E+08  1.975E+08      83.95  HWT_3:total_time
         6  6.909E+07  6.909E+07  6.909E+07          1  HWT_3:user
         6          0          0          0          0  HWT_3:virt_all_time
         6          0          0          0          0  HWT_4:guest
         6          0          0          0          0  HWT_4:guest_nice
         6  1.098E+08  1.098E+08  1.098E+08      82.76  HWT_4:idle
         6  1.098E+08  1.098E+08  1.098E+08         80  HWT_4:idle_all
         6  2.938E+04  2.938E+04  2.938E+04          0  HWT_4:iowait
         6          0          0          0          0  HWT_4:irq
         6   1.99E+04   1.99E+04   1.99E+04          0  HWT_4:nice
         6  2.275E+04  2.275E+04  2.275E+04          0  HWT_4:softirq
         6          0          0          0          0  HWT_4:steal
         6  1.758E+07  1.758E+07  1.758E+07          0  HWT_4:system
         6   1.76E+07   1.76E+07   1.76E+07          0  HWT_4:system_all
         6  1.975E+08  1.975E+08  1.975E+08      77.72  HWT_4:total_time
         6  7.012E+07  7.012E+07  7.012E+07          1  HWT_4:user
         6          0          0          0          0  HWT_4:virt_all_time
         6          0          0          0          0  HWT_5:guest
         6          0          0          0          0  HWT_5:guest_nice
         6  1.101E+08  1.101E+08  1.101E+08      82.11  HWT_5:idle
         6  1.101E+08  1.101E+08  1.101E+08       80.8  HWT_5:idle_all
         6  2.957E+04  2.957E+04  2.957E+04          0  HWT_5:iowait
         6          0          0          0          0  HWT_5:irq
         6  2.179E+04  2.179E+04  2.179E+04          0  HWT_5:nice
         6  2.352E+04  2.352E+04  2.352E+04          0  HWT_5:softirq
         6          0          0          0          0  HWT_5:steal
         6  1.748E+07  1.748E+07  1.748E+07          0  HWT_5:system
         6   1.75E+07   1.75E+07   1.75E+07          0  HWT_5:system_all
         6  1.976E+08  1.976E+08  1.976E+08      82.51  HWT_5:total_time
         6  6.991E+07  6.991E+07  6.991E+07          1  HWT_5:user
         6          0          0          0          0  HWT_5:virt_all_time
         6          0          0          0          0  HWT_6:guest
         6          0          0          0          0  HWT_6:guest_nice
         6  1.101E+08  1.101E+08  1.101E+08      80.01  HWT_6:idle
         6  1.102E+08  1.102E+08  1.102E+08       80.8  HWT_6:idle_all
         6  2.505E+04  2.505E+04  2.505E+04          0  HWT_6:iowait
         6          0          0          0          0  HWT_6:irq
         6  4.617E+04  4.617E+04  4.617E+04          0  HWT_6:nice
         6   5.72E+04   5.72E+04   5.72E+04          0  HWT_6:softirq
         6          0          0          0          0  HWT_6:steal
         6  1.755E+07  1.755E+07  1.755E+07      0.866  HWT_6:system
         6   1.76E+07   1.76E+07   1.76E+07          0  HWT_6:system_all
         6  1.975E+08  1.975E+08  1.975E+08      82.51  HWT_6:total_time
         6  6.971E+07  6.971E+07  6.971E+07          0  HWT_6:user
         6          0          0          0          0  HWT_6:virt_all_time
         6          0          0          0          0  HWT_7:guest
         6          0          0          0          0  HWT_7:guest_nice
         6    1.1E+08    1.1E+08    1.1E+08      77.33  HWT_7:idle
         6  1.101E+08  1.101E+08  1.101E+08       78.4  HWT_7:idle_all
         6  2.389E+04  2.389E+04  2.389E+04          0  HWT_7:iowait
         6          0          0          0          0  HWT_7:irq
         6  1.725E+04  1.725E+04  1.725E+04          0  HWT_7:nice
         6  2.323E+04  2.323E+04  2.323E+04          0  HWT_7:softirq
         6          0          0          0          0  HWT_7:steal
         6   1.76E+07   1.76E+07   1.76E+07       3.01  HWT_7:system
         6  1.763E+07  1.763E+07  1.763E+07        3.7  HWT_7:system_all
         6  1.976E+08  1.976E+08  1.976E+08      84.05  HWT_7:total_time
         6  6.987E+07  6.987E+07  6.987E+07          1  HWT_7:user
         6          0          0          0          0  HWT_7:virt_all_time
         6          0          0          0          0  HWT_8:guest
         6          0          0          0          0  HWT_8:guest_nice
         6  1.084E+08  1.084E+08  1.084E+08          0  HWT_8:idle
         6  1.084E+08  1.084E+08  1.084E+08          0  HWT_8:idle_all
         6  2.409E+04  2.409E+04  2.409E+04          0  HWT_8:iowait
         6          0          0          0          0  HWT_8:irq
         6  2.315E+04  2.315E+04  2.315E+04          0  HWT_8:nice
         6  1.015E+06  1.015E+06  1.015E+06      1.118  HWT_8:softirq
         6          0          0          0          0  HWT_8:steal
         6  1.818E+07  1.818E+07  1.818E+07          0  HWT_8:system
         6  1.919E+07  1.919E+07  1.919E+07      0.866  HWT_8:system_all
         6  1.966E+08  1.966E+08  1.966E+08      82.46  HWT_8:total_time
         6    6.9E+07    6.9E+07    6.9E+07       80.8  HWT_8:user
         6          0          0          0          0  HWT_8:virt_all_time
         6          0          0          0          0  HWT_9:guest
         6          0          0          0          0  HWT_9:guest_nice
         6    1.1E+08    1.1E+08    1.1E+08       75.3  HWT_9:idle
         6    1.1E+08    1.1E+08    1.1E+08      76.18  HWT_9:idle_all
         6  3.087E+04  3.087E+04  3.087E+04          0  HWT_9:iowait
         6          0          0          0          0  HWT_9:irq
         6  2.086E+04  2.086E+04  2.086E+04          0  HWT_9:nice
         6       8876       8875       8875     0.3727  HWT_9:softirq
         6          0          0          0          0  HWT_9:steal
         6  1.762E+07  1.762E+07  1.762E+07      3.708  HWT_9:system
         6  1.763E+07  1.763E+07  1.763E+07        3.7  HWT_9:system_all
         6  1.975E+08  1.975E+08  1.975E+08         84  HWT_9:total_time
         6  6.977E+07  6.977E+07  6.977E+07          1  HWT_9:user
         6          0          0          0          0  HWT_9:virt_all_time
         6         19         19         19          0  LWP_3833275:majflt
         6       4463       4463       4463          0  LWP_3833275:minflt
         6          4          4          4          0  LWP_3833275:nonvoluntary_ctxt_switches
         6          0          0          0          0  LWP_3833275:nswap
         6         38         38         38          0  LWP_3833275:processor
         6  1.404E+14  1.404E+14  1.404E+14  2.568E+06  LWP_3833275:pthread lock calls
         6  1.404E+14  1.404E+14  1.404E+14  2.568E+06  LWP_3833275:pthread trylock calls
         6          1          1          1          0  LWP_3833275:stime
         6          6          6          6          0  LWP_3833275:utime
         6         30         30         30          0  LWP_3833275:voluntary_ctxt_switches
         6          0          0          0          0  LWP_3833286:majflt
         6        593        419      537.2      56.04  LWP_3833286:minflt
         6          6          6          6          0  LWP_3833286:nonvoluntary_ctxt_switches
         6          0          0          0          0  LWP_3833286:nswap
         6         39         39         39          0  LWP_3833286:processor
         6       1806         69       1508      643.6  LWP_3833286:pthread lock calls
         6          0          0          0          0  LWP_3833286:pthread trylock calls
         6          0          0          0          0  LWP_3833286:stime
         6        232        231      231.7     0.4714  LWP_3833286:utime
         6          9          4        6.5      1.708  LWP_3833286:voluntary_ctxt_switches
---------------------------------------------------------------------------------------

FUNCTION SUMMARY (total):
---------------------------------------------------------------------------------------
%Time    Exclusive    Inclusive       #Call      #Subrs  Inclusive Name
              msec   total msec                          usec/call
---------------------------------------------------------------------------------------
100.0           87       42,938           8           8    5367256 .TAU application
 49.9           58       21,444           4          16    5361177 int taupreload_main(int, char **, char **)
 49.9       21,336       21,405           4      400032    5351310 void zerosum::ZeroSum::threadedFunction()
 49.8       20,048       21,368           4          20    5342058 main
 12.5        0.027        5,365           1           1    5365404 [PTHREAD] addr=<7fdb6b7ebda0>
 12.5        0.023        5,349           1           1    5349131 [PTHREAD] addr=<7f57e65ebda0>
 12.4        0.025        5,345           1           1    5345636 [PTHREAD] addr=<7f72797ebda0>
 12.4        0.025        5,345           1           1    5345169 [PTHREAD] addr=<7fadb5febda0>
  3.0        1,268        1,268           4           0     317145 MPI_Init()
  0.1        0.208           49           4          32      12266 func
  0.1           48           48           4           0      12016 MPI_Barrier()
  0.1           35           35      400004           0          0 bool zerosum::ZeroSum::doOnce() [THROTTLED]
  0.1           32           32          24           0       1361 void zerosum::ZeroSum::doPeriodic()
  0.0           16           16           4           0       4152 pthread_join
  0.0            1            1           4           0        415 MPI_Finalize()
  0.0            1            1           4           0        301 void zerosum::ZeroSum::getProcStatus()
  0.0        0.315        0.488           4          12        122 void zerosum::ZeroSum::getMPIinfo()
  0.0         0.43         0.43          12           0         36 MPI_Recv()
  0.0        0.228         0.26           4           4         65 MPI_Bcast()
  0.0        0.185        0.185           4           0         46 pthread_create
  0.0        0.101        0.101           8           0         13 MPI_Comm_rank()
  0.0        0.101        0.101          12           0          8 MPI_Send()
  0.0        0.071        0.071           8           0          9 MPI_Comm_size()
  0.0        0.043        0.043           4           0         11 MPI_Get_processor_name()
  0.0        0.032        0.032           4           0          8 MPI Collective Sync

FUNCTION SUMMARY (mean):
---------------------------------------------------------------------------------------
%Time    Exclusive    Inclusive       #Call      #Subrs  Inclusive Name
              msec   total msec                          usec/call
---------------------------------------------------------------------------------------
100.0           10        5,367           1           1    5367256 .TAU application
 49.9            7        2,680         0.5           2    5361177 int taupreload_main(int, char **, char **)
 49.9        2,667        2,675         0.5       50004    5351310 void zerosum::ZeroSum::threadedFunction()
 49.8        2,506        2,671         0.5         2.5    5342058 main
 12.5      0.00337          670       0.125       0.125    5365404 [PTHREAD] addr=<7fdb6b7ebda0>
 12.5      0.00287          668       0.125       0.125    5349131 [PTHREAD] addr=<7f57e65ebda0>
 12.4      0.00313          668       0.125       0.125    5345636 [PTHREAD] addr=<7f72797ebda0>
 12.4      0.00313          668       0.125       0.125    5345169 [PTHREAD] addr=<7fadb5febda0>
  3.0          158          158         0.5           0     317145 MPI_Init()
  0.1        0.026            6         0.5           4      12266 func
  0.1            6            6         0.5           0      12016 MPI_Barrier()
  0.1            4            4     50000.5           0          0 bool zerosum::ZeroSum::doOnce() [THROTTLED]
  0.1            4            4           3           0       1361 void zerosum::ZeroSum::doPeriodic()
  0.0            2            2         0.5           0       4152 pthread_join
  0.0        0.208        0.208         0.5           0        415 MPI_Finalize()
  0.0        0.151        0.151         0.5           0        301 void zerosum::ZeroSum::getProcStatus()
  0.0       0.0394        0.061         0.5         1.5        122 void zerosum::ZeroSum::getMPIinfo()
  0.0       0.0537       0.0537         1.5           0         36 MPI_Recv()
  0.0       0.0285       0.0325         0.5         0.5         65 MPI_Bcast()
  0.0       0.0231       0.0231         0.5           0         46 pthread_create
  0.0       0.0126       0.0126           1           0         13 MPI_Comm_rank()
  0.0       0.0126       0.0126         1.5           0          8 MPI_Send()
  0.0      0.00888      0.00888           1           0          9 MPI_Comm_size()
  0.0      0.00538      0.00538         0.5           0         11 MPI_Get_processor_name()
  0.0        0.004        0.004         0.5           0          8 MPI Collective Sync
