j-1MM0DOB1TUSN2 Cluster Report at Thu, 30 Jun 2016 02:01:36 +0000

Last  hour2hr4hrdayweekmonthyear

or from to

  Physical View

EMR Grid > j-1MM0DOB1TUSN2 > --Choose a Nodeip-172-28-17-185.ap-southeast-2.compute.internal ip-172-28-22-41.ap-southeast-2.compute.internal ip-172-28-49-76.ap-southeast-2.compute.internal ip-172-28-203-39.ap-southeast-2.compute.internal ip-172-28-207-11.ap-southeast-2.compute.internal   

---

Overview of j-1MM0DOB1TUSN2 @ 2016-06-30 02:01

CPUs Total: 20 Hosts up: 5 Hosts down: 0   Current Load Avg (15, 5, 1m):   5%, 4%, 1% Avg Utilization (last hour):   7%	Edit Optional Graphs
Server Load Distribution

Stacked Graph - load_one

j-1MM0DOB1TUSN2 load_one last hour sorted by name

Metric  apache_reportapache_response_reportboottimebytes_inbytes_outcpu_aidlecpu_idlecpu_nicecpu_numcpu_reportcpu_speedcpu_stealcpu_systemcpu_usercpu_wiodefault.StartupProgress.ElapsedTimedefault.StartupProgress.LoadingEditsCountdefault.StartupProgress.LoadingEditsElapsedTimedefault.StartupProgress.LoadingEditsPercentCompletedefault.StartupProgress.LoadingEditsTotaldefault.StartupProgress.LoadingFsImageCountdefault.StartupProgress.LoadingFsImageElapsedTimedefault.StartupProgress.LoadingFsImagePercentCompletedefault.StartupProgress.LoadingFsImageTotaldefault.StartupProgress.PercentCompletedefault.StartupProgress.SafeModeCountdefault.StartupProgress.SafeModeElapsedTimedefault.StartupProgress.SafeModePercentCompletedefault.StartupProgress.SafeModeTotaldefault.StartupProgress.SavingCheckpointCountdefault.StartupProgress.SavingCheckpointElapsedTimedefault.StartupProgress.SavingCheckpointPercentCompletedefault.StartupProgress.SavingCheckpointTotaldfs.FSNamesystem.BlockCapacitydfs.FSNamesystem.BlocksTotaldfs.FSNamesystem.CapacityRemainingdfs.FSNamesystem.CapacityRemainingGBdfs.FSNamesystem.CapacityTotaldfs.FSNamesystem.CapacityTotalGBdfs.FSNamesystem.CapacityUseddfs.FSNamesystem.CapacityUsedGBdfs.FSNamesystem.CapacityUsedNonDFSdfs.FSNamesystem.CorruptBlocksdfs.FSNamesystem.ExcessBlocksdfs.FSNamesystem.ExpiredHeartbeatsdfs.FSNamesystem.FilesTotaldfs.FSNamesystem.LastCheckpointTimedfs.FSNamesystem.LastWrittenTransactionIddfs.FSNamesystem.MillisSinceLastLoadedEditsdfs.FSNamesystem.MissingBlocksdfs.FSNamesystem.MissingReplOneBlocksdfs.FSNamesystem.PendingDataNodeMessageCountdfs.FSNamesystem.PendingDeletionBlocksdfs.FSNamesystem.PendingReplicationBlocksdfs.FSNamesystem.PostponedMisreplicatedBlocksdfs.FSNamesystem.ScheduledReplicationBlocksdfs.FSNamesystem.Snapshotsdfs.FSNamesystem.SnapshottableDirectoriesdfs.FSNamesystem.StaleDataNodesdfs.FSNamesystem.TotalFilesdfs.FSNamesystem.TotalLoaddfs.FSNamesystem.TransactionsSinceLastCheckpointdfs.FSNamesystem.TransactionsSinceLastLogRolldfs.FSNamesystem.UnderReplicatedBlocksdfs.FSNamesystem.numDeadDataNodesdfs.FSNamesystem.numLiveDataNodesdfs.datanode.BlockChecksumOpAvgTimedfs.datanode.BlockChecksumOpNumOpsdfs.datanode.BlockReportsAvgTimedfs.datanode.BlockReportsNumOpsdfs.datanode.BlockVerificationFailuresdfs.datanode.BlocksCacheddfs.datanode.BlocksGetLocalPathInfodfs.datanode.BlocksReaddfs.datanode.BlocksRemoveddfs.datanode.BlocksReplicateddfs.datanode.BlocksUncacheddfs.datanode.BlocksVerifieddfs.datanode.BlocksWrittendfs.datanode.BytesReaddfs.datanode.BytesWrittendfs.datanode.CacheReportsAvgTimedfs.datanode.CacheReportsNumOpsdfs.datanode.CopyBlockOpAvgTimedfs.datanode.CopyBlockOpNumOpsdfs.datanode.DatanodeNetworkErrorsdfs.datanode.FlushNanosAvgTimedfs.datanode.FlushNanosNumOpsdfs.datanode.FsyncCountdfs.datanode.FsyncNanosAvgTimedfs.datanode.FsyncNanosNumOpsdfs.datanode.HeartbeatsAvgTimedfs.datanode.HeartbeatsNumOpsdfs.datanode.IncrementalBlockReportsAvgTimedfs.datanode.IncrementalBlockReportsNumOpsdfs.datanode.PacketAckRoundTripTimeNanosAvgTimedfs.datanode.PacketAckRoundTripTimeNanosNumOpsdfs.datanode.RamDiskBlocksDeletedBeforeLazyPersisteddfs.datanode.RamDiskBlocksEvicteddfs.datanode.RamDiskBlocksEvictedWithoutReaddfs.datanode.RamDiskBlocksEvictionWindowMsAvgTimedfs.datanode.RamDiskBlocksEvictionWindowMsNumOpsdfs.datanode.RamDiskBlocksLazyPersistWindowMsAvgTimedfs.datanode.RamDiskBlocksLazyPersistWindowMsNumOpsdfs.datanode.RamDiskBlocksLazyPersisteddfs.datanode.RamDiskBlocksReadHitsdfs.datanode.RamDiskBlocksWritedfs.datanode.RamDiskBlocksWriteFallbackdfs.datanode.RamDiskBytesLazyPersisteddfs.datanode.RamDiskBytesWritedfs.datanode.ReadBlockOpAvgTimedfs.datanode.ReadBlockOpNumOpsdfs.datanode.ReadsFromLocalClientdfs.datanode.ReadsFromRemoteClientdfs.datanode.RemoteBytesReaddfs.datanode.RemoteBytesWrittendfs.datanode.ReplaceBlockOpAvgTimedfs.datanode.ReplaceBlockOpNumOpsdfs.datanode.SendDataPacketBlockedOnNetworkNanosAvgTimedfs.datanode.SendDataPacketBlockedOnNetworkNanosNumOpsdfs.datanode.SendDataPacketTransferNanosAvgTimedfs.datanode.SendDataPacketTransferNanosNumOpsdfs.datanode.TotalReadTimedfs.datanode.TotalWriteTimedfs.datanode.VolumeFailuresdfs.datanode.WriteBlockOpAvgTimedfs.datanode.WriteBlockOpNumOpsdfs.datanode.WritesFromLocalClientdfs.datanode.WritesFromRemoteClientdfs.namenode.AddBlockOpsdfs.namenode.AllowSnapshotOpsdfs.namenode.BlockReceivedAndDeletedOpsdfs.namenode.BlockReportAvgTimedfs.namenode.BlockReportNumOpsdfs.namenode.CacheReportAvgTimedfs.namenode.CacheReportNumOpsdfs.namenode.CreateFileOpsdfs.namenode.CreateSnapshotOpsdfs.namenode.CreateSymlinkOpsdfs.namenode.DeleteFileOpsdfs.namenode.DeleteSnapshotOpsdfs.namenode.DisallowSnapshotOpsdfs.namenode.FileInfoOpsdfs.namenode.FilesAppendeddfs.namenode.FilesCreateddfs.namenode.FilesDeleteddfs.namenode.FilesInGetListingOpsdfs.namenode.FilesRenameddfs.namenode.FilesTruncateddfs.namenode.FsImageLoadTimedfs.namenode.GetAdditionalDatanodeOpsdfs.namenode.GetBlockLocationsdfs.namenode.GetEditAvgTimedfs.namenode.GetEditNumOpsdfs.namenode.GetImageAvgTimedfs.namenode.GetImageNumOpsdfs.namenode.GetLinkTargetOpsdfs.namenode.GetListingOpsdfs.namenode.ListSnapshottableDirOpsdfs.namenode.PutImageAvgTimedfs.namenode.PutImageNumOpsdfs.namenode.RenameSnapshotOpsdfs.namenode.SafeModeTimedfs.namenode.SnapshotDiffReportOpsdfs.namenode.StorageBlockReportOpsdfs.namenode.SyncsAvgTimedfs.namenode.SyncsNumOpsdfs.namenode.TotalFileOpsdfs.namenode.TransactionsAvgTimedfs.namenode.TransactionsBatchedInSyncdfs.namenode.TransactionsNumOpsdisk_freedisk_totalgexecgmond_startedip_addressjvm.JvmMetrics.GcCountjvm.JvmMetrics.GcCountPS MarkSweepjvm.JvmMetrics.GcCountPS Scavengejvm.JvmMetrics.GcNumInfoThresholdExceededjvm.JvmMetrics.GcNumWarnThresholdExceededjvm.JvmMetrics.GcTimeMillisjvm.JvmMetrics.GcTimeMillisPS MarkSweepjvm.JvmMetrics.GcTimeMillisPS Scavengejvm.JvmMetrics.GcTotalExtraSleepTimejvm.JvmMetrics.LogErrorjvm.JvmMetrics.LogFataljvm.JvmMetrics.LogInfojvm.JvmMetrics.LogWarnjvm.JvmMetrics.MemHeapCommittedMjvm.JvmMetrics.MemHeapMaxMjvm.JvmMetrics.MemHeapUsedMjvm.JvmMetrics.MemMaxMjvm.JvmMetrics.MemNonHeapCommittedMjvm.JvmMetrics.MemNonHeapMaxMjvm.JvmMetrics.MemNonHeapUsedMjvm.JvmMetrics.ThreadsBlockedjvm.JvmMetrics.ThreadsNewjvm.JvmMetrics.ThreadsRunnablejvm.JvmMetrics.ThreadsTerminatedjvm.JvmMetrics.ThreadsTimedWaitingjvm.JvmMetrics.ThreadsWaitinglast_reportedlast_reported_timestamplast_reported_uptime_in_secload_all_reportload_fifteenload_fiveload_oneload_reportlocationmachine_typemapred.ShuffleMetrics.ShuffleConnectionsmapred.ShuffleMetrics.ShuffleOutputBytesmapred.ShuffleMetrics.ShuffleOutputsFailedmapred.ShuffleMetrics.ShuffleOutputsOKmem_buffersmem_cachedmem_freemem_reportmem_sharedmem_totalmetricssystem.MetricsSystem.DroppedPubAllmetricssystem.MetricsSystem.NumActiveSinksmetricssystem.MetricsSystem.NumActiveSourcesmetricssystem.MetricsSystem.NumAllSinksmetricssystem.MetricsSystem.NumAllSourcesmetricssystem.MetricsSystem.PublishAvgTimemetricssystem.MetricsSystem.PublishNumOpsmetricssystem.MetricsSystem.Sink_cloudwatchAvgTimemetricssystem.MetricsSystem.Sink_cloudwatchDroppedmetricssystem.MetricsSystem.Sink_cloudwatchNumOpsmetricssystem.MetricsSystem.Sink_cloudwatchQsizemetricssystem.MetricsSystem.Sink_gangliaAvgTimemetricssystem.MetricsSystem.Sink_gangliaDroppedmetricssystem.MetricsSystem.Sink_gangliaNumOpsmetricssystem.MetricsSystem.Sink_gangliaQsizemetricssystem.MetricsSystem.SnapshotAvgTimemetricssystem.MetricsSystem.SnapshotNumOpsnetwork_reportnfs_v3_client_reportos_nameos_releasepacket_reportpart_max_usedpkts_inpkts_outproc_runproc_totalrpc.RetryCache.NameNodeRetryCache.CacheClearedrpc.RetryCache.NameNodeRetryCache.CacheHitrpc.RetryCache.NameNodeRetryCache.CacheUpdatedrpc.rpc.CallQueueLengthrpc.rpc.NumOpenConnectionsrpc.rpc.ReceivedBytesrpc.rpc.RpcAuthenticationFailuresrpc.rpc.RpcAuthenticationSuccessesrpc.rpc.RpcAuthorizationFailuresrpc.rpc.RpcAuthorizationSuccessesrpc.rpc.RpcProcessingTimeAvgTimerpc.rpc.RpcProcessingTimeNumOpsrpc.rpc.RpcQueueTimeAvgTimerpc.rpc.RpcQueueTimeNumOpsrpc.rpc.SentBytesrpcdetailed.rpcdetailed.AddBlockAvgTimerpcdetailed.rpcdetailed.AddBlockNumOpsrpcdetailed.rpcdetailed.AllocateAvgTimerpcdetailed.rpcdetailed.AllocateNumOpsrpcdetailed.rpcdetailed.BlockReceivedAndDeletedAvgTimerpcdetailed.rpcdetailed.BlockReceivedAndDeletedNumOpsrpcdetailed.rpcdetailed.BlockReportAvgTimerpcdetailed.rpcdetailed.BlockReportNumOpsrpcdetailed.rpcdetailed.CompleteAvgTimerpcdetailed.rpcdetailed.CompleteNumOpsrpcdetailed.rpcdetailed.CreateAvgTimerpcdetailed.rpcdetailed.CreateNumOpsrpcdetailed.rpcdetailed.DeleteAvgTimerpcdetailed.rpcdetailed.DeleteNumOpsrpcdetailed.rpcdetailed.FinishApplicationMasterAvgTimerpcdetailed.rpcdetailed.FinishApplicationMasterNumOpsrpcdetailed.rpcdetailed.FsyncAvgTimerpcdetailed.rpcdetailed.FsyncNumOpsrpcdetailed.rpcdetailed.GetApplicationReportAvgTimerpcdetailed.rpcdetailed.GetApplicationReportNumOpsrpcdetailed.rpcdetailed.GetApplicationsAvgTimerpcdetailed.rpcdetailed.GetApplicationsNumOpsrpcdetailed.rpcdetailed.GetBlockLocationsAvgTimerpcdetailed.rpcdetailed.GetBlockLocationsNumOpsrpcdetailed.rpcdetailed.GetClusterMetricsAvgTimerpcdetailed.rpcdetailed.GetClusterMetricsNumOpsrpcdetailed.rpcdetailed.GetDatanodeReportAvgTimerpcdetailed.rpcdetailed.GetDatanodeReportNumOpsrpcdetailed.rpcdetailed.GetFileInfoAvgTimerpcdetailed.rpcdetailed.GetFileInfoNumOpsrpcdetailed.rpcdetailed.GetFsStatsAvgTimerpcdetailed.rpcdetailed.GetFsStatsNumOpsrpcdetailed.rpcdetailed.GetListingAvgTimerpcdetailed.rpcdetailed.GetListingNumOpsrpcdetailed.rpcdetailed.GetNewApplicationAvgTimerpcdetailed.rpcdetailed.GetNewApplicationNumOpsrpcdetailed.rpcdetailed.GetReplicaVisibleLengthAvgTimerpcdetailed.rpcdetailed.GetReplicaVisibleLengthNumOpsrpcdetailed.rpcdetailed.GetServerDefaultsAvgTimerpcdetailed.rpcdetailed.GetServerDefaultsNumOpsrpcdetailed.rpcdetailed.HeartbeatAvgTimerpcdetailed.rpcdetailed.HeartbeatNumOpsrpcdetailed.rpcdetailed.MkdirsAvgTimerpcdetailed.rpcdetailed.MkdirsNumOpsrpcdetailed.rpcdetailed.NodeHeartbeatAvgTimerpcdetailed.rpcdetailed.NodeHeartbeatNumOpsrpcdetailed.rpcdetailed.RefreshQueuesAvgTimerpcdetailed.rpcdetailed.RefreshQueuesNumOpsrpcdetailed.rpcdetailed.RegisterApplicationMasterAvgTimerpcdetailed.rpcdetailed.RegisterApplicationMasterNumOpsrpcdetailed.rpcdetailed.RegisterDatanodeAvgTimerpcdetailed.rpcdetailed.RegisterDatanodeNumOpsrpcdetailed.rpcdetailed.RegisterNodeManagerAvgTimerpcdetailed.rpcdetailed.RegisterNodeManagerNumOpsrpcdetailed.rpcdetailed.RenameAvgTimerpcdetailed.rpcdetailed.RenameNumOpsrpcdetailed.rpcdetailed.RenewLeaseAvgTimerpcdetailed.rpcdetailed.RenewLeaseNumOpsrpcdetailed.rpcdetailed.SendHeartbeatAvgTimerpcdetailed.rpcdetailed.SendHeartbeatNumOpsrpcdetailed.rpcdetailed.SetOwnerAvgTimerpcdetailed.rpcdetailed.SetOwnerNumOpsrpcdetailed.rpcdetailed.SetPermissionAvgTimerpcdetailed.rpcdetailed.SetPermissionNumOpsrpcdetailed.rpcdetailed.SetReplicationAvgTimerpcdetailed.rpcdetailed.SetReplicationNumOpsrpcdetailed.rpcdetailed.SetSafeModeAvgTimerpcdetailed.rpcdetailed.SetSafeModeNumOpsrpcdetailed.rpcdetailed.StartContainersAvgTimerpcdetailed.rpcdetailed.StartContainersNumOpsrpcdetailed.rpcdetailed.StopContainersAvgTimerpcdetailed.rpcdetailed.StopContainersNumOpsrpcdetailed.rpcdetailed.SubmitApplicationAvgTimerpcdetailed.rpcdetailed.SubmitApplicationNumOpsrpcdetailed.rpcdetailed.VersionRequestAvgTimerpcdetailed.rpcdetailed.VersionRequestNumOpssample_reportswap_freeswap_totalugi.UgiMetrics.GetGroupsAvgTimeugi.UgiMetrics.GetGroupsNumOpsugi.UgiMetrics.LoginFailureAvgTimeugi.UgiMetrics.LoginFailureNumOpsugi.UgiMetrics.LoginSuccessAvgTimeugi.UgiMetrics.LoginSuccessNumOpsvarnish_reportyarn.ClusterMetrics.AMLaunchDelayAvgTimeyarn.ClusterMetrics.AMLaunchDelayNumOpsyarn.ClusterMetrics.AMRegisterDelayAvgTimeyarn.ClusterMetrics.AMRegisterDelayNumOpsyarn.ClusterMetrics.NumActiveNMsyarn.ClusterMetrics.NumDecommissionedNMsyarn.ClusterMetrics.NumDecommissioningNMsyarn.ClusterMetrics.NumLostNMsyarn.ClusterMetrics.NumRebootedNMsyarn.ClusterMetrics.NumUnhealthyNMsyarn.NodeManagerMetrics.AllocatedContainersyarn.NodeManagerMetrics.AllocatedGByarn.NodeManagerMetrics.AllocatedVCoresyarn.NodeManagerMetrics.AvailableGByarn.NodeManagerMetrics.AvailableVCoresyarn.NodeManagerMetrics.ContainerLaunchDurationAvgTimeyarn.NodeManagerMetrics.ContainerLaunchDurationNumOpsyarn.NodeManagerMetrics.ContainersCompletedyarn.NodeManagerMetrics.ContainersFailedyarn.NodeManagerMetrics.ContainersInitingyarn.NodeManagerMetrics.ContainersKilledyarn.NodeManagerMetrics.ContainersLaunchedyarn.NodeManagerMetrics.ContainersRunningyarn.QueueMetrics.ActiveApplicationsyarn.QueueMetrics.ActiveUsersyarn.QueueMetrics.AggregateContainersAllocatedyarn.QueueMetrics.AggregateContainersReleasedyarn.QueueMetrics.AllocatedContainersyarn.QueueMetrics.AllocatedMByarn.QueueMetrics.AllocatedVCoresyarn.QueueMetrics.AppsCompletedyarn.QueueMetrics.AppsFailedyarn.QueueMetrics.AppsKilledyarn.QueueMetrics.AppsPendingyarn.QueueMetrics.AppsRunningyarn.QueueMetrics.AppsSubmittedyarn.QueueMetrics.AvailableMByarn.QueueMetrics.AvailableVCoresyarn.QueueMetrics.PendingContainersyarn.QueueMetrics.PendingMByarn.QueueMetrics.PendingVCoresyarn.QueueMetrics.ReservedContainersyarn.QueueMetrics.ReservedMByarn.QueueMetrics.ReservedVCoresyarn.QueueMetrics.running_0yarn.QueueMetrics.running_1440yarn.QueueMetrics.running_300yarn.QueueMetrics.running_60

load_one

Show Hosts Scaled: Auto Same None

Size  small medium large xlarge xxlarge mobile

Columns   0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 (0 = metric + reports)

Show only nodes matching

Max graphs to show all10005002001005025201510

Sorted  ascendingdescendingby name

ip-172-28-17-185.ap-southeast-2.compute.internal	ip-172-28-22-41.ap-southeast-2.compute.internal	ip-172-28-49-76.ap-southeast-2.compute.internal	ip-172-28-203-39.ap-southeast-2.compute.internal
ip-172-28-207-11.ap-southeast-2.compute.internal

(Nodes colored by 1-minute load) | Legend

Search term matches any number of metrics and hosts. For example type web or disk; wait a split second, and a drop down menu will show up with choices.

Invoke automatic rotation system. Automatic rotation rotates all of the graphs/metrics specified in a view waiting 30 seconds in between each. This will run as long as you have this page open.

Please select the view you want to rotate.

Live dashboard provides you with an overview of all view metrics in a compact format. Data updates every 15 seconds. Only those elements that contain a metric or graph report are supported. Aggregate graphs will not be included.

You can get more graphs per page by using your browser zoom functionality.

Please select the view you want to view