Hadoop Logs

2014-10-20 14:48:40,949 INFO org.apache.hadoop.hdfs.server.namenode.
NameNode:
STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG: host = tri03ws-386/127.0.0.1
STARTUP_MSG: args = []
STARTUP_MSG: version = 2.5.0
************************************************************/
2014-10-20 14:48:40,961 INFO org.apache.hadoop.hdfs.server.namenode.NameNode:
registered UNIX signal handlers for [TERM, HUP, INT]
createNameNode []
2014-10-20 14:48:41,230 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: loaded
properties from hadoop-metrics2.properties
2014-10-20 14:48:41,363 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl:
Scheduled snapshot period at 10 second(s).
2014-10-20 14:48:41,363 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl:
NameNode metrics system started
fs.defaultFS is hdfs://localhost:9500/
Clients are to use localhost:9500 to access this namenode/service.
2014-10-20 14:48:46,686 INFO org.apache.hadoop.hdfs.DFSUtil: Starting web server
as: ${dfs.web.authentication.kerberos.principal}
2014-10-20 14:48:46,686 INFO org.apache.hadoop.hdfs.DFSUtil: Starting Web-server
for hdfs at: http://0.0.0.0:50070
2014-10-20 14:48:46,756 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2014-10-20 14:48:46,759 INFO org.apache.hadoop.http.HttpRequestLog: Http request
log for http.requests.namenode is not defined
2014-10-20 14:48:46,767 INFO org.apache.hadoop.http.HttpServer2: Added global
filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2014-10-20 14:48:46,769 INFO org.apache.hadoop.http.HttpServer2: Added filter
static_user_filter
(class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context
hdfs
static_user_filter
static
static_user_filter
logs
'org.apache.hadoop.hdfs.web.AuthFilter'
(class=org.apache.hadoop.hdfs.web.AuthFilter)
2014-10-20 14:48:46,797 INFO org.apache.hadoop.http.HttpServer2:
addJerseyResourcePackage:
packageName=org.apache.hadoop.hdfs.server.namenode.web.resources;org.apache.hadoop.
hdfs.web.resources, pathSpec=/webhdfs/v1/*
2014-10-20 14:48:46,812 INFO org.apache.hadoop.http.HttpServer2: Jetty bound to
port 50070
2014-10-20 14:48:46,812 INFO org.mortbay.log: jetty-6.1.26
2014-10-20 14:48:47,016 WARN
org.apache.hadoop.security.authentication.server.AuthenticationFilter:
'signature.secret' configuration not set, using a random value as secret
2014-10-20 14:48:47,062 INFO org.mortbay.log: Started
HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:50070
2014-10-20 14:48:52,097 WARN org.apache.hadoop.hdfs.server.common.Util: Path
/home/user/Downloads/bigdata/NN should be specified as a URI in configuration
files. Please update hdfs configuration.
2014-10-20 14:48:52,097 WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem:
Only one image storage directory (dfs.namenode.name.dir) configured. Beware of data
loss due to lack of redundant storage directories!
2014-10-20 14:48:52,097 WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem:
Only one namespace edits storage directory (dfs.namenode.edits.dir) configured.
Beware of data loss due to lack of redundant storage directories!
2014-10-20 14:48:52,105 WARN org.apache.hadoop.hdfs.server.common.Storage: set
restore failed storage to true
2014-10-20 14:48:52,123 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem:
fsLock is fair:true
2014-10-20 14:48:52,151 INFO
org.apache.hadoop.hdfs.server.blockmanagement.DatanodeManager:
dfs.block.invalidate.limit=1000
2014-10-20 14:48:52,151 INFO
org.apache.hadoop.hdfs.server.blockmanagement.DatanodeManager:
dfs.namenode.datanode.registration.ip-hostname-check=true
2014-10-20 14:48:52,153 INFO
org.apache.hadoop.hdfs.server.blockmanagement.BlockManager:
dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000
2014-10-20 14:48:52,154 INFO
org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: The block deletion will
start around 2014 Oct 20 14:48:52
2014-10-20 14:48:52,156 INFO org.apache.hadoop.util.GSet: Computing capacity for
map BlocksMap
2014-10-20 14:48:52,156 INFO org.apache.hadoop.util.GSet: VM type = 64-bit
2014-10-20 14:48:52,157 INFO org.apache.hadoop.util.GSet: 2.0% max memory 889 MB =
17.8 MB
2014-10-20 14:48:52,157 INFO org.apache.hadoop.util.GSet: capacity = 2^21 =
2097152 entries
2014-10-20 14:48:52,170 INFO
dfs.block.access.token.enable=false
2014-10-20 14:48:52,170 INFO
org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: defaultReplication
= 1
2014-10-20 14:48:52,170 INFO
org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: maxReplication
= 512
2014-10-20 14:48:52,170 INFO
org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: minReplication
= 1
2014-10-20 14:48:52,170 INFO
org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: maxReplicationStreams
= 2
2014-10-20 14:48:52,170 INFO
shouldCheckForEnoughRacks = false
2014-10-20 14:48:52,170 INFO
replicationRecheckInterval = 3000
2014-10-20 14:48:52,170 INFO
org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: encryptDataTransfer
= false
2014-10-20 14:48:52,170 INFO
org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: maxNumBlocksToLog
= 1000
fsOwner = user (auth:SIMPLE)
supergroup = supergroup
isPermissionEnabled = true
HA Enabled: false
Append Enabled: true
map INodeMap
8.9 MB
1048576 entries
Caching file names occuring more than 10 times
map cachedBlocks
2.2 MB
262144 entries
dfs.namenode.safemode.threshold-pct = 0.9990000128746033
dfs.namenode.safemode.min.datanodes = 0
dfs.namenode.safemode.extension = 30000
Retry cache on namenode is enabled
Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000
millis
map NameNodeRetryCache
2014-10-20 14:48:52,219 INFO org.apache.hadoop.util.GSet: 0.029999999329447746% max
memory 889 MB = 273.1 KB
32768 entries
2014-10-20 14:48:52,222 INFO org.apache.hadoop.hdfs.server.namenode.NNConf: ACLs
enabled? false
2014-10-20 14:48:52,222 INFO org.apache.hadoop.hdfs.server.namenode.NNConf: XAttrs
enabled? true
2014-10-20 14:48:52,222 INFO org.apache.hadoop.hdfs.server.namenode.NNConf: Maximum
size of an xattr: 16384
2014-10-20 14:48:52,257 INFO org.apache.hadoop.hdfs.server.common.Storage: Lock
on /home/user/Downloads/bigdata/NN/in_use.lock acquired by nodename 5545@tri03ws-
386
2014-10-20 14:48:52,332 INFO
org.apache.hadoop.hdfs.server.namenode.FileJournalManager: Recovering unfinalized
segments in /home/user/Downloads/bigdata/NN/current
2014-10-20 14:48:52,332 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: No
edit log streams selected.
2014-10-20 14:48:52,419 INFO
org.apache.hadoop.hdfs.server.namenode.FSImageFormatPBINode: Loading 1 INodes.
2014-10-20 14:48:52,468 INFO
org.apache.hadoop.hdfs.server.namenode.FSImageFormatProtobuf: Loaded FSImage in 0
seconds.
2014-10-20 14:48:52,469 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Loaded
image for txid 0 from
/home/user/Downloads/bigdata/NN/current/fsimage_0000000000000000000
Need to save fs image? false (staleImage=false, haEnabled=false,
isRollingUpgrade=false)
2014-10-20 14:48:52,473 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog:
Starting log segment at 1
2014-10-20 14:48:52,608 INFO org.apache.hadoop.hdfs.server.namenode.NameCache:
initialized with 0 entries 0 lookups
Finished loading FSImage in 386 msecs
2014-10-20 14:48:52,812 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: RPC
server is binding to localhost:9500
2014-10-20 14:48:52,818 INFO org.apache.hadoop.ipc.CallQueueManager: Using
callQueue class java.util.concurrent.LinkedBlockingQueue
2014-10-20 14:48:52,826 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader
#1 for port 9500
Registered FSNamesystemState MBean
Number of blocks under construction: 0
Number of blocks under construction: 0
initializing replication queues
2014-10-20 14:48:53,048 INFO org.apache.hadoop.hdfs.StateChange: STATE* Leaving
safe mode after 0 secs
2014-10-20 14:48:53,048 INFO org.apache.hadoop.hdfs.StateChange: STATE* Network
topology has 0 racks and 0 datanodes
2014-10-20 14:48:53,048 INFO org.apache.hadoop.hdfs.StateChange: STATE*
UnderReplicatedBlocks has 0 blocks
2014-10-20 14:48:53,058 INFO
org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: Total number of blocks
= 0
2014-10-20 14:48:53,059 INFO
org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: Number of invalid
blocks = 0
2014-10-20 14:48:53,059 INFO
org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: Number of under-
replicated blocks = 0
2014-10-20 14:48:53,059 INFO
org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: Number of over-
replicated blocks = 0
2014-10-20 14:48:53,059 INFO
org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: Number of blocks being
written = 0
2014-10-20 14:48:53,059 INFO org.apache.hadoop.hdfs.StateChange: STATE* Replication
Queue initialization scan for invalid, over- and under-replicated blocks completed
in 11 msec
2014-10-20 14:48:53,085 INFO org.apache.hadoop.ipc.Server: IPC Server Responder:
starting
2014-10-20 14:48:53,085 INFO org.apache.hadoop.ipc.Server: IPC Server listener on
9500: starting
NameNode RPC up at: localhost/127.0.0.1:9500
Starting services required for active state
2014-10-20 14:48:53,090 INFO
org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Starting
CacheReplicationMonitor with interval 30000 milliseconds
2014-10-20 14:48:53,090 INFO
org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning
because of pending operations
2014-10-20 14:48:53,090 INFO
org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0
directive(s) and 0 block(s) in 0 millisecond(s).
2014-10-20 14:48:56,951 INFO org.apache.hadoop.hdfs.StateChange: BLOCK*
registerDatanode: from DatanodeRegistration(127.0.0.1, datanodeUuid=cb05f89a-8c8a-
4929-a6e6-43fcaa8dffcd, infoPort=50075, ipcPort=50020, storageInfo=lv=-55;cid=CID-
75778905-7788-4e42-ba65-62c3e0d1ab6d;nsid=1157657138;c=0) storage cb05f89a-8c8a-
4929-a6e6-43fcaa8dffcd
2014-10-20 14:48:56,954 INFO org.apache.hadoop.net.NetworkTopology: Adding a new
node: /default-rack/127.0.0.1:50010
2014-10-20 14:48:57,007 INFO
org.apache.hadoop.hdfs.server.blockmanagement.DatanodeDescriptor: Adding new
storage ID DS-e31c3319-9497-48ba-9c87-6f306e496660 for DN 127.0.0.1:50010
2014-10-20 14:48:57,035 INFO
org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: BLOCK* processReport:
Received first block report from DatanodeStorage[DS-e31c3319-9497-48ba-9c87-
6f306e496660,DISK,NORMAL] after starting up or becoming active. Its block contents
are no longer considered stale
2014-10-20 14:48:57,035 INFO BlockStateChange: BLOCK* processReport: from storage
DS-e31c3319-9497-48ba-9c87-6f306e496660 node DatanodeRegistration(127.0.0.1,
datanodeUuid=cb05f89a-8c8a-4929-a6e6-43fcaa8dffcd, infoPort=50075, ipcPort=50020,
storageInfo=lv=-55;cid=CID-75778905-7788-4e42-ba65-
62c3e0d1ab6d;nsid=1157657138;c=0), blocks: 0, hasStaleStorages: false, processing
time: 1 msecs
2014-10-20 14:49:23,090 INFO
after 30000 milliseconds
2014-10-20 14:49:23,091 INFO
2014-10-20 14:49:53,090 INFO
2014-10-20 14:49:53,090 INFO
Roll Edit Log from 127.0.0.1
Rolling edit logs
Ending log segment 1
Number of transactions: 2 Total time for transactions(ms): 0 Number of transactions
batched in Syncs: 0 Number of syncs: 2 SyncTimes(ms): 58
Number of transactions: 2 Total time for transactions(ms): 0 Number of transactions
batched in Syncs: 0 Number of syncs: 3 SyncTimes(ms): 72
2014-10-20 14:50:06,936 INFO
org.apache.hadoop.hdfs.server.namenode.FileJournalManager: Finalizing edits file
/home/user/Downloads/bigdata/NN/current/edits_inprogress_0000000000000000001 ->
/home/user/Downloads/bigdata/NN/current/edits_0000000000000000001-
0000000000000000002
Starting log segment at 3
2014-10-20 14:50:07,781 WARN
org.apache.hadoop.security.ssl.FileBasedKeyStoresFactory: The property
'ssl.client.truststore.location' has not been set, no TrustStore will be loaded
2014-10-20 14:50:08,331 INFO
org.apache.hadoop.hdfs.server.namenode.TransferFsImage: Transfer took 0.03s at 0.00
KB/s
2014-10-20 14:50:08,331 INFO
org.apache.hadoop.hdfs.server.namenode.TransferFsImage: Downloaded file
fsimage.ckpt_0000000000000000002 size 351 bytes.
2014-10-20 14:50:08,367 INFO
org.apache.hadoop.hdfs.server.namenode.NNStorageRetentionManager: Going to retain 2
images with txid >= 0
2014-10-20 14:50:23,090 INFO
2014-10-20 14:50:23,090 INFO
2014-10-20 14:50:53,090 INFO
2014-10-20 14:50:53,091 INFO
2014-10-20 14:51:23,090 INFO
2014-10-20 14:51:23,090 INFO
2014-10-20 14:51:53,090 INFO
2014-10-20 14:51:53,090 INFO
2014-10-20 14:52:23,090 INFO
2014-10-20 14:52:23,091 INFO
2014-10-20 14:52:53,090 INFO
2014-10-20 14:52:53,111 INFO
2014-10-20 14:53:23,090 INFO
2014-10-20 14:53:23,090 INFO
2014-10-20 14:53:53,090 INFO
2014-10-20 14:53:53,091 INFO
2014-10-20 14:54:23,091 INFO
2014-10-20 14:54:23,184 INFO
2014-10-20 14:54:53,091 INFO
2014-10-20 14:54:53,142 INFO
STARTUP_MSG:

Hadoop Logs

Hochgeladen von

Dokumentinformationen

Originaltitel

Copyright

Verfügbare Formate

Dieses Dokument teilen

Dokument teilen oder einbetten

Freigabeoptionen

Stufen Sie dieses Dokument als nützlich ein?

Sind diese Inhalte unangemessen?

Copyright:

Verfügbare Formate

Hadoop Logs

Hochgeladen von

Copyright:

Verfügbare Formate

2014-10-20 14:48:40,949 INFO org.apache.hadoop.hdfs.server.namenode.

Das könnte Ihnen auch gefallen