&&相关文章推荐
* 以上用户言论只代表其个人观点,不代表CSDN网站的观点或立场
访问:12191次
积分:1107
积分:1107
排名:千里之外
原创:40篇
转载:207篇
译文:27篇
(window.slotbydup = window.slotbydup || []).push({
id: '4740887',
container: s,
size: '250,250',
display: 'inlay-fix'消息处理是由base::MessageLoop中实现,消息中的任务和定时器都是异步事件的。
主要如下几点:
1、消息的类型分类
2、延时处理的消息是如何实现
一、消息分类
&&&& chromium主要将消息类型如下定义:(/////&
enum Type {
TYPE_DEFAULT,
TYPE_CUSTOM,
6 #if defined(OS_ANDROID)
TYPE_J***A,
// defined(OS_ANDROID)
1.TYPE_DEFAULT:
&&&&& 处理chromium定义的Task(闭包代码块)和定时器任务
2.TYPE_UI:
&&&& 除了TYPE_DEFAULT定义的范围,还支持原生的UI事件消息(比如用户操作的窗口消息),MessageLoopForUI类
3.TYPE_IO:
&&&& 除了TYPE_DEFAULT定义的范围,还支持异步IO的事件消息,MessageLoopForIO类
4.TYPE_J***A
&&& 是Android平台的特有的消息消息,因为Android里,有java消息和native消息分层,native消息与java消息交互,java消息与应用程序交互,可以看做java消息接管了native消息。
5.TYPE_CUSTOM
&&& 定制消息,比较少见使用。
消息类型的不同也就会创建不同的MessagePump。对于UI消息,不同的平台也会有不同的实现。在/////&166行
二、延时消息如何处理
消息的处理与消息队列密不可分,internal::IncomingTaskQueue实现了一个线程安全的消息队列。 MessageLoop里定义了(/////&392行)
1 scoped_refptr&internal::IncomingTaskQueue& incoming_task_queue_;
接收到的消息就缓存在这个队列里。那么我们先看看这个类的构造函数。
1 IncomingTaskQueue::IncomingTaskQueue(MessageLoop* message_loop)
: always_schedule_work_(AlwaysNotifyPump(message_loop-&type())),
triage_tasks_(this),
delayed_tasks_(this),
deferred_tasks_(this),
message_loop_(message_loop) {
// The constructing sequence is not necessarily the running sequence in the
// case of base::Thread.
DETACH_FROM_SEQUENCE(sequence_checker_);
构造函数里通过MessageLoop的类型来初始化bool成员 always_schedule_work_ ,来判断是否对消息进行调度, 并保存了message_loop指针。
继续分析代码,前面看到消息队列已经初始化了,那接下来我们看看是怎么往队列里添加任务的。
bool IncomingTaskQueue::AddToIncomingQueue(const Location& from_here,
OnceClosure task,
TimeDelta delay,
Nestable nestable) {
PendingTask pending_task(from_here, std::move(task),
CalculateDelayedRuntime(delay), nestable);
return PostPendingTask(&pending_task);
使用了PendingTask对象,并计算了延迟的时间和是否是嵌套任务。那么看PostPendingTask函数:
1 bool IncomingTaskQueue::PostPendingTask(PendingTask* pending_task) {
bool accept_new_
bool schedule_work = false;
AutoLock auto_lock(incoming_queue_lock_);
accept_new_tasks = accept_new_tasks_;
if (accept_new_tasks)
schedule_work = PostPendingTaskLockRequired(pending_task);
if (!accept_new_tasks) {19
pending_task-&task.Reset();
return false;
if (schedule_work) {
// Ensures |message_loop_| isn't destroyed while running.
AutoLock auto_lock(message_loop_lock_);
if (message_loop_)
message_loop_-&ScheduleWork();
return true;
这里已经开始给线程加锁了,那么继续看PostPendingTaskLockRequired函数:
1 bool IncomingTaskQueue::PostPendingTaskLockRequired(PendingTask* pending_task) {
incoming_queue_lock_.AssertAcquired();
pending_task-&sequence_num = next_sequence_num_++;
task_annotator_.DidQueueTask(&MessageLoop::PostTask&, *pending_task);
bool was_empty = incoming_queue_.empty();
incoming_queue_.push(std::move(*pending_task));
if (is_ready_for_scheduling_ &&
(always_schedule_work_ || (!message_loop_scheduled_ && was_empty))) {
message_loop_scheduled_ = true;
return true;
return false;
这里看到pending_task是保存在incoming_queue_ 这里使用了std::queue容器(一个FIFO的数据结构),这个队列里面的任务还没有添加到MessageLoop中,也可以看到这里还没有明确任务的执行方式,使用的是FIFO队列。
下面的几个成员变量,则就是在MessageLoop中使用了。
/////&217行
1 // Queue for initial triaging of tasks on the |sequence_checker_| sequence.
TriageQueue triage_tasks_;
// Queue for delayed tasks on the |sequence_checker_| sequence.
DelayedQueue delayed_tasks_;
// Queue for non-nestable deferred tasks on the |sequence_checker_| sequence.
DeferredQueue deferred_tasks_;
1、TriageQueue
&&&& 这是第一个按默认的任务处理顺序(FIFO)接受所有任务的队列,这个队列的任务要马上执行或者放到下面的DelayedQueue&或者 DeferredQueue。
&&&& triage_tasks_队列的任务是通过&IncomingTaskQueue::ReloadWorkQueue(TaskQueue&work_queue)来实现切换的,可以将
incoming_queue_ 和 triage_tasks_看成冷热备份的缓存,在triage_tasks_队列的任务执行完了,即为空时,就将待执行的incoming_queue_队列的任务与之交换。
1 void IncomingTaskQueue::TriageQueue::ReloadFromIncomingQueueIfEmpty() {
if (queue_.empty()) {
// TODO(robliao): Since these high resolution tasks aren't yet in the
// delayed queue, they technically shouldn't trigger high resolution timers
// until they are.
outer_-&pending_high_res_tasks_ += outer_-&ReloadWorkQueue(&queue_);
2、DelayedQueue
&&&& 这个队列是存放延迟执行的任务,并且按期望时间排序的
&&&& delayed_tasks_是一个优先级队列,按delayed_run_time排序,////
1 // PendingTasks are sorted by their |delayed_run_time| property.
2 using DelayedTaskQueue = std::priority_queue&base::PendingTask&;
3、DeferredQueue
&&&& 这个队列通常是存放哪些因为MessageLoop嵌套而不能执行的任务,这些任务通常会在空闲的时候执行。
OK,看到这里,我们回顾一下MessageLoop的执行流程:
1 void MessageLoop::Run() {
DCHECK_EQ(this, current());
pump_-&Run(this);
由MessagePump来执行,那么我们选择默认的MessagePump来看Run的流程,/////&29行:
其中的流程是,delegate-&DoWork(), delegate-&DoDelayedWork(&delayed_work_time_),delegate-&DoIdleWork()。
也可以看其他平台的MessagePump,主要的流程是一致的,都是delegate的函数,而delegate指向一个MessageLoop指针,那么又回到MessageLoop中。
上面具体的DoWork就不详述了,接下来看看延迟任务是如何实现的:
TimeTicks next_run_time =
incoming_task_queue_-&delayed_tasks().Peek().delayed_run_
if (next_run_time & recent_time_) {
recent_time_ = TimeTicks::Now();
// Get a better view of Now();
if (next_run_time & recent_time_) {
*next_delayed_work_time = next_run_
return false;
PendingTask pending_task = incoming_task_queue_-&delayed_tasks().Pop();
if (incoming_task_queue_-&delayed_tasks().HasTasks()) {
*next_delayed_work_time =
incoming_task_queue_-&delayed_tasks().Peek().delayed_run_
return DeferOrRunPendingTask(std::move(pending_task));
在下一个可执行时间到来了,就会从incoming_task_queue_-&delayed_tasks().Pop() 出来一个task, 如果incoming_task_queue_-&delayed_tasks()里还有延迟任务,就取里面优先级最高的任务的延迟时间作为下次判断的时间。
到这里,消息的处理和延迟任务的执行都完成了。
好了,回到上面的Run()函数流程,在DoIdleWork()完成之后,当前线程开始休眠,直到有新的任务来会重新唤醒。
嗯,这篇就到这里了,下面一篇会总结IPC消息声明和IPC channel的创建。
&&相关文章推荐
* 以上用户言论只代表其个人观点,不代表CSDN网站的观点或立场
访问:12193次
积分:1107
积分:1107
排名:千里之外
原创:40篇
转载:207篇
译文:27篇
(window.slotbydup = window.slotbydup || []).push({
id: '4740887',
container: s,
size: '250,250',
display: 'inlay-fix'Deprecated Properties &弃用属性
The following table lists the configuration property names that are deprecated in this version of Hadoop, and their replacements.
下表列出了在这个版本的Hadoop中被弃用的配置属性名称及其替换。
说明: 基于&Hadoop 2.7.4
Deprecated property name
已经被遗弃属性的名称
New property name
新的属性名称
create.empty.dir.if.nonexist
mapreduce.jobcontrol.createdir.ifnotexist
dfs.access.time.precision
dfs.namenode.accesstime.precision
dfs.backup.address
dfs.namenode.backup.address
dfs.backup.http.address
dfs.namenode.backup.http-address
dfs.balance.bandwidthPerSec
dfs.datanode.balance.bandwidthPerSec
dfs.block.size
dfs.blocksize
dfs.data.dir
dfs.datanode.data.dir
dfs.datanode.max.xcievers
dfs.datanode.max.transfer.threads
dfs.df.interval
fs.df.interval
dfs.federation.nameservice.id
dfs.nameservice.id
dfs.federation.nameservices
dfs.nameservices
dfs.http.address
dfs.namenode.http-address
dfs.https.address
dfs.namenode.https-address
dfs.https.client.keystore.resource
dfs.client.https.keystore.resource
dfs.https.need.client.auth
dfs.client.https.need-auth
dfs.max.objects
dfs.namenode.max.objects
dfs.max-repl-streams
dfs.namenode.replication.max-streams
dfs.name.dir
dfs.namenode.name.dir
dfs.name.dir.restore
dfs.namenode.name.dir.restore
dfs.name.edits.dir
dfs.namenode.edits.dir
dfs.permissions
dfs.permissions.enabled
dfs.permissions.supergroup
dfs.permissions.superusergroup
dfs.read.prefetch.size
dfs.client.read.prefetch.size
dfs.replication.considerLoad
dfs.namenode.replication.considerLoad
dfs.replication.interval
dfs.namenode.replication.interval
dfs.replication.min
dfs.namenode.replication.min
dfs.replication.pending.timeout.sec
dfs.namenode.replication.pending.timeout-sec
dfs.safemode.extension
dfs.namenode.safemode.extension
dfs.safemode.threshold.pct
dfs.namenode.safemode.threshold-pct
dfs.secondary.http.address
dfs.namenode.secondary.http-address
dfs.socket.timeout
dfs.client.socket-timeout
dfs.umaskmode
fs.permissions.umask-mode
dfs.write.packet.size
dfs.client-write-packet-size
fs.checkpoint.dir
dfs.namenode.checkpoint.dir
fs.checkpoint.edits.dir
dfs.namenode.checkpoint.edits.dir
fs.checkpoint.period
dfs.namenode.checkpoint.period
fs.default.name
fs.defaultFS
hadoop.configured.node.mapping
net.topology.configured.node.mapping
hadoop.job.history.location
mapreduce.jobtracker.jobhistory.location
hadoop.native.lib
io.native.lib.available
hadoop.net.static.resolutions
mapreduce.tasktracker.net.static.resolutions
mand-file.keep
mandfile.preserve
hadoop.pipes.executable.interpretor
mapreduce.pipes.executable.interpretor
hadoop.pipes.executable
mapreduce.pipes.executable
hadoop.pipes.java.mapper
mapreduce.pipes.isjavamapper
hadoop.pipes.java.recordreader
mapreduce.pipes.isjavarecordreader
hadoop.pipes.java.recordwriter
mapreduce.pipes.isjavarecordwriter
hadoop.pipes.java.reducer
mapreduce.pipes.isjavareducer
hadoop.pipes.partitioner
mapreduce.pipes.partitioner
heartbeat.recheck.interval
dfs.namenode.heartbeat.recheck-interval
io.bytes.per.checksum
dfs.bytes-per-checksum
io.sort.factor
mapreduce.task.io.sort.factor
io.sort.mb
mapreduce.task.io.sort.mb
io.sort.spill.percent
mapreduce.map.sort.spill.percent
pletion.poll.interval
pletion.pollinterval
jobclient.output.filter
mapreduce.client.output.filter
jobclient.progress.monitor.poll.interval
mapreduce.client.progressmonitor.pollinterval
job.end.notification.url
mapreduce.job.end-notification.url
job.end.retry.attempts
mapreduce.job.end-notification.retry.attempts
job.end.retry.interval
mapreduce.job.end-notification.retry.interval
job.local.dir
mapreduce.job.local.dir
keep.failed.task.files
mapreduce.task.files.preserve.failedtasks
keep.task.files.pattern
mapreduce.task.files.preserve.filepattern
key.value.separator.in.input.line
mapreduce.input.keyvaluelinerecordreader.key.value.separator
local.cache.size
mapreduce.tasktracker.cache.local.size
map.input.file
mapreduce.map.input.file
map.input.length
mapreduce.map.input.length
map.input.start
mapreduce.map.input.start
map.output.key.field.separator
mapreduce.map.output.key.field.separator
map.output.key.value.fields.spec
mapreduce.fieldsel.map.output.key.value.fields.spec
mapred.acls.enabled
mapreduce.cluster.acls.enabled
mapred.binary.partitioner.left.offset
mapreduce.partition.binarypartitioner.left.offset
mapred.binary.partitioner.right.offset
mapreduce.partition.binarypartitioner.right.offset
mapred.cache.archives
mapreduce.job.cache.archives
mapred.cache.archives.timestamps
mapreduce.job.cache.archives.timestamps
mapred.cache.files
mapreduce.job.cache.files
mapred.cache.files.timestamps
mapreduce.job.cache.files.timestamps
mapred.cache.localArchives
mapreduce.job.cache.local.archives
mapred.cache.localFiles
mapreduce.job.cache.local.files
mapred.child.tmp
mapreduce.task.tmp.dir
mapred.cluster.average.blacklist.threshold
mapreduce.jobtracker.blacklist.average.threshold
mapred.cluster.map.memory.mb
mapreduce.cluster.mapmemory.mb
mapred.cluster.max.map.memory.mb
mapreduce.jobtracker.maxmapmemory.mb
mapred.cluster.max.reduce.memory.mb
mapreduce.jobtracker.maxreducememory.mb
mapred.cluster.reduce.memory.mb
mapreduce.cluster.reducememory.mb
mitter.job.setup.cleanup.needed
mitter.setup.cleanup.needed
press.map.output
mapreduce.press
mapred.data.field.separator
mapreduce.fieldsel.data.field.separator
mapred.debug.out.lines
mapreduce.task.debugout.lines
mapred.healthChecker.interval
mapreduce.tasktracker.healthchecker.interval
mapred.healthChecker.script.args
mapreduce.tasktracker.healthchecker.script.args
mapred.healthChecker.script.path
mapreduce.tasktracker.healthchecker.script.path
mapred.healthChecker.script.timeout
mapreduce.tasktracker.healthchecker.script.timeout
mapred.heartbeats.in.second
mapreduce.jobtracker.heartbeats.in.second
mapred.hosts.exclude
mapreduce.jobtracker.hosts.exclude.filename
mapred.hosts
mapreduce.jobtracker.hosts.filename
mapred.inmem.merge.threshold
mapreduce.reduce.merge.inmem.threshold
mapred.input.dir.formats
mapreduce.input.multipleinputs.dir.formats
mapred.input.dir.mappers
mapreduce.input.multipleinputs.dir.mappers
mapred.input.dir
mapreduce.input.fileinputformat.inputdir
mapred.input.pathFilter.class
mapreduce.input.pathFilter.class
mapred.jar
mapreduce.job.jar
mapred.job.classpath.archives
mapreduce.job.classpath.archives
mapred.job.classpath.files
mapreduce.job.classpath.files
mapred.job.id
mapreduce.job.id
mapred.jobinit.threads
mapreduce.jobtracker.jobinit.threads
mapred.job.map.memory.mb
mapreduce.map.memory.mb
mapred.job.name
mapreduce.job.name
mapred.job.priority
mapreduce.job.priority
mapred.job.queue.name
mapreduce.job.queuename
mapred.job.reduce.input.buffer.percent
mapreduce.reduce.input.buffer.percent
mapred.job.reduce.markreset.buffer.percent
mapreduce.reduce.markreset.buffer.percent
mapred.job.reduce.memory.mb
mapreduce.reduce.memory.mb
mapred.job.reduce.total.mem.bytes
mapreduce.reduce.memory.totalbytes
mapred.job.reuse.jvm.num.tasks
mapreduce.job.jvm.numtasks
mapred.job.shuffle.input.buffer.percent
mapreduce.reduce.shuffle.input.buffer.percent
mapred.job.shuffle.merge.percent
mapreduce.reduce.shuffle.merge.percent
mapred.job.tracker.handler.count
mapreduce.jobtracker.handler.count
mapred.job.pleted.location
mapreduce.pleted.location
mapred.job.tracker.http.address
mapreduce.jobtracker.http.address
mapred.jobtracker.instrumentation
mapreduce.jobtracker.instrumentation
mapred.jobtracker.job.history.block.size
mapreduce.jobtracker.jobhistory.block.size
mapred.job.tracker.jobhistory.lru.cache.size
mapreduce.jobtracker.jobhistory.lru.cache.size
mapred.job.tracker
mapreduce.jobtracker.address
mapred.jobtracker.maxtasks.per.job
mapreduce.jobtracker.maxtasks.perjob
mapred.job.tracker.persist.jobstatus.active
mapreduce.jobtracker.persist.jobstatus.active
mapred.job.tracker.persist.jobstatus.dir
mapreduce.jobtracker.persist.jobstatus.dir
mapred.job.tracker.persist.jobstatus.hours
mapreduce.jobtracker.persist.jobstatus.hours
mapred.jobtracker.restart.recover
mapreduce.jobtracker.restart.recover
mapred.job.tracker.retiredjobs.cache.size
mapreduce.jobtracker.retiredjobs.cache.size
mapred.job.tracker.retire.jobs
mapreduce.jobtracker.retirejobs
mapred.jobtracker.taskalloc.capacitypad
mapreduce.jobtracker.taskscheduler.taskalloc.capacitypad
mapred.jobtracker.taskScheduler
mapreduce.jobtracker.taskscheduler
mapred.jobtracker.taskScheduler.maxRunningTasksPerJob
mapreduce.jobtracker.taskscheduler.maxrunningtasks.perjob
mapred.join.expr
mapreduce.join.expr
mapred.join.keycomparator
mapreduce.join.keycomparator
mapred.lazy.output.format
mapreduce.output.lazyoutputformat.outputformat
mapred.line.input.format.linespermap
mapreduce.input.lineinputformat.linespermap
mapred.linerecordreader.maxlength
mapreduce.input.linerecordreader.line.maxlength
mapred.local.dir
mapreduce.cluster.local.dir
mapred.local.dir.minspacekill
mapreduce.tasktracker.local.dir.minspacekill
mapred.local.dir.minspacestart
mapreduce.tasktracker.local.dir.minspacestart
mapred.map.child.env
mapreduce.map.env
mapred.map.child.java.opts
mapreduce.map.java.opts
mapred.map.child.log.level
mapreduce.map.log.level
mapred.map.max.attempts
mapreduce.map.maxattempts
mapred.pression.codec
mapreduce.press.codec
mapred.mapoutput.key.class
mapreduce.map.output.key.class
mapred.mapoutput.value.class
mapreduce.map.output.value.class
mapred.mapper.regex.group
mapreduce.mapper.regexmapper..group
mapred.mapper.regex
mapreduce.mapper.regex
mapred.map.task.debug.script
mapreduce.map.debug.script
mapred.map.tasks
mapreduce.job.maps
mapred.map.tasks.speculative.execution
mapreduce.map.speculative
mapred.max.map.failures.percent
mapreduce.map.failures.maxpercent
mapred.max.reduce.failures.percent
mapreduce.reduce.failures.maxpercent
mapred.max.split.size
mapreduce.input.fileinputformat.split.maxsize
mapred.max.tracker.blacklists
mapreduce.jobtracker.tasktracker.maxblacklists
mapred.max.tracker.failures
mapreduce.job.maxtaskfailures.per.tracker
mapred.merge.recordsBeforeProgress
mapreduce.task.merge.progress.records
mapred.min.split.size
mapreduce.input.fileinputformat.split.minsize
mapred.min.split.size.per.node
mapreduce.input.fileinputformat.split.minsize.per.node
mapred.min.split.size.per.rack
mapreduce.input.fileinputformat.split.minsize.per.rack
pression.codec
mapreduce.press.codec
pression.type
mapreduce.press.type
mapreduce.press
mapred.output.dir
mapreduce.output.fileoutputformat.outputdir
mapred.output.key.class
mapreduce.job.output.key.class
mapred.parator.class
mapreduce.job.parator.class
mapred.output.value.class
mapreduce.job.output.value.class
mapred.output.value.groupfn.class
mapreduce.job.parator.class
mapred.permissions.supergroup
mapreduce.cluster.permissions.supergroup
mapred.pipes.user.inputformat
mapreduce.pipes.inputformat
mapred.reduce.child.env
mapreduce.reduce.env
mapred.reduce.child.java.opts
mapreduce.reduce.java.opts
mapred.reduce.child.log.level
mapreduce.reduce.log.level
mapred.reduce.max.attempts
mapreduce.reduce.maxattempts
mapred.reduce.parallel.copies
mapreduce.reduce.shuffle.parallelcopies
mapred.pleted.maps
mapreduce.job.pletedmaps
mapred.reduce.task.debug.script
mapreduce.reduce.debug.script
mapred.reduce.tasks
mapreduce.job.reduces
mapred.reduce.tasks.speculative.execution
mapreduce.reduce.speculative
mapred.seqbinary.output.key.class
mapreduce.output.seqbinaryoutputformat.key.class
mapred.seqbinary.output.value.class
mapreduce.output.seqbinaryoutputformat.value.class
mapred.shuffle.connect.timeout
mapreduce.reduce.shuffle.connect.timeout
mapred.shuffle.read.timeout
mapreduce.reduce.shuffle.read.timeout
mapred.skip.attempts.to.start.skipping
mapreduce.task.skip.start.attempts
mapred.skip.map.auto.incr.proc.count
mapreduce.map.skip.proc-count.auto-incr
mapred.skip.map.max.skip.records
mapreduce.map.skip.maxrecords
mapred.skip.on
mapreduce.job.skiprecords
mapred.skip.out.dir
mapreduce.job.skip.outdir
mapred.skip.reduce.auto.incr.proc.count
mapreduce.reduce.skip.proc-count.auto-incr
mapred.skip.reduce.max.skip.groups
mapreduce.reduce.skip.maxgroups
mapred.speculative.execution.slowNodeThreshold
mapreduce.job.speculative.slownodethreshold
mapred.speculative.execution.slowTaskThreshold
mapreduce.job.speculative.slowtaskthreshold
mapred.speculative.execution.speculativeCap
mapreduce.job.speculative.speculativecap
mapred.submit.replication
mapreduce.client.submit.file.replication
mapred.system.dir
mapreduce.jobtracker.system.dir
mapred.task.cache.levels
mapreduce.jobtracker.taskcache.levels
mapred.task.id
mapreduce.task.attempt.id
mapred.task.is.map
mapreduce.task.ismap
mapred.task.partition
mapreduce.task.partition
mapred.task.profile
mapreduce.task.profile
mapred.task.profile.maps
mapreduce.task.profile.maps
mapred.task.profile.params
mapreduce.task.profile.params
mapred.task.profile.reduces
mapreduce.task.profile.reduces
mapred.task.timeout
mapreduce.task.timeout
mapred.tasktracker.dns.interface
mapreduce.tasktracker.dns.interface
mapred.tasktracker.dns.nameserver
mapreduce.tasktracker.dns.nameserver
mapred.tasktracker.events.batchsize
mapreduce.tasktracker.events.batchsize
mapred.tasktracker.expiry.interval
mapreduce.jobtracker.expire.trackers.interval
mapred.task.tracker.http.address
mapreduce.tasktracker.http.address
mapred.tasktracker.indexcache.mb
mapreduce.tasktracker.indexcache.mb
mapred.tasktracker.instrumentation
mapreduce.tasktracker.instrumentation
mapred.tasktracker.map.tasks.maximum
mapreduce.tasktracker.map.tasks.maximum
mapred.tasktracker.memory_calculator_plugin
mapreduce.tasktracker.resourcecalculatorplugin
mapred.tasktracker.memorycalculatorplugin
mapreduce.tasktracker.resourcecalculatorplugin
mapred.tasktracker.reduce.tasks.maximum
mapreduce.tasktracker.reduce.tasks.maximum
mapred.task.tracker.report.address
mapreduce.tasktracker.report.address
mapred.task.tracker.task-controller
mapreduce.tasktracker.taskcontroller
mapred.tasktracker.taskmemorymanager.monitoring-interval
mapreduce.tasktracker.taskmemorymanager.monitoringinterval
mapred.tasktracker.tasks.sleeptime-before-sigkill
mapreduce.tasktracker.tasks.sleeptimebeforesigkill
mapred.temp.dir
mapreduce.cluster.temp.dir
mapred.parator.options
mapreduce.partition.keycomparator.options
mapred.text.key.partitioner.options
mapreduce.partition.keypartitioner.options
mapred.textoutputformat.separator
mapreduce.output.textoutputformat.separator
mapred.tip.id
mapreduce.task.id
bine.class
bine.class
mapreduce.inputformat.class
mapreduce.job.inputformat.class
mapreduce.job.counters.limit
mapreduce.job.counters.max
mapreduce.jobtracker.permissions.supergroup
mapreduce.cluster.permissions.supergroup
mapreduce.map.class
mapreduce.job.map.class
mapreduce.outputformat.class
mapreduce.job.outputformat.class
mapreduce.partitioner.class
mapreduce.job.partitioner.class
mapreduce.reduce.class
mapreduce.job.reduce.class
mapred.used.genericoptionsparser
mapreduce.client.genericoptionsparser.used
mapred.userlog.limit.kb
mapreduce.task.userlog.limit.kb
mapred.userlog.retain.hours
mapreduce.job.userlog.retain.hours
mapred.working.dir
mapreduce.job.working.dir
mapred.work.output.dir
mapreduce.task.output.dir
min.num.bine
bine.minspills
reduce.output.key.value.fields.spec
mapreduce.fieldsel.reduce.output.key.value.fields.spec
security.job.submission.protocol.acl
security.job.client.protocol.acl
security.task.umbilical.protocol.acl
security.job.task.protocol.acl
sequencefile.filter.class
mapreduce.input.sequencefileinputfilter.class
sequencefile.filter.frequency
mapreduce.input.sequencefileinputfilter.frequency
sequencefile.filter.regex
mapreduce.input.sequencefileinputfilter.regex
session.id
dfs.metrics.session-id
slave.host.name
dfs.datanode.hostname
slave.host.name
mapreduce.tasktracker.host.name
tasktracker.contention.tracking
mapreduce.tasktracker.contention.tracking
tasktracker.http.threads
mapreduce.tasktracker.http.threads
topology.node.switch.mapping.impl
net.topology.node.switch.mapping.impl
topology.script.file.name
net.topology.script.file.name
topology.script.number.args
net.topology.script.number.args
mapreduce.job.user.name
webinterface.private.actions
mapreduce.jobtracker.webinterface.trusted
yarn.app.mapreduce.yarn.app.mapreduce.client-am.ipc.max-retries-on-timeouts
yarn.app.mapreduce.client-am.ipc.max-retries-on-timeouts
The following table lists additional changes to some configuration properties:
Deprecated property name
New property name
mapred.create.symlink
NONE - symlinking is always on
mapreduce.job.cache.symlink.create
NONE - symlinking is always on
文章可以转载,必须以链接形式标明出处。
&&相关文章推荐
* 以上用户言论只代表其个人观点,不代表CSDN网站的观点或立场
访问:12195次
积分:1107
积分:1107
排名:千里之外
原创:40篇
转载:207篇
译文:27篇
(window.slotbydup = window.slotbydup || []).push({
id: '4740887',
container: s,
size: '250,250',
display: 'inlay-fix'