Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 850CD200C01 for ; Thu, 15 Dec 2016 03:54:08 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 83B9F160B19; Thu, 15 Dec 2016 02:54:08 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 605B3160B2E for ; Thu, 15 Dec 2016 03:54:07 +0100 (CET) Received: (qmail 73295 invoked by uid 500); 15 Dec 2016 02:54:06 -0000 Mailing-List: contact issues-help@eagle.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@eagle.incubator.apache.org Delivered-To: mailing list issues@eagle.incubator.apache.org Received: (qmail 73286 invoked by uid 99); 15 Dec 2016 02:54:06 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 15 Dec 2016 02:54:06 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 122A21806A1 for ; Thu, 15 Dec 2016 02:54:06 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -7.018 X-Spam-Level: X-Spam-Status: No, score=-7.018 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-2.999, URIBL_BLOCKED=0.001] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id eXpMgsai5HqM for ; Thu, 15 Dec 2016 02:54:02 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with SMTP id 3C77F5FB73 for ; Thu, 15 Dec 2016 02:54:01 +0000 (UTC) Received: (qmail 73173 invoked by uid 99); 15 Dec 2016 02:54:00 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 15 Dec 2016 02:54:00 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 6189F2C0086 for ; Thu, 15 Dec 2016 02:54:00 +0000 (UTC) Date: Thu, 15 Dec 2016 02:54:00 +0000 (UTC) From: "ASF GitHub Bot (JIRA)" To: issues@eagle.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (EAGLE-820) add unit test for eagle-jpm-mr-history MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Thu, 15 Dec 2016 02:54:08 -0000 [ https://issues.apache.org/jira/browse/EAGLE-820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15750201#comment-15750201 ] ASF GitHub Bot commented on EAGLE-820: -------------------------------------- Github user wujinhu commented on a diff in the pull request: https://github.com/apache/incubator-eagle/pull/710#discussion_r92535708 --- Diff: eagle-jpm/eagle-jpm-mr-history/src/test/resources/job_1479206441898_508949_conf.xml --- @@ -0,0 +1,1337 @@ + + +hadoop.proxyuser.hive.groups*core-site.xmljob.xml +dfs.block.access.token.lifetime600hdfs-default.xmljob.xml +dfs.namenode.rpc-address.nameservice2.namenode309yhd-jqhadoop180.int.yihaodian.com:8020hdfs-site.xmljob.xml +hive.skewjoin.key100000programaticallyorg.apache.hadoop.hive.conf.LoopingByteArrayInputStream@78dfcf46job.xml +mapreduce.job.heap.memory-mb.ratio0.8mapred-default.xmljob.xml +dfs.namenode.rpc-address.nameservice2.namenode307yhd-jqhadoop175.int.yihaodian.com:8020hdfs-site.xmljob.xml +hive.index.compact.binary.searchtrueprogramaticallyorg.apache.hadoop.hive.conf.LoopingByteArrayInputStream@78dfcf46job.xml +mapreduce.map.log.levelINFOmapred-default.xmljob.xml +dfs.namenode.lazypersist.file.scrub.interval.sec300hdfs-default.xmljob.xml +mapreduce.admin.user.envLD_LIBRARY_PATH=$HADOOP_COMMON_HOME/lib/native:$JAVA_LIBRARY_PATHmapred-site.xmljob.xml +file.bytes-per-checksum512core-default.xmljob.xml +mapreduce.client.completion.pollinterval5000mapred-default.xmljob.xml +yarn.nodemanager.linux-container-executor.cgroups.strict-resource-usagefalseyarn-default.xmljob.xml +yarn.log-aggregation-enablefalseyarn-default.xmljob.xml +yarn.nodemanager.aux-services.mapreduce_shuffle.classorg.apache.hadoop.mapred.ShuffleHandleryarn-default.xmljob.xml +dfs.namenode.edit.log.autoroll.check.interval.ms300000hdfs-default.xmljob.xml +mapreduce.job.speculative.retry-after-speculate15000mapred-default.xmljob.xml +ipc.client.fallback-to-simple-auth-allowedfalsecore-default.xmljob.xml +dfs.client.failover.connection.retries0hdfs-default.xmljob.xml +mapreduce.jobtracker.system.dir${hadoop.tmp.dir}/mapred/systemmapred-default.xmljob.xml +hive.metastore.event.db.listener.timetolive86400sprogramaticallyorg.apache.hadoop.hive.conf.LoopingByteArrayInputStream@78dfcf46job.xml +yarn.scheduler.minimum-allocation-mb1024yarn-site.xmljob.xml +mapreduce.task.profile.map.params${mapreduce.task.profile.params}mapred-default.xmljob.xml +mapreduce.map.memory.mb2048mapred-site.xmljob.xml +mapreduce.tasktracker.dns.interfacedefaultmapred-default.xmljob.xml +dfs.datanode.failed.volumes.tolerated0hdfs-default.xmljob.xml +hive.server2.authenticationNONEprogramaticallyorg.apache.hadoop.hive.conf.LoopingByteArrayInputStream@78dfcf46job.xml +_hive.tmp_table_space/tmp/warehouse/bi_etl/9cbc3c63-c8f9-48cc-94a3-43ae6191ddf1/_tmp_space.dbprogramaticallyjob.xml +stream.stderr.reporter.prefixreporter:programaticallyorg.apache.hadoop.hive.conf.LoopingByteArrayInputStream@78dfcf46job.xml +dfs.client.slow.io.warning.threshold.ms30000hdfs-default.xmljob.xml +hadoop.security.groups.cache.secs300core-default.xmljob.xml +yarn.nodemanager.env-whitelistJAVA_HOME,HADOOP_COMMON_HOME,HADOOP_HDFS_HOME,HADOOP_CONF_DIR,HADOOP_YARN_HOMEyarn-default.xmljob.xml +dfs.namenode.top.window.num.buckets10hdfs-default.xmljob.xml +hive.metastore.authorization.storage.checksfalseprogramaticallyorg.apache.hadoop.hive.conf.LoopingByteArrayInputStream@78dfcf46job.xml +map.sort.classorg.apache.hadoop.util.QuickSortmapred-default.xmljob.xml +dfs.namenode.safemode.threshold-pct0.999fhdfs-default.xmljob.xml +mapreduce.jobtracker.jobhistory.task.numberprogresssplits12mapred-default.xmljob.xml +datanucleus.storeManagerTyperdbmsprogramaticallyorg.apache.hadoop.hive.conf.LoopingByteArrayInputStream@78dfcf46job.xml +dfs.short.circuit.shared.memory.watcher.interrupt.check.ms60000hdfs-default.xmljob.xml +hive.metastore.aggregate.stats.cache.max.writer.wait5000msprogramaticallyorg.apache.hadoop.hive.conf.LoopingByteArrayInputStream@78dfcf46job.xml +fs.s3n.block.size67108864core-default.xmljob.xml +yarn.resourcemanager.client.thread-count50yarn-site.xmljob.xml +dfs.client.read.shortcircuitfalsehdfs-site.xmljob.xml +mapreduce.job.end-notification.max.retry.interval5000mapred-default.xml +hadoop.security.authenticationsimplecore-site.xmljob.xml +dfs.client.mmap.retry.timeout.ms300000hdfs-default.xmljob.xml +dfs.datanode.readahead.bytes4193404hdfs-default.xmljob.xml +mapreduce.jobhistory.max-age-ms604800000mapred-default.xmljob.xml +yarn.app.mapreduce.client-am.ipc.max-retries3mapred-default.xmljob.xml +hive.mapjoin.followby.map.aggr.hash.percentmemory0.3programaticallyorg.apache.hadoop.hive.conf.LoopingByteArrayInputStream@78dfcf46job.xml +hive.script.recordwriterorg.apache.hadoop.hive.ql.exec.TextRecordWriterprogramaticallyorg.apache.hadoop.hive.conf.LoopingByteArrayInputStream@78dfcf46job.xml +hive.multigroupby.singlereducertrueprogramaticallyorg.apache.hadoop.hive.conf.LoopingByteArrayInputStream@78dfcf46job.xml +yarn.nodemanager.sleep-delay-before-sigkill.ms250yarn-default.xmljob.xml +hive.vectorized.execution.reduce.groupby.enabledtrueprogramaticallyorg.apache.hadoop.hive.conf.LoopingByteArrayInputStream@78dfcf46job.xml +hadoop.shell.missing.defaultFs.warningtruecore-default.xmljob.xml +fs.trash.interval1core-site.xmljob.xml +dfs.datanode.max.locked.memory0hdfs-default.xmljob.xml +hadoop.http.filter.initializersorg.apache.hadoop.yarn.server.webproxy.amfilter.AmFilterInitializerprogramaticallyjob.xml +fs.har.implorg.apache.hadoop.hive.shims.HiveHarFileSystemprogramaticallyorg.apache.hadoop.hive.conf.LoopingByteArrayInputStream@78dfcf46job.xml +dfs.datanode.ipc.address0.0.0.0:50020hdfs-default.xmljob.xml +dfs.namenode.delegation.token.renew-interval86400000hdfs-default.xmljob.xml +yarn.resourcemanager.webapp.address${yarn.resourcemanager.hostname}:8088yarn-default.xmljob.xml +hive.spark.client.rpc.sasl.mechanismsDIGEST-MD5programaticallyorg.apache.hadoop.hive.conf.LoopingByteArrayInputStream@78dfcf46job.xml +hive.current.databasedefaultprogramaticallyjob.xml +hive.optimize.index.groupbyfalseprogramaticallyorg.apache.hadoop.hive.conf.LoopingByteArrayInputStream@78dfcf46job.xml +mapreduce.shuffle.max.connections80mapred-site.xmljob.xml +yarn.nodemanager.local-cache.max-files-per-directory8192yarn-default.xmljob.xml +dfs.namenode.replication.work.multiplier.per.iteration2hdfs-default.xmljob.xml +mapred.mapper.new-apifalseprogramaticallyjob.xml +mapreduce.jobtracker.addresslocalmapred-default.xmljob.xml +dfs.datanode.slow.io.warning.threshold.ms300hdfs-default.xmljob.xml +yarn.client.max-cached-nodemanagers-proxies0yarn-default.xmljob.xml +mapreduce.job.working.dirviewfs://cluster9/user/bi_etlprogramaticallyjob.xml +mapreduce.tasktracker.instrumentationorg.apache.hadoop.mapred.TaskTrackerMetricsInstmapred-default.xmljob.xml +hadoop.registry.zk.quorumlocalhost:2181yarn-default.xmljob.xml +yarn.app.mapreduce.am.job.committer.commit-window10000mapred-default.xmljob.xml +hadoop.registry.zk.session.timeout.ms60000yarn-default.xmljob.xml +hive.tez.exec.print.summaryfalseprogramaticallyorg.apache.hadoop.hive.conf.LoopingByteArrayInputStream@78dfcf46job.xml +nfs.exports.allowed.hosts* rwcore-default.xmljob.xml +hive.metastore.filter.hookorg.apache.hadoop.hive.metastore.DefaultMetaStoreFilterHookImplprogramaticallyorg.apache.hadoop.hive.conf.LoopingByteArrayInputStream@78dfcf46job.xml +hive.metastore.integral.jdo.pushdownfalseprogramaticallyorg.apache.hadoop.hive.conf.LoopingByteArrayInputStream@78dfcf46job.xml +hadoop.util.hash.typemurmurcore-default.xmljob.xml +dfs.namenode.replication.min1hdfs-default.xmljob.xml +mapreduce.job.user.namebi_etlprogramatically +hive.cli.print.current.dbfalseprogramaticallyorg.apache.hadoop.hive.conf.LoopingByteArrayInputStream@78dfcf46job.xml +hive.debug.localtaskfalseprogramaticallyorg.apache.hadoop.hive.conf.LoopingByteArrayInputStream@78dfcf46job.xml +hive.security.authorization.enabledfalseprogramaticallyorg.apache.hadoop.hive.conf.LoopingByteArrayInputStream@78dfcf46job.xml +hive.warehouse.subdir.inherit.permstruefile:/data/opt/hive1.2.1/apache-hive-1.2.1-bin/conf/hive-site.xmljob.xml +mapreduce.jobtracker.retiredjobs.cache.size1000mapred-default.xmljob.xml +s3.client-write-packet-size65536core-default.xmljob.xml +yarn.resourcemanager.scheduler.address${yarn.resourcemanager.hostname}:8030yarn-default.xmljob.xml +hive.metastore.try.direct.sqltrueprogramaticallyorg.apache.hadoop.hive.conf.LoopingByteArrayInputStream@78dfcf46job.xml +fs.s3.block.size67108864core-default.xmljob.xml +hadoop.security.group.mapping.ldap.search.filter.user(&(objectClass=user)(sAMAccountName={0}))core-default.xmljob.xml +dfs.permissions.superusergroupsupergrouphdfs-default.xmljob.xml +yarn.resourcemanager.resource-tracker.address${yarn.resourcemanager.hostname}:8031yarn-default.xmljob.xml +yarn.resourcemanager.resource-tracker.address.rm405yhd-jqhadoop168.int.yihaodian.com:8031yarn-site.xmljob.xml --- End diff -- Can we reduce the file content since our tests do not need so much test data? > add unit test for eagle-jpm-mr-history > -------------------------------------- > > Key: EAGLE-820 > URL: https://issues.apache.org/jira/browse/EAGLE-820 > Project: Eagle > Issue Type: Improvement > Reporter: luokun > Assignee: luokun > -- This message was sent by Atlassian JIRA (v6.3.4#6332)