Underrated Dev
Install Tez UI in HDP3 Unsecure

Install Tez UI in HDP3 Unsecure

Nur Kholis M.'s photo
Nur Kholis M.
·

1 min read

Tez UI Installation

  1. Download tez-ui-0.9.1.war

  2. Extract tez-ui-0.9.1.war di /var/www/html/tez-ui

    # mkdir /var/www/html/tez-ui
# unzip tez-ui-0.9.1.war -d /var/www/html/tez-ui

  3. Edit file /var/www/html/tez-ui/config/configs.env

    • timeline must be set to Ambari value of yarn.timeline-service.webapp.address (YARN configuration)
    • rm must be set to Ambari value of yarn.resourcemanager.webapp.address (YARN configuration)
    • timeZone: "Asia/Jakarta",

    The two above parameter values are like server.domain.com:8188 and server.domain.com:8088. Ensure with a web browser that they return the list of competed and running applications onto your cluster.

    Ambari values to copy/paste:

    tez01.png

  4. Done. You can access to TEZ UI at this url: ambari-server.domain.com/tez-ui

Tez UI Configuration

  • HDFS Configuration:
hadoop.http.filter.initializers = org.apache.hadoop.security.AuthenticationFilterInitializer,org.apache.hadoop.security.HttpCrossOriginFilterInitializer
  • YARN Configuration:
yarn.timeline-service.enabled = true
yarn.acl.enable = false
yarn.admin.acl = activity_analyzer,yarn,dr.who,admin
yarn.timeline-service.webapp.address = <host>:8188
yarn.timeline-service.version = 2,0f
yarn.timeline-service.hostname = <host>
yarn.timeline-service.http-cross-origin.enabled = true
yarn.timeline-service.http-cross-origin.allowed-origins = *
yarn.resourcemanager.system-metrics-publisher.enabled = true
yarn.timeline-service.entity-group-fs-store.group-id-plugin-classes = org.apache.hadoop.yarn.applications.distributedshell.DistributedShellTimelinePlugin,org.apache.tez.dag.history.logging.ats.TimelineCachePluginImpl
  • Tez Configuration:
yarn.timeline-service.enabled = true
tez.tez-ui.history-url.base = http://<host>/tez-ui/
tez.am.tez-ui.history-url.template = __HISTORY_URL_BASE__?viewPath=/#/tez-app/__APPLICATION_ID__
tez.history.logging.service.class = org.apache.tez.dag.history.logging.ats.ATSHistoryLoggingService
  • Hive Configuration:
hive_timeline_logging_enabled = true
hive.exec.pre.hooks = org.apache.hadoop.hive.ql.hooks.HiveProtoLoggingHook,org.apache.hadoop.hive.ql.hooks.ATSHook
hive.exec.post.hooks = org.apache.hadoop.hive.ql.hooks.HiveProtoLoggingHook,org.apache.hadoop.hive.ql.hooks.ATSHook,org.apache.atlas.hive.hook.HiveHook
hive.exec.failure.hooks = org.apache.hadoop.hive.ql.hooks.HiveProtoLoggingHook,org.apache.hadoop.hive.ql.hooks.ATSHook

Result

tez02.png

References

hadoop