Ask Your Question
1

HIVE_06 - Configuration file 'core-site.xml' is missing from 'hadoop-conf'

asked 2018-06-14 16:47:58 -0600

This post is a wiki. Anyone with karma >75 is welcome to improve it.

Hi, I'm following this tutorial https://github.com/streamsets/tutoria... but i have this error HIVE_06 - Configuration file 'core-site.xml' is missing from 'hadoop-conf' What can be?, thanks

edit retag flag offensive close merge delete

2 Answers

Sort by » oldest newest most voted
1

answered 2018-06-14 16:54:35 -0600

It looks like you might not have followed these instructions:

Note: SDC requires the configuration files for Hadoop and Hive to be accessible in a single directory. Before you add the Hive and Hadoop pipeline stages, create a directory named hadoop-conf under SDC's resources directory, and link the core-site.xml, hdfs-site.xml and hive-site.xml configuration files from your distribution into the hadoop-conf directory.

edit flag offensive delete link more
1

answered 2018-07-10 05:57:01 -0600

Step1: Crate a hadoop-conf folder under resource of your streamset

  • sudo mkdir /home/training/streamsets-datacollector-3.3.0/resources/hadoop-conf

Step2: Then, keep the below files from Hadoop and hive config under hadoop-conf.

core-site.xml hdfs-site.xml hive-site.xml

Step3: restart streamsets and now run your pipeline.

PS: - No need to make link for core-site.xml, hdfs-site.xml, hive-site.xml if you keep whole file under hadoop-conf. - No need to run any - chown -R sdc:sdc hadoop-conf

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2018-06-14 16:47:58 -0600

Seen: 172 times

Last updated: Jul 10 '18
{"cc_re__cc_re__cc_by_sa_3_0_le": ["eed</a> </p> </div> </div> <div class=\"clearfix\"></div> <div class=\"box statsWidget\"> <div class=\"clearfix\"></div> <h2>Stats</h2> <p>\n        Asked: <strong> <abbr class=\"timeago\" title=\"2018-06-14 16:47:58 -0600\">2018-06-14 16:47:58 -0600</abbr> </strong> </p> <p> \n        Seen: <strong>172 times</strong> </p> <p>\n        Last updated: <strong title=\"2018-07-10 05:57:01.037231\">Jul 10 '18</strong> </p> </div> </div> </div> <div id=\"ground\"> <div class=\"content-wrapper\"> <div class=\"copyright\"> <a href=\"http://creativecommons.org/licenses/by-sa/3.0/legalcode\" target=\"_blank\"> <img class=\"license-logo\" src=\"/m/default/media/images/cc-by-sa.png?v=1\" title=\"cc-by-sa\" alt=\"cc-by-sa\"> </a>\r\n                \r\n                Copyright StreamSets, Inc., 2017. <br/>Licensed under <a href=\"http://creativecommons.org/licenses/by-sa/3.0/legalcode\" target=\"_blank\">Creative Commons Attribution Share Alike 3.0</a> </div> <div class=\"footer-links\"> <a href=\"/about/\">about</a><span class=\"link-separator\"> |</span> <a href=\"/faq/\">faq</a><span class=\"link-separator\"> |</span> <a hre", "trong>172 times</strong> </p> <p>\n        Last updated: <strong title=\"2018-07-10 05:57:01.037231\">Jul 10 '18</strong> </p> </div> </div> </div> <div id=\"ground\"> <div class=\"content-wrapper\"> <div class=\"copyright\"> <a href=\"http://creativecommons.org/licenses/by-sa/3.0/legalcode\" target=\"_blank\"> <img class=\"license-logo\" src=\"/m/default/media/images/cc-by-sa.png?v=1\" title=\"cc-by-sa\" alt=\"cc-by-sa\"> </a>\r\n                \r\n                Copyright StreamSets, Inc., 2017. <br/>Licensed under <a href=\"http://creativecommons.org/licenses/by-sa/3.0/legalcode\" target=\"_blank\">Creative Commons Attribution Share Alike 3.0</a> </div> <div class=\"footer-links\"> <a href=\"/about/\">about</a><span class=\"link-separator\"> |</span> <a href=\"/faq/\">faq</a><span class=\"link-separator\"> |</span> <a href=\"/help/\" title=\"help\">help</a> <span class=\"link-separator\"> |</span> <a href=\"/privacy/\">privacy policy</a> <span class=\"link-separator\"> |</span> <a href=\"/feedback/?next=/questions/scope:all/sort:answers-asc/tags:gzip/page:1/\">\r\n                give feedback\r\n            </a> <"], "copyright__copyright__copyright": ["e below files from Hadoop and hive config under hadoop-conf.\n\ncore-site.xml hdfs-site.xml hive-site.xml\n\nStep3: restart streamsets and now run your pipeline.\n\nPS: - No need to make link for core-site.xml, hdfs-site.xml, hive-site.xml if you keep whole file under hadoop-conf. - No need to run any - chown -R sdc:sdc hadoop-conf\n\nedit flag offensive delete link more\nLogin/Signup to Answer\n\nQuestion Tools\n\n1 follower\n\nStats\n\nAsked: 2018-06-14 16:47:58 -0600\n\nSeen: 172 times\n\nLast updated: Jul 10 '18", "e below files from Hadoop and hive config under hadoop-conf.\n\ncore-site.xml hdfs-site.xml hive-site.xml\n\nStep3: restart streamsets and now run your pipeline.\n\nPS: - No need to make link for core-site.xml, hdfs-site.xml, hive-site.xml if you keep whole file under hadoop-conf. - No need to run any - chown -R sdc:sdc hadoop-conf\n\nedit flag offensive delete link more\nLogin/Signup to Answer\n\nQuestion Tools\n\n1 follower\n\nStats\n\nAsked: 2018-06-14 16:47:58 -0600\n\nSeen: 172 times\n\nLast updated: Jul 10 '18"]}