events.action: opened
events.author: ScrapCodes
events.text: This is work in progress, because I wanted some early feedback as to overall approach taken. At the moment with current code, this mounting feature does not work in client mode of submission. The reason is, in client mode kubernetes does not create any resources. 
  
  My question is, what is the correct way to create a config map, while in the client mode. If it is created in a place like ExecutorPodAllocator, then since it is run repeatedly, then we would not want the config map to be created again and again on each executor pod allocation. So, what would be correct place to do it.
  
  ### What changes were proposed in this pull request?
  A new feature to propagate correct logging configuration file either by picking up from user specified logger configuration file on the classpath or through user specified k8s config map.
  
  ### Why are the changes needed?
  Please see referenced JIRA.
  
  ### Does this PR introduce any user-facing change?
  No
  
  ### How was this patch tested?
  Manually tested.
events.title: [WIP][SPARK-25065][k8s] Allow setting up correct logging configuration on driver and executor.
events.type: issue
events.action: created
events.author: ScrapCodes
events.text: @srowen and @vanzin Do you think this patch makes sense? I am ready to work on it more if some more work is needed. Thanks :)
events.type: comment
events.action: created
events.author: ScrapCodes
events.text: Jenkins, retest this please.
events.type: comment
events.action: created
events.author: ScrapCodes
events.text: Jenkins, retest this please.
events.type: comment
events.action: created
events.author: ScrapCodes
events.text: This failed with 20/02/04 00:20:45 INFO AmazonHttpClient: Unable to execute HTTP request: Read timed out
  20/02/04 00:20:45.716 ScalaTest-main-running-KubernetesSuite INFO ProcessUtils: java.net.SocketTimeoutException: Read timed out
events.type: comment
events.action: created
events.author: ScrapCodes
events.text: This test is failing more often and only occasionally it passes.
  
  - Launcher client dependencies *** FAILED ***
    
  The code passed to eventually never returned normally. Attempted 1 times over 3.375042707433333 minutes. Last failure message: Failed to create bucket spark.. (DepsTestsSuite.scala:213)
events.type: comment
events.action: created
events.author: ScrapCodes
events.text: Jenkins, retest this please.
events.type: comment
events.action: created
events.author: ScrapCodes
events.text: @mccheah @vanzin @dongjoon-hyun Can you please take a look?
events.type: comment
events.action: created
events.author: ScrapCodes
events.text: @vanzin, Hi Marcelo Vanzin, I have added you for the review, as you have worked on similar features as this PR, please take a look.
events.type: comment
data_with_bots.bot: **[Test build #117811 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/117811/testReport)** for PR 26193 at commit [`05b4273`](https://github.com/apache/spark/commit/05b427391f048240d3f7cd38b0055c70c3a80987).
data_with_bots.meta: This message directly preceded comment from bot *SparkQA* by author *ScrapCodes*:
data_with_bots.text: Jenkins, retest this please.
data_with_bots.bot: Merged build finished. Test FAILed.
data_with_bots.meta: This message directly preceded comment from bot *AmplabJenkins* by author *ScrapCodes*:
data_with_bots.text: Jenkins, retest this please.
data_with_bots.bot: Merged build finished. Test FAILed.
data_with_bots.meta: This message directly preceded comment from bot *AmplabJenkins* by author *ScrapCodes*:
data_with_bots.text: Jenkins, retest this please.
data_with_bots.bot: Kubernetes integration test starting
  URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/22738/
data_with_bots.meta: This message directly preceded comment from bot *SparkQA* by author *ScrapCodes*:
data_with_bots.text: @mccheah @vanzin @dongjoon-hyun Can you please take a look?
data_without_bots.meta: This message directly preceded comment from bot *SparkQA* by author *ScrapCodes*:
data_without_bots.text: Jenkins, retest this please.
data_without_bots.meta: This message directly preceded comment from bot *AmplabJenkins* by author *ScrapCodes*:
data_without_bots.text: Jenkins, retest this please.
data_without_bots.meta: This message directly preceded comment from bot *AmplabJenkins* by author *ScrapCodes*:
data_without_bots.text: Jenkins, retest this please.
data_without_bots.meta: This message directly preceded comment from bot *SparkQA* by author *ScrapCodes*:
data_without_bots.text: @mccheah @vanzin @dongjoon-hyun Can you please take a look?