reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <>
Subject [jira] [Commented] (REEF-2021) In AzureBatch Runtime, Enable REEF .NET Client Communication to Driver
Date Sat, 16 Jun 2018 00:27:00 GMT


ASF GitHub Bot commented on REEF-2021:

motus commented on a change in pull request #1468: [REEF-2021]In AzureBatch Runtime, Enable
REEF .NET Client Communication to Driver

 File path: lang/cs/Org.Apache.REEF.Client/AzureBatch/AzureBatchJobSubmissionResult.cs
 @@ -0,0 +1,119 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements.  See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership.  The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License.  You may obtain a copy of the License at
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// KIND, either express or implied.  See the License for the
+// specific language governing permissions and limitations
+// under the License.
+using System;
+using System.Collections.Generic;
+using System.IO;
+using System.Linq;
+using Microsoft.Azure.Batch;
+using Microsoft.Azure.Batch.Common;
+using Microsoft.Practices.EnterpriseLibrary.TransientFaultHandling;
+using Org.Apache.REEF.Client.API;
+using Org.Apache.REEF.Client.Common;
+using Org.Apache.REEF.Client.DotNet.AzureBatch;
+using Org.Apache.REEF.Utilities.Logging;
+namespace Org.Apache.REEF.Client.AzureBatch
+    internal class AzureBatchJobSubmissionResult : JobSubmissionResult
+    {
+        private static readonly Logger LOGGER = Logger.GetLogger(typeof(AzureBatchJobSubmissionResult));
+        private const string AzureBatchTaskWorkDirectory = "wd";
+        private readonly AzureBatchService _azurebatchService;
+        private readonly string _jobId;
+        private readonly int _numberOfRetries;
+        private readonly int _retryInterval;
+        internal AzureBatchJobSubmissionResult(IREEFClient reefClient,
+            string filePath,
+            string jobId,
+            int numberOfRetries,
+            int retryInterval,
+            AzureBatchService azbatchService) : base(reefClient, filePath, numberOfRetries,
+        {
+            _jobId = jobId;
+            _numberOfRetries = numberOfRetries;
+            _retryInterval = retryInterval;
+            _azurebatchService = azbatchService;
+        }
+        protected override string GetDriverUrl(string filepath)
+        {
+            var policy = new RetryPolicy<AllErrorsTransientStrategy>(_numberOfRetries,
 Review comment:
   `policy` can be a member variable, initialized in constructor. then you won't need `_numberOfRetries`
and `_retryInterval` members

This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:

> In AzureBatch Runtime, Enable REEF .NET Client Communication to Driver
> ----------------------------------------------------------------------
>                 Key: REEF-2021
>                 URL:
>             Project: REEF
>          Issue Type: Improvement
>          Components: REEF.NET Client, REEF.NET Driver
>            Reporter: Chenxi Zhao
>            Assignee: Chenxi Zhao
>            Priority: Major
> After user submits task to Azure Batch runtime, client is not able to communicate REEF
HTTP server hosted on Driver, due to network configuration. We want to save the pain for user
of setting up VNET in Azure Batch Pool to enable the connection.
> We will provide this capability by a HTTP connection proxy, which exchanges HTTP request
through Azure Storage Queue.

This message was sent by Atlassian JIRA

View raw message