Export Training Data For Deep Learning

(Required)

The portal item Id, image service URL, cloud raster dataset, or shared raster dataset that will be classified. At least one type of input needs to be provided in the JSON object. If multiple inputs are given, the itemId takes priority.

Syntax: JSON object describes the input raster.

{"itemId": <portal item id>}
{"url": <image service url>}
{"serviceProperties":{"name":"testrasteranalysis",
   "serviceUrl":"https://<server name>/server/rest/services/Hosted/testrasteranalysis/ImageServer"},
   "itemProperties":{"itemId":"8cfbd3ec25584d0d8fed23b8ff7c43b", "folderId":"sdfwerfbd3ec25584d0d8f4"}
}

(Required)

This is the output location for training sample data. It can be just the output folder name, or the path of the output location on the file share raster data store, or a shared file system path.

rooftoptrainingsamples

/rasterStores/myrasterstore/rooftoptrainingsamples

\\servername\deeplearning\rooftoptrainingsamples

(Required)

Labeled data, either a feature service or image service. Vector inputs should follow a training sample format as generated by the ArcGIS Pro Training Sample Manager, whereas raster inputs should follow a classified raster format as generated by the Classify Raster tool.

{"itemId": <portal item id>}
{"url": <image or feature service url>}
{"serviceProperties":{"name":"testrasteranalysis",
   "serviceUrl":"https://<server name>/server/rest/services/Hosted/testrasteranalysis/ImageServer"},
   "itemProperties":{"itemId":"8cfbd3ec25584d0d8fed23b8ff7c43b", "folderId":"sdfwerfbd3ec25584d0d8f4"}
}

The raster format for the image chip outputs.

Values: TIFF | PNG | JPEG | MRF (Meta Raster Format)

TIFF

The size of the image chips.

{"x": 256, "y": 256}

The distance to move in the x and y when creating the next image chip. When stride is equal to the tile size, there will be no overlap. When stride is equal to half of the tile size, there will be 50 percent overlap.

{"x": 128, "y": 128}

The format of the output metadata labels.

The four options for output metadata labels for the training data are KITTI rectangles, PASCAL VOC rectangles, Classified Tiles (a class map), and RCNN Masks. If your input training sample data is a feature class layer, such as a building layer or standard classification training sample file, use the KITTI or PASCAL VOC rectangles option. The output metadata is a .txt file or .xml file containing the training sample data contained in the minimum bounding rectangle. The name of the metadata file matches the input source image name. If your input training sample data is a class map, use the Classified Tiles option as your output metadata format.

Values:

• KITTI_rectangles (Default): The metadata follows the same format as the Karlsruhe Institute of Technology and Toyota Technological Institute (KITTI) Object Detection Evaluation dataset. The KITTI dataset is a vision benchmark suite. The label files are plain text files. All values, both numerical and strings, are separated by spaces, and each row corresponds to one object. For more information, see KITTI metadata format.
• PASCAL_VOC_rectangles: The metadata follows the same format as the Pattern Analysis, Statistical Modeling and Computational Learning, Visual Object Classes (PASCAL_VOC) dataset. The PASCAL VOC dataset is a standardized image dataset for object class recognition. The label files are XML files and contain information about image name, class value, and bounding boxes. For more information, see PASCAL Visual Object Classes.
• Classified_Tiles: This option will output one classified image chip per input image chip. No other metadata for each image chip is used. Only the statistics output has more information on the classes, such as class names, class values, and output statistics.
• RCNN_Masks: This option will output image chips that have a mask on the areas where the sample exists. The model generates bounding boxes and segmentation masks for each instance of an object in the image. It's based on Feature Pyramid Network (FPN) and a ResNet101 backbone in the deep learning framework model.
• Labeled_Tiles: Each output tile will be labeled with a specific class.

PASCAL_VOC_rectangles example:

<?xml version=”1.0”?>
- <layout>
      <image>000000000</image>
      <object>1</object>
    - <part>
         <class>1</class>
       - <bndbox>
            <xmin>31.85</xmin>
            <ymin>101.52</ymin>
            <xmax>256.00</xmax>
            <ymax>256.00</ymax>
         </bndbox>
      </part>
  </layout>

The field that contains the class values. If no field is specified, the system searches for a value or classvalue field. If the feature does not contain a class field, the system determines that all records belong to one class.

{"Classvalue"}

The radius for a buffer around each training sample to delineate a training sample area. This allows you to create circular polygon training samples from points.

{1}

A polygon feature class that delineates the area where image chips will be created.

Only image chips that fall completely within the polygons will be created.

{"itemId": <portal item id>}
{"url": <feature service url>}

The rotation angle that will be used to generate additional image chips.

An image chip will be generated with a rotation angle of 0, which means no rotation. It will then be rotated at the specified angle to create an additional image chip. The same training samples will be captured at multiple angles in multiple image chips for data augmentation.

The default rotation angle is 0.

{60}

Contains settings that affect task execution. This task has the following settings:

• Extent (extent)—A bounding box that defines the analysis area.
• Cell Size (cellSize)—The output raster will have the resolution specified by cell size.
• Export All Tiles (exportAllTiles)—Choose if the training sample image chips with overlapped label data will be exported.
  • True—Export all the image chips, including those that do not overlap labeled data. This is the default.
  • False—Export only the image chips that overlap the labeled data.

  Syntax:

  {"exportAllTiles" : true}

• Start Index (startIndex)—Allows you to set the start index for the sequence of image chips. This appends more image chips to an existing sequence. The default value is 0.

  Syntax:

  {"startIndex": 0 }

The response format. The default response format is html.

Values: html | json

1

Class value

The class value of the object listed in the stats.txt file.

2–4

Unused

5–8

Bbox

The two-dimensional bounding box of objects in the image, based on a 0-based image space coordinate index. The bounding box contains the four coordinates for the left, top, right, and bottom pixels.

9–15

Unused