Annotation

A successful machine learning application starts with data.

Although there exist many large open machine-learning datasets, deep neural network (DNN) applications usually require specialized training data and annotation.

YouTube-8M
MS COCO
CityScapes CityScapes Images

FACES IN THE WILD

Faces in the wild ImageNet

Data is plentiful but ground-truth annotation can be expensive to create. DNNs are limited by their training data.

Garbage in garbage out

Neureon solves the data problem with several strategies:

1: Semi-automatic boot-strap annotation

Annotation cycle Whole-slide-image segmentation

Networks trained on a task automatically annotate new training data. As the training database grows, proofreading effort decreases. Training data continues to grow after the application is deployed.

2: Self annotating video

Two superimposed frames Input image Reconstructed image

Moving targets are tracked and stabilized in video. Auto-encoder networks learn to ignore moving distractors.

3: Synthetic ray-traced images and ground truth

Rendered Humvee Humvee mask
Rendered Airplane

Domain randomization mitigates synthetic dataset bias. We render target models on background photographs. High dynamic range images (HDRIs) generate diverse lighting and atmospheric conditions.

HDRI example

Occlusion augmentation uses alpha blending.

Humvee with no occlusion

+

Forgeround building

=

Foreground and background combined Humvee occluded with pole

Our networks trained on synthetic target images

Rendered sherman tank Rendered sherman tank Rendered sherman tank Rendered sherman tank

perform well on photos of real targets.

Photos of sherman tanks

Results: Semantic Segmentation on Real Targets

Segmented sherman tank Segmented sherman tank Segmented sherman tank Segmented sherman tank Segmented sherman tank Segmented sherman tank Segmented sherman tank Segmented sherman tank Segmented sherman tank Segmented sherman tank Segmented sherman tank Segmented sherman tank Segmented sherman tank Segmented sherman tank Segmented sherman tank
Segmented sherman tank Segmented sherman tank Segmented sherman tank Segmented sherman tank Segmented sherman tank Segmented sherman tank Segmented sherman tank Segmented sherman tank