io.bigconnect.dw.image.face

Class FaceDescriptorDataWorker

java.lang.Object

com.mware.core.ingest.dataworker.DataWorker

io.bigconnect.dw.image.face.FaceDescriptorDataWorker

public class FaceDescriptorDataWorker
extends com.mware.core.ingest.dataworker.DataWorker

Field Summary

Fields

Modifier and Type	Field and Description
static com.mware.core.model.properties.types.StringBcProperty	FACE_DESCRIPTOR
static com.mware.core.model.properties.types.IntegerBcProperty	FACE_NUMBER

Constructor Summary

Constructors

Constructor and Description
FaceDescriptorDataWorker(com.mware.core.config.Configuration configuration) Flow:

Method Summary

Modifier and Type	Method and Description
void	execute(java.io.InputStream in, com.mware.core.ingest.dataworker.DataWorkerData data)
boolean	isHandled(com.mware.ge.Element element, com.mware.ge.Property property)
void	prepare(com.mware.core.ingest.dataworker.DataWorkerPrepareData workerPrepareData)

Methods inherited from class com.mware.core.ingest.dataworker.DataWorker

addVertexToWorkspaceIfNeeded, addVideoTranscriptAsTextPropertiesToMutation, applyTermMentionFilters, getAuthorizations, getConfiguration, getGraph, getGraphAuthorizationRepository, getGraphRepository, getSchemaRepository, getUser, getVisibilityTranslator, getWebQueueRepository, getWorkQueueRepository, getWorkspaceRepository, isConceptType, isDeleteHandled, isHiddenHandled, isLocalFileRequired, isTextProperty, isUnhiddenHandled, isVertex, pushChangedPropertiesOnWorkQueue, pushTextUpdated, pushVideoTranscriptTextPropertiesOnWorkQueue, refresh, setConfiguration, setGraph, setGraphAuthorizationRepository, setGraphRepository, setSchemaRepository, setVisibilityTranslator, setWebQueueRepository, setWorkQueueRepository, setWorkspaceRepository, verify

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

FACE_NUMBER

public static final com.mware.core.model.properties.types.IntegerBcProperty FACE_NUMBER

FACE_DESCRIPTOR

public static final com.mware.core.model.properties.types.StringBcProperty FACE_DESCRIPTOR

Constructor Detail

FaceDescriptorDataWorker

@Inject
public FaceDescriptorDataWorker(com.mware.core.config.Configuration configuration)

Flow:

One-Shot training phase:

1. Handle on 'faceOf' relationship -> Call face extractor URL for the 'Person' and image in it If multiple descriptors for a person are present then AVG is computed

Detection phase:

1. VGGFaces2 based python script runs in a separate process on a video stream 2. All detected faces are compared with all the existing descriptors in BC (Retrieved as 'Face Descriptors' saved search) 3. If a match is found then the '/face-event' endpoint is called -> 'Event' vertex linked with 'faceEvent' rel to 'Person'

NTH: Store face descriptors in faiss index

Method Detail

prepare

public void prepare(com.mware.core.ingest.dataworker.DataWorkerPrepareData workerPrepareData)
             throws java.lang.Exception

Overrides:

prepare in class com.mware.core.ingest.dataworker.DataWorker

Throws:

java.lang.Exception

isHandled

public boolean isHandled(com.mware.ge.Element element,
                         com.mware.ge.Property property)

Specified by:

isHandled in class com.mware.core.ingest.dataworker.DataWorker

execute

public void execute(java.io.InputStream in,
                    com.mware.core.ingest.dataworker.DataWorkerData data)
             throws java.lang.Exception

Specified by:

execute in class com.mware.core.ingest.dataworker.DataWorker

Throws:

java.lang.Exception