Integration with arbitrary class system

Answered

Follow

Fujiwara Daichi

• November 20, 2024 05:41
• Edited

I would like to implement following system:

 

1. Class label is not specified at the compile. It opens out only when getting response from AI, which uses arbitrary class system.

2. AI System works as a server outside the plugin, on the same local PC.

3. Frame is sent to the AI server with some interval (w.r.t frame count)

4. Class is sent from AI server, with additional informations(Confidence, Target ID, etc)

5. View those information below each bounding box captured.

 

What I want to visualize is similar to this image.

In this reference image,

I want "Face" to be dynamic arbitrary class name, which depends on AI response.

And I want additional Information "Age", "Gender", etc are always visualized, which also depends on AI response.

 

 

Then,

1. how can I implement dynamic class label?

2. how can I visualize additional information with some format?

 

0

• 

  Andrey Terentyev

  • November 20, 2024 16:38

  Hello,

  I'd recommend you to start with this guide.

  https://meta.nxvms.com/docs/developers/knowledgebase/200-introduction-to-creating-a-video-analytics-plugin

  In addition, see sample analytics plugin in the Metadata SDK.

  0

  Comment actions Permalink
• 

  Fujiwara Daichi

  • November 21, 2024 03:18
  • Edited

  Thank you for reference.

  But I've been already using sample analytics plugin as a reference.

  I want to know, whether that system is possible to implement or not.

  Because I guess Nx Witness itself expects static class system(defined at compile).

  0

  Comment actions Permalink
• 

  Andrey Terentyev

  • November 27, 2024 12:01

  Hello,

  The object type ids to be used by the plugin are declared in the Engine's manifest.

  The Engine's manifest can be dynamically updated by implementing this method.

  /** Must be called when the Integration needs to change the data in the Engine manifest. */
          virtual void pushManifest(const IString* manifest) = 0;

  Object parameter values can be assigned in the object metadata packet with        

   objectMetadata->addAttribute()

  0

  Comment actions Permalink

Please sign in to leave a comment.