Skip to main content

Next idea for a killer APP for nx witness - actually 2

Answered
Danny Ferguson

Hi everyone,

I am deploying a DW IVMS and have been looking at options. I came up with a couple of ideas that I would love to hear your feedback about. I have the IVMS running on a 2 CPU 2/6 CORE EA XEON SERVER and would love it's extra CPU and or a GPU to run these applications.

1. YOLO4 - You Only Look Once Object identification. Open Source, code is available for integration!
This is the most interesting!

https://youtu.be/CtjZFkO5RPw
https://youtu.be/_JzOFWx1vZg

2. npointer - visual gesture recognition platform.
Imagine being able to run and use these on the security cameras of your choosing. Npointer would allow users to make gestures into the security cameras to trigger events (alarms, change channels, etc).


Tie these features into the Zappier plugin and it would give users a very flexible platform that would alert and/or message based on triggered conditional events..

Yolo4 is open source and ready to go now, just needs to be integrated.

What would it take to make a Yolo4 plugin that I could use? 

My system is a 3U enterprise server with 2 CPUs with 6 cores each with 64GB of RAM (Running VMWARE). I am only using less than 1/4 of the resources of the DW NVR. I would love to be able to use the rest of the server or even a GPU to run these to apps on the same system. 

1

Comments

7 comments

Date Votes
  • Danny Ferguson

    I forgot to include the link to the npointer gesture recognition platform..

    https://www.neurotechnology.com/npointer.html#nav_foldable

     

    0
  • Andrey Terentyev
    • Network Optix team
    Edited

    Hello Danny,

    Actually, we have the ready infrastructure for integration.

    - We have programming interface inside the Server

    - We offer Metadata SDK for developing a plugin which could utilize both mentioned libs for object detection.

    - We offer examples of how to create a plugin in this repo https://github.com/networkoptix/nx_open_integrations

    > What would it take to make a Yolo4 plugin that I could use?
    > I would love to be able to use the rest of the server or even a GPU to run these to apps on the same system. 

    So, there is no technical limitation for anybody (including yourself) in creating such a plugin. :)

    1
  • Evgeny Balashov

    Danny, both ideas seem great!

     

    As Andrey mentioned, we have some code examples: https://github.com/networkoptix/nx_open_integrations/tree/master/cpp/vms_server_plugins/opencv_object_detection_analytics_plugin

    They use MobileNet SSD models, but it should be a straightforward process to replace one model with YOLO.

    Please, if you have questions about those examples - let us know.

     

    After that, integrating npointer should be straightforward as well, as long as there is C++ library for it.

     

     

     

     

    0
  • Danny Ferguson

    Thanks for all of your feedback everyone. I haven't programed in over 25 years, back then it was 6502,68k assembly and C++. I am starting  a new business (coming from 30+ years IT support background) that requires the video surveillance. At this time I have no resources to fund a development project like this.. I'm just trying to choke before I get to open the doors.

    In the future that may be a different story.. If I was look for developer to implement this do you have any suggestions? If they are already familiar with implementing on the NX platform that would be  a plus.. 

    0
  • Duncan Miller

    I agree...Object classification is the next big feature all VMS systems need to have. There are some companies offering 3rd party integrations for different VMS systems but some VMS systems are now offering this as a base feature. It will be a basic requirement in the future just like motion detection is today.

     

    0
  • Evgeny Balashov

    What object types are you looking to integrate? And what are user stories for them? 

     

    We have also released OpenVINO object detection plugin for reference use.

    Please check here: https://nxvms.com/integrations/101

     

    We can look into expanding the detection list there.

     

    0
  • Duncan Miller

    I think the basic ones are People, Cars, Bikes, Boats, Animals, Knives and Guns.


    A use case we are using right now is when motion is detected and a person is detected in the motion zone it sends an alert/push notification. We aren't doing this with nxwitness but with a cloud service. This is useful for monitoring construction sites or businesses for outside of business hours.

    Object classification also makes it easier to search for events when you can search for specific objects and their colour. 

    I will play around with this plugin. Thanks. 

     

    0

Please sign in to leave a comment.

Didn't find what you were looking for?

New post