Enrich motion detection with Object Detection

Answered

Comments

9 comments

  • Official comment
    Avatar
    Norman Graafsma

    Hi Martijn,

    Thank you for the feedback.

    Actually, from v4.0 there will be some AI / Deeplearning solutions be available that work together with Nx Witness with the help of our Nx Meta video management development platform that enables solutions like Darknet YOLO to be integrated into Nx Witness. The only thing is that someone needs to sign up for our Nx Meta platform and create the integration together with our development team. 

     

  • Avatar
    Martijn Dierckx

    Was a feature request created in the backend?

     

    1. Please describe the benefits for us, the developer, you as the integrator, and the end-user? 

      NX: Claim you can optimise storage for users even further, by only recording events that matter. No more false positives. You can also send very specific and accurate alarms. 
      Integrator: /
      End-user: Not only a reliable/stable platform, but also a highly usable and integratable platform

      Downside = bigger investment in hardware needed.

    2. Please describe the use case? How would it improve the use of Nx Witness and what gap would it fill? 

      Instead of recording on motion, you would only record when seeing a moving pre-selected object (car, person, backpack ...)

    3. Lastly, how many licenses would we sell extra if we add this feature? Or how many licenses wouldn't we sell at all is we have this feature? 

      +15%

     

  • Avatar
    Sergey Bystrov

    Martijn

    We will consider making integration with it. The benefits are obvious. The issue is it's a bit hardware specific. 
    You know.. a lot of people have just have HD graphics. 

    But again, looks very cool form demo standpoint(sort of WOW factor)  and very very beneficial for the storage. So we will very seriously consider doing this.

  • Avatar
    Miguel Câmara

     

    Please consider enriching the "Smart Search" feature, where instead of just have true/false in each "square" whether there is motion or not, you could have tags as in terms of objects.

     

    Using YOLO or another object classification AI/Deep Learning Algorithm, you could populate each "square" with the tags, so that we could do a Smart Search for cars in a specific zone of the image, and get immediate results as we already do now for simple motion.

     

     

  • Avatar
    Roman Inflianskas

    Martijn,

    In Nx we have done a lot of research and came to the conclusion that standard solutions do not work Real-Time on the usual hardware (without a powerful graphics card). Now we are developing a solution based on OpenVINO technology from Intel, which allows us to solve Computer Vision problems in Real-Time on Intel processors. The solution is still in the prototype state and will be released with version 4.1/4.2. We will definitely write about the release.

  • Avatar
    Martijn Dierckx

    Keep me posted.
    I’m very curious if this is going to work in virtualized environment.
    But maybe it’s possible to add a Intel Movidius stick to offload the computing?

  • Avatar
    Roman Inflianskas

    Martijn,

    What do you mean by "virtualized environment"? OS running in Virtual Machine like VirtualBox? If so, we've tested that. It works ~30% slower (in our testing environment), but it works fine.

    As I understand the company's tactics, at first, Nx will release plugin for CPU only, and then we will expand to other Intel computing devices, because for sure, people with ARM, for example, would benifit a lot from Intel Neural Compute Stick.

  • Avatar
    Martijn Dierckx

    Thanks for the info.
    Do you have any idea on the timeline?

  • Avatar
    Roman Inflianskas

    Martijn,

    Unfortunately, I have no idea, because this feature will not be included into 4.0 (we already passed feature freeze), and release dates for future versions of Nx Witness are not determined. But we understand that this is a long awaited feature and will release it ASAP.

Please sign in to leave a comment.