Analytics Events Metadata - Dahua

Answered

Comments

29 comments

  • Avatar
    Tomasz Polus

    We asked Nx to support bounding boxes in all those new AI and Ultra AI cameras.... They are planning to include that support in 4.1 release, probably next year.....  ?

    2
    Comment actions Permalink
  • Avatar
    Sergey Bystrov

    Guys,

    We are currently working on deep Duahua AI integration. It will be released together with 4.1.
    I would suggest you take our beta-version( it should be available by the end of Jan) and test it and provide us some feedback. 

    Once done, it should be possible:
    - you should be able to get any events form Dahua 
    - AI object traking

    - in client lines/polygons configuration for AI. 

    1
    Comment actions Permalink
  • Avatar
    Campbell Steven

    Thanks Sergey,

    Will 4.1 include the recording of some more of the meta data included with the event? That's the interesting part for me, otherwise having say 4 or 5 tripwires on a camera and not knowing which one triggered in an event is problematic.

    Campbell

    0
    Comment actions Permalink
  • Avatar
    Sergey Bystrov

    Campbell

    Honestly, I'm not sure I completely understand what are you asking(likely it's me). Can you please elaborate a bit. 
    We definitely will record all object tracking info( but I'm not sure if you ask about it). 

    0
    Comment actions Permalink
  • Avatar
    Campbell Steven

    Sure, and I think likely 4.1 will do what I want but just want to try and confirm. Say I have a camera with 6 or 7 tripwires set up on it, with an arrangement of directions and locations of the tripwires so that I can track what happens in different parts of the area.

    At the moment I get an event from NX Witness saying "Tripwire detection (Cross line detection)" which is great. But I've lost all the metadata from that event, so aside from knowing the I had a Tripwire broken I don't know which of the Tripwires it was. So if in 4.1 I'll be able to see not only the Object Tracking info, but also the name of the rule that was broken and which direction it was broken in, e.g. in my capture above "Rule4" "RighttoLeft" is what I'm looking for.

    Going beyond this, once this metadata is stored, being able to historically search for all of the "Rule4" Tripwire breaks in the past would be infinitely valuable for tracking and also tuning tripwires (or other analytics events).

    Hope this makes sense!

    0
    Comment actions Permalink
  • Avatar
    Sergey Bystrov

    makes sense. It will be supported. Thanks. 

    0
    Comment actions Permalink
  • Avatar
    Campbell Steven

    Thanks Sergey, looking forward to the upcoming release.

    0
    Comment actions Permalink
  • Avatar
    Jasper Leenknegt

    Sergey, I am also looking forward to this new integration!

    Do you know if the NX mobile application will support Push Notifications in 4.1? Will there be a preview image come with the push notification? I am know using NX bot created by someone on the forum via Telegram. It would be great if it would be possible to have all this in one application for our customers.

    0
    Comment actions Permalink
  • Avatar
    Tagir Gadelshin

    Jasper Leenknegt
    I accidentally came across your post

    Push Notifications are implemented in 4.1 (https://www.youtube.com/watch?v=MGXYuLkyf-8). Public Beta is available and we are preparing for release now 

    0
    Comment actions Permalink
  • Avatar
    Fredrik Ahlsen

    Hi.

    Can you give an update on this.

    Looks like some new AI features was added in 4.1, but not all.

    0
    Comment actions Permalink
  • Avatar
    Sergey Bystrov

    Dahua analytics is under active development and is on the final stage.

    We plan to start testing soon and release it in the form of a patch at the beginning of sept.
    Looking for volunteers to help us testing( models and fw are slightly different) 

    Can you help us?:-)

    0
    Comment actions Permalink
  • Avatar
    Tomasz Polus

    In short, yes we can :-) Like I promised before, we have lots of AI cameras in our lab and we are ready to help, any time.

     

     

    0
    Comment actions Permalink
  • Avatar
    Sergey Bystrov

    oh I thought you were going to help only with other camera manufacture.

    good, you can help with both. Thanks!

    0
    Comment actions Permalink
  • Avatar
    Campbell Steven

    Also happy to test against the Dahua AI cameras I have.

    0
    Comment actions Permalink
  • Avatar
    Sergey Bystrov

    thanks!

    0
    Comment actions Permalink
  • Avatar
    Fredrik Ahlsen

    I`m also able to test if needed.

    0
    Comment actions Permalink
  • Avatar
    Herman Acker

    I'm curious how the tests are going. If you need more testers, just let me know. I'm happy to test new functionality.

    0
    Comment actions Permalink
  • Avatar
    Fredrik Ahlsen

    Event bounding boxes in the latest patch is a good step in the right direction :)

    Looking forward to the final version with constant bounding boxes and drawing of ROI from Nx.

    In the future I also hope to see all the metadata integrated.
    Here is whats available in to more advanced cameras:

    0
    Comment actions Permalink
  • Avatar
    Tagir Gadelshin

    Thanks, Fredrik Ahlsen
    I haven't worked on integration, but I know from my colleagues that integrating objects and making bounding boxes constant is almost impossible at this point. Mainly due to API limitations on the Dahua side. We did as much as we can, further implementation will be possible only when we have an object detection API. Currently, there is no such thing or it's some proprietary mechanisms that we can't use
    The same stands for drawing ROI, afaik

    maybe we will be able to improve that, but my best guess this will stay as it is now at least for a couple releases from now

    0
    Comment actions Permalink
  • Avatar
    Fredrik Ahlsen

    OK. After some testing I found that the short lived bounding box actually works pretty well.
    Its not perfect, but ROI search for objects work.

    What I think you will be able to add support for with the current dahua API are more objects.

    You already got the face detection event. But its missing all the meta info like sex, age, feature, mask, beard...
    This shoukd be included in the same event on cameras that support it, so it should be easy to add in Nx to I hope.

    16.1.2.15 [Event] FaceDetection - in the API.

    -------------------

    Also human detection. It contains a lot of usefull information that would be great to have inside Nx.

    16.1.3.5 [Event] HumanTrait - in the API.

    ------------------

    It also looks like Smart Motion Detect (SMD) is gone in 4.1 build 32212

     

    0
    Comment actions Permalink
  • Avatar
    Tagir Gadelshin

    Thanks, Fredrik Ahlsen
    I'll check this with our dev team worked on integration.

    0
    Comment actions Permalink
  • Avatar
    Tagir Gadelshin

    Fredrik Ahlsen can you specify what camera did you use (regarding the SMD event)?

    Regarding attributes -- yes, it sounds reasonable, but it depends on how this API is consistent across different devices.  It'll have more chances if we could implement that once for all cameras (not implementing specific logic for each model). We tried implementing this for Face detection event, actually, but it might not work on your camera. Can you also provide the camera model? (and probably we will ask for access if the dev team will decide to fix that)
    But in general, we see current functionality as MVP, and further development will be done after a while, maybe after it is released officially.

    0
    Comment actions Permalink
  • Avatar
    Fredrik Ahlsen

    SMD events I tested multiple models. For example HDBW5442.

    But it looks like its even gone from the list of supported in-camera analytics now: https://support.networkoptix.com/hc/en-us/articles/360056005254-Supported-In-Camera-Analytics

    Attributes will be availble in some series from Dahua.
    Like all other manufactorers this is considered a high end feature.

    So for now its the Ultra AI series: 71242, 7842, 7442 as well as the SDT cameras.

    Post search for attributes is something that is extremely important for larger projects now.
    Without it, we can not even partisipate in the competition.

    0
    Comment actions Permalink
  • Avatar
    Tagir Gadelshin

    Fredrick, we’ll see if we can support attributes for face detection. HumanTrait is not supported and, as I said before, it’s undefined when we will be able to support it.

    About SMD our team says we’ve never supported that. Are you sure you’ve seen that working in and before?
    Maybe it was in some events list but didn’t work, idk. But as you mentioned, it’s not in the list, hence we need to wait till it will be implemented

    0
    Comment actions Permalink
  • Avatar
    Tagir Gadelshin

    Fredrik Ahlsen
    I've created a support ticket (see mail from Support Network Optix). Can you check if you can help us fix the issue with FaceDetection event metadata?
    We need a camera that sends FaceDetection event metadata. All cameras that we have don't send this metadata (but they have FaceDetection event, though)

    0
    Comment actions Permalink
  • Avatar
    Fredrik Ahlsen

    I got it. Will do it as soon as I can. Just need to do the x-mas thing first :)

    Regarding SMD, IPVM tested it and did list it as supported by Nx:

    https://ipvm.com/reports/dahua-smart-motion-tested
    I'm pretty sure I tested it too.

     

    0
    Comment actions Permalink
  • Avatar
    Fredrik Ahlsen

    Any news on the bounding box for Dahua?

    With the new AI search features that will come with 5.0 we really need the bounding box working constantly.

    0
    Comment actions Permalink
  • Avatar
    MAS DAVID

    Hello,

    I have the same problem.
    My IPC-HDBW7442H-Z camera works well with metadata, only "Face & Body Detection" does not work. On the camera the data comes back well.
    In nx, Face & body detection does not appear.

    0
    Comment actions Permalink
  • Avatar
    WallaWalla

    Hello, I am also curious to know if there is any update on video metadata from Dahua cameras. I have been testing with an IPC-HDW5849H and have had very little luck with any of the video metadata being returned properly. The best I get is “bottom clothing color: black”, always, regardless of whether it actually is or not. And for SMD events no metadata seems to be returned at all.

    0
    Comment actions Permalink

Please sign in to leave a comment.