Can you get audio information from Video Analytics Plugin
Answered
Can you get audio information from Video Analytics Plugin
-
Hello Daniel,
the plugin will request inference to our API server( with the stream of audio from the captured video)
There is no problem to connect from the plugin to your external API server.
Can you get audio information from Video Analytics Plugin
But there is no possibility for the Server to receive binary data from the analytics plugin, neither video nor audio. Only metadata is accepted: detected object type, attributes, bounding box etc... However, that does not mean you can't send any audio-related metadata from the plugin.
Your analytics plugin can open an audio connection to your external server, analyze an audio stream and send metadata to the Sever.0 -
Hi Daniel,
You might find the following 2 articles helpful:
https://support.networkoptix.
com/hc/en-us/articles/ 4410048890135 0 -
Hello Andrey Terentyev,
Your analytics plugin can open an audio connection to your external server, analyze an audio stream and send metadata to the Sever.
What you meant here was connecting audio to external server by getting audio using api right?( like diagram bellow) or is there other way than using http api?
May be coded in device_agent.ccp -> pullMetadataPackets() function ?
Also I cannot find API documentation in nx meta server is that normal? I remember seeing in it in nx witness server
Thanks
0 -
Hello Daniel Hwang ,
What you meant here was connecting audio to external server by getting audio using api right?( like diagram bellow) or is there other way than using http api?
No, I meant something different. :) However, your idea is feasible. You can connect from a plugin to a server via HTTPS API.
May be coded in device_agent.ccp -> pullMetadataPackets() function ?
I wouldn't recommend connecting to the Server (i.e. utilizing API) in the pullMetadataPackets(). Think of the separate thread for pulling audio data from the Server, analyzing and saving extracted metadata to a queue. When the pullMetadataPackets() is called, it would read the queue and pass metadata to the Server.
Also I cannot find API documentation in nx meta server is that normal? I remember seeing in it in nx witness server
You can use either of these locations on your local server for the API documentation.
https://localhost:7001/static/index.html#/developers/api
https://localhost:7001/static/api.xml
0 -
Hello Andrey Terentyev,
Thank you for your help,
No, I meant something different. :) However, your idea is feasible. You can connect from a plugin to a server via HTTPS API.
Could you tell me if there is another way than using HTTPS API?
Such as a way to get an audio stream directly from a plugin?it seems that there is a class related to it ("IUncompressedMediaFrame")
is the data accessible?
========
addedI found this => ICompressedMediaPacketin sdk is there anywhere in plugin to retrieve this and get audio packet ?Thanks0 -
Could you tell me if there is another way than using HTTPS API?
Such as a way to get an audio stream directly from a plugin?I'm sorry, there is no other way but using API.
it seems that there is a class related to it ("IUncompressedMediaFrame")
For now, this class is inherited by the IUncompressedVideoFrame0 and indirectly by the IUncompressedVideoFrame used in the DeviceAgent::pushUncompressedVideoFrame().
So, video data only is accessible. No audio at the moment.
1 -
Ah ha :) Thank you
0
Please sign in to leave a comment.
Comments
7 comments