-
Notifications
You must be signed in to change notification settings - Fork 2
Home
AudioVideoAnalysis is designed for realtime spectral analysis of video and audio. by clicking record, you record said information onto the applications Display Window. Alternatively, hit the spacebar
to toggle recording on or off.
Before recording, make sure you have selected your desired device parameters. These include camera device
, camera format (resolution) and general audio settings
such as audio device, samplerate, buffersize etc. The refreshDevices
feature in the video section lets you refresh the video device list if you connect new video hardware to you computer while the application is running.
AudioVideoAnalysis features three distinct section of audio parameters which effect the spectrogram printed in the Display window. These are audio channels
, color
and processing
.
The logarithmic dial controls how logarithmic we want our spectrogram frequency distribution to be. A higher logarithmic value will create a steeper logarithmic curve along the Y-axis of the spectrogram.
the spectral blur effect is, in principle, a vector-sized delay and can be used to create more generalized images of the audio amplitude and frequency content. The spectral blur has 3 modes: no blur
- blur
- lots of blur
.
AudioVideoAnalysis also features clickpoint data retrieval of any recorded audio material. This means you can simply point and click anywhere in the display window and get the Amplitude of a certain Frequency(Hz) at a given Time(sec).
Note: You can use the clickpoint feature, as well as manipulate the spectrograms color and logarithmic frequency distribution, post-recording.
AudioVideoAnalysis also features three distinct section of video parameters which effect the motion/videogram printed in the Display window. These are image selector
, color
and filter
. There is also a preview window that lets you see how the video-feed is processed before being its printed on main display window.
The Image selector lets you either view a videogram or motiongram in the display window. Both images express vertical motion over time, the only difference is that a motiongram has some additional pre-processing which further isolates motion and reduces image noise.
When recording a motiongram, we can use a binary or "regular"(unary) noise reduction filter to reduxe unwanted noise in our video-feed. The differences between these two filters are subtle, but a general tendency is that the binary filter is usually more "radical" than its regular counterpart. The applications preview window can help us see these effects more clearly.
Note: you can also manipulate the motion/videogram color post-recording.
The application also features several display parameters that enables you to pre-configure and view your spectral recordings in various ways. The Display sections features a RefreshWindow
button that clears all content from the display window, as well as a rate
and grid size
function.
Rate controls how long it takes the spectral recordings to reach the end of the display window, or from x-min to x-max, effectively controlling the printing rate of the recording. Thus, a higher rate value will result in a shorter display length. This Total Display Time
is dynamically expressed in seconds in the Display section of the UI.
There are also more display options in the Menubar.
Bring Display to Front
will enable your display window to always be in front of the app UI. Underneath this option you find 4 different Viewing options. These toggle different ways to view your spectral recording in the display window.
Lastly, you can add Analysis markers to our display window by toggeling the View Display Markers
and View Display Grid
options. Futhermore, by configuring the Grid Size
knob in the application UI, you can change the size of your analysis grid. Beware that a grid size of 6 corresponds to a visible 4x4 grid on our display window. This is because it requires 6 vertical and horizontal lines to generate a 4x4 grid.
Note: You can resize the display window by simply clicking and dragging. Furthermore, you can change viewing options and add/remove analysis markers post-recording.
An important feature to the 2.0 version of AudioVideoAnalysis is the ability to export the images we create. It is important to note here that the applications post-recording processing abilities are in place such that we can find good images to export for further analysis.
Have you experienced errors or any strange behavior from AudioVideoAnalysis? If you take a moment and report it to us, you can greatly contribute to the development of this software. Clicking on Help > Report a problem... opens your default internet browser and takes you straight to the Issues page at our Github repository for AudioVideoAnalysis. Here you can click on the (green) New issue button, and tell us about the problem.