AI Driven Audio Noise Reduction for Free in FFMPEG (RN Noise)

FFMPEG is an incredibly powerful free open source audio and video processing tool. This time we're going to look at how to use the arnndn filter. This is FFMPEG's implementation of the RNNoise deep learning or AI noise reduction system. This process behaves similar in it's underlying operation to Nvidia's RTX Voice or DaVinci Resolves Dialog Isolation. That said, it does lack the easy one click operation of the commercial options.
This video is tarted at beginning film makers that are short on budget but have at least as little in the way of computer skills.
🔗 My FFMPEG Playlist - • Video and Audio Proces...
🔗Installing FFMPEG on MacOS and Windows - • Basics of Installing a...
══════════════════════
💵 Support the Channel and Content Like This 💵
══════════════════════
⯈ Click the Thanks Button under the video.
⯈ Use PayPal: paypal.me/pointsinfocus
⯈ Buy yourself something from the affiliate links below.
══════════════════════
Gear I Use to Make Videos
══════════════════════
(Affiliate links)
⯈ Canon EOS R5 - amzn.to/3uJNNVI
⯈ Canon EOS R5C -
⯈ Anker 747 USB Power Bank for R5C - amzn.to/3i5hIEd
⯈ Canon RF 15-35mm f/2.8L IS USM - amzn.to/37SuLDw
⯈ Canon EF 16-35mm f/4L IS USM - amzn.to/3Oi7YBO
⯈ Canon RF 24-70mm f/2.8L IS USM - amzn.to/3M9I0yQ
⯈ Rode NTG2 -
⯈ Rode Wireless Go -
⯈ Zoom F6 - amzn.to/2TWsSvo
══════════════════════
Chapters
══════════════════════
00:00 Intro
01:24 What is RN Noise?
02:07 Does it really work?
04:02 Getting and Using Noise Reduction Models
09:14 Using RNNoise in FFMPEG (Command creation)

[@epicportriter]

First like first viewer🎉

[@PizzlesTechTime]

Thanks!

[@PointsInFocus]

Thanks for the support, it's much appreciated.

[@PizzlesTechTime]

@@PointsInFocus No problem brother. I got one the other day from a random viewer. I realized, if we all operated anymore grateful manner, The world would be a better place. You are helping so many people with your videos.

[@PizzlesTechTime]

Yeah I have been using the AI voice enhance in Adobe premiere and have had mixed results. Surprisingly if the audio is good it works well. Although it is still a very new feature just came out of beta last month. I had no idea about RTX voice I did download some of the Nvidia software but I didn't see a way to implement it. At least other than streaming. I'll have to look into the Nvidia voice thing

[@PointsInFocus]

RTX voice can be really impressive. Linus Tech Tips did a video on it where it basically eliminated his kids screaming and playing in the background. That said, the problem with it is that it's designed for realtime processing only, so running something through it in post is doable but it's a real pain in the rear.
That said, there's at least a few companies that are doing AI voice isolation/noise reduction specifically that may have plugins for Premiere Pro. I would expect a company that specializes in it will likely have better models and better performance than Adobe's implementation.
But as I said in the video, this isn't a panacea solution to every problem. You still have to do everything you can in the field to maximize the SNR and get as good of a starting point as you can.

[@PizzlesTechTime]

So I have been sharing your videos with a few of my friends in video production. The information is so valuable and helps me so much. I am hearing people say you're long form videos would probably translate pretty well into shorter clips. Optimizing each video for a specific question. Or I guess that would be a UA-cam Short. Have you thought about using the editor in UA-cam to upload portions of your videos as shorts?

[@PointsInFocus]

I have looked into doing short form content. I'm not sure I want to do shorts, as I hate vertical video. That said, right now it's a problem of time and resources. I haven't figured out an efficient enough processes to make time to fit that in and make it work.

[@PizzlesTechTime]

@@PointsInFocus well I certainly understand that I am scrambling around working full time and trying to upload to 10 different sites. Reading my comments, I'm sure you have picked up on my anxiety. 😂 There is an AI editor that does a really good job making shorts. It even adds captions but the free version is very limited. It is called Opus Pro. I have used it in a few instances and was fairly impressed. I do not care for short form content either. It benefits the creator very little and often is less engaged with. Unfortunately, the internet seems to be incentivizing shorts with more and more viewers vertical short form video.

[@Twobarpsi]

​@@PointsInFocusI like your long videos.

[@PointsInFocus]

@Twobarpsi, then I have good news for you,. they're not going anywhere.
I tried a couple of UA-cam shorts, and the ROI on them was pretty bad. I am always looking for ways to make my longer videos more concise, especially finding ways to better use the medium, but I don't want to compromise on depth and detail. The way I see it, if I do that, I might as well just stop making them as I'll be doing the exact same things as everyone else.

[@Twobarpsi]

@@PointsInFocus I like your subjects, format, and presentation style. Top notch!

[@PizzlesTechTime]

I started getting audio interference using my DJI Mic. Found out the mics on top of my tascam recorder were causing interference. I took those off and I am still getting a robotic like interference that has aggravated me enough to buy the new DJI Mic.... Probably should have got the rode version lol.

[@PointsInFocus]

The problem with wireless mics is that they're wireless. Both DJI's and Rode's operate on the 2.4 GHz ISM (industrial scientific medical) band, basically where everything else that has a radio in it operates. They can be interfered with by the bluetooth and Wifi radios in your phone, computer, the WiFI network in the building your in, microwave ovens, you get the idea.
The best solution with these inexpensive systems is to get one that can record on the transmitter so you have a recording there that you can use in the even the remote recording is messed up.
If you want wireless and much more protection against interference, you need to look at the professional systems from someone like Sennheiser. They use different radio frequencies that aren't in the normal range where everything operates.

[@PizzlesTechTime]

@@PointsInFocus That makes a lot of sense. I did know about the transmission issues before but I never really had an issue until I started using the tascam recorder. The top two microphones cause the receiver to malfunction and both microphones on the recorder get a high pitched squeaking noise. I took those out of the picture and the transmission interference still happens. I'm going to set the DJI Mic to record automatically from now on. That also gives you 32-bit float point audio with the DJI Mic 2 or the rode wireless Pro. I am guessing it is Wi-Fi signal from a network extender nearby.