FFMPEG Advanced Techniques Pt1 - Advanced Filters
Вставка
- Опубліковано 2 лип 2024
- In the past, we've worked with FFMPEG as a conversion tool, but in fact, this little command line utility is so much more! We kick off this two-part series by first delving into some of the more interesting filters provided by the program!
= 0612 TV =
0612 TV is your one stop for general geekery! Learn about a variety of technology-related subjects, including Photography, General Computing, Audio/Video Production and Image Manipulation! Enjoy your stay, and don't hesitate to drop me a comment or a personal message to my inbox =) If you like my work, don't forget to subscribe!
If you're interested in showing monetary support, consider making a recurring donation at: / lcc0612
Alternatively, you can send me a one-off payment via PayPal. Click on the "Business Enquiries" button to reveal the email address on this page: ua-cam.com/users/lcc0612about
More about me: about.me/lcc0612
Official Twitter: / 0612tv
-----
Disclaimer: Please note that any information is provided on this channel in good faith, but I cannot guarantee 100% accuracy / correctness on all content. Contributors to this channel are not to be held responsible for any possible outcomes from your use of the information.
![Fix Noisy Grainy Footage with FFmpeg [Denoise Filters Deep Dive]](http://i.ytimg.com/vi/I9-VEUs1ZsE/mqdefault.jpg)
6:03 Just a note, the command “ffmpeg -filters” shows a summary of all available filters, while “ffmpeg -h filter=«filter»” gives information about how to use the filter named “«filter»”. So, for example, “ffmpeg -h filter=eq” gives help on the equalization filter.
Hello and thank you for your comment! Thank you for sharing! Useful to know.
What a great video! Much higher quality than the average found on youtube.
Hello and thank you for your comment! Glad you liked the video =)
Very informative video. Thanksfor sharing.
Hello and thank you very much for your comment! Very happy to be of help =)
Your videos on ffmpeg are awesome. Simple, clear, effective, visual examples. Awesome.
Hello and thank you very much for your comment! Thanks for hanging around and checking out my videos, glad they were useful for you =)
-filter_complex_script filename
This is much better than trying to inline a complex -filter
Hello and thank you for your comment! That's cool, I learnt something new here. Yes, definitely much easier to make adjustments than if it was written inline.
Thanks for the videos on how to use ffmpeg, is so much fun mixing videos with overlay ❤️
You're welcome! Glad to be of help =)
@@NERDfirst the most important part for me, learned from your tutorial was the notation of In and Out. I was wrongly thinking for a long time that the information between square brackets must be like [0:a] or [0:v] and should be strictly in this way written. I had some old AviSynth scripts from 2013 that I could not longer use under Linux, than I found your video in YT recommendations few days ago and so I could transform the video mix ideas from AviSynth into FFMPEG scripts :D
Phenomenal video! Thank you so much!
You're welcome! Glad to be of help =)
*Expand for Notes*
*1. Filters interchangeable between images and video*
In case you're wondering, yes, those filters that I applied to images also apply to video! I used images to simplify the explanation, but you can absolutely use them in the exact same way with video files. Sorry for the confusion!
*2. On Debugging and Help*
Unfortunately due to high IRL workloads, I'm not able to look at your command calls and help diagnose problems. You may contact me at hello(at)nerdfirst(dot)net for paid consultation, if you really see the need.
Fantastic work.
Thank you very much! Glad you liked the video :)
Wow this is help me alot to understand the filter. Thanks for this education.
You're welcome :) Glad to be of help!
This is a beautifully made video. It was very clear and useful. If you had a Patreon, I would donate to you immediately for your service.
Hello and thank you very much for your comment! Happy to be of help =)
I do actually have a patreon (patreon.com/lcc0612). I also accept one-time donations via paypal. Thank you very much for your support!
Thanks for helping me learn the ffmpeg,
Just for fun -
Matrix - We see the simulated world in form of matrix
0617 - I prefer "vectorscope"
Very well done, thank you
You're welcome! Very happy to be of help =)
This is awesome - I really love the last demo at the end - did you ever publish the FFMPEg command you ran?
Hello and thank you for your comment! I don't believe I have, I'm afraid! It's a combination of several of the filters shown in the video. Mostly overlay and waveform.
Freaking awesome info Video! been looking for this, thanks for the clear explanations and guide! anyway you could make a video on using ffmpeg for multi bitrate profiles with rtmp streaming to hls? and explaining the different options available to you?
Hello and thank you for your comment! I wouldn't know where to start on this as I have never used FFMPEG for streaming before! However, this _is_ one of the more powerful and less-known features of this platform, so I'm definitely interested in exploring! I may do something on streaming eventually though I don't know if I'll ever address what you're looking for I'm afraid!
great video 👍 thanks for sharing
Hello and thank you for your comment! Glad you liked the video :)
Thanks you, I got a satisfactory video.
You're welcome! Happy to be of help =)
Thank you 0612! Very informative, appreciate the time you took to make this video. :) Do you know if it is possible to specifically change the pitch of a video to the exact pitch you want? For example to the musical note C4? Thanks!
Hello and thank you very much for your comment! Glad to be of help =)
For what you wish to do, it doesn't seem that FFMPEG gives you a direct way of doing it. You'll have to first change the overall sample rate of the audio track (thus affecting both pitch and tempo), then using the atempo filter to revert the tempo back to the original. Source: superuser.com/questions/292833/how-to-change-audio-frequency (refer to the answer with the lower score).
Based on what I'm seeing though, you may have better luck using a different tool.
@@NERDfirst Hi and thanks a lot for your quick reply! I actually managed to change it the way you suggested. But the problem is I can't determine if the pitch is now at C4 or A3 or any other musical note that I want it at haha I found a way to lower and raise the pitch I think. Now I just have to detect the frequency of the sound file (it is just a 1-2 second file that I want to be able to change). Do you work as a Software Engineer in Singapore? Thanks again and have a great day!
Hello again! You're welcome! FFMPEG will not detect the "original" or "starting" pitch of your file. You'll have to figure that out yourself first somehow (you can try using Audacity's spectrograph), and then calculate how much you have to adjust the sample rate.
I'm not a software engineer (though I am computer science trained). I work as a freelance educator =)
very nice video, thank you!
You're welcome! Very happy to be of help =)
OMG so nice THX!
You're welcome! Glad you liked the video!
Great Job !! THX !!
You're welcome! Very happy to be of help =)
Thanks man 👍🏼👍🏼
You're welcome! Very happy to be of help :)
Made damn well, by any chance do you ever try id3v2 chapters management for audio files with FFMPEG?
Hello and thank you very much for your comment! Glad you found the video useful =)
I'm afraid I don't have experience with chapter management. However, the metadata portion of the documentation seems useful, perhaps you can start your search there: ffmpeg.org/ffmpeg-formats.html#Metadata-1
Wonderful
Hello and thank you for your comment! Glad to be of help :)
Nice!
Hello and thank you for your comment! Glad you liked the video =)
nice, thanks!
You're welcome! Glad to be of help =)
Thank you for the video, please explain one details: what is p9 in yuva444p9 ?
You're welcome! According to the FFMPEG source code, p9 seems to refer to 9 bits per pixel.
Source: ffmpeg.org/doxygen/trunk/pixfmt_8h_source.html (refer to lines 182 and 183, explanation at line 153)
Can you tell me how to vary the timecodes that I'm using with my frames. Like incrementing 1 second to the timecode for example.
Hello and thank you for your comment! I'm afraid I've never done this before, but you may want to check and see if the -timecode option can be of use to you. Scroll up a little in the following link to see: ffmpeg.org/ffmpeg.html#filter_005fcomplex_005foption
Thanks for this video It's very hard to find examples of these filters.
You're welcome! Yeah, I think demonstrations of filters can make it clearer on how they work!
i like the audio ones
Hi! Great Video! Amateur coder here. I was just going to ask if the filters can be applied and be changed without interrupting the video being played? THANK YOU SO MUCH FOR YOUR TUTORIALS!
Hello and thank you for your comment! As far as I'm aware, if you're calling ffmpeg from the command line, you cannot switch out or add new filters. However, for filters with a disable function, you may be able to switch them off or on during certain timestamps, using the "t" parameter.
Sir, how to add utf-8 subtitles to video using ffmpeg. we are seeing the letters distorted kindly help
Hello and thank you for your comment! Unfortunately I have no experience in this. However, you can check if you've specified an encoding correctly: en.m.wikibooks.org/wiki/FFMPEG_An_Intermediate_Guide/subtitle_options#Set_Subtitles_Character_Encoding_Conversion
So, for the inbuilt filters of a phone gallery or say snapchat filter, does selecting a filter indirectly runs ffmpeg in the background?
Hello and thank you for your comment! _If_ we know the app uses FFMPEG, then yes, very likely the image data is passed to FFMPEG, FFMPEG works its magic, and the output is taken and displayed back to you. The program saves it to disk when you call for it to.
THANKS
You're welcome! Glad to be of help =)
Hello, How to change some particular frames as compression effect(macro block) in a video.
Hello and thank you for your comment! I'm not sure I understand what you're trying to do. Could you elaborate further?
Thanks for the great tutorial..
I want to make video with images and want to add different animations between the images..
I've done with first part..now i want to add animations between different images..
Can you help me with this?
Hello and thank you for your comment! Sounds like you want to create a slideshow with transitions! I'm afraid I haven't done that before, but I see some interesting discussions on superuser that would probably be useful for you! Check it out: superuser.com/questions/1189246/ffmpeg-image-slideshow-with-zoompan-and-fade-in-out
Useful video ...
I've converted a file from ts to mp4 using ffmpeg....although it has 1280x720 resolution, the picture quality of the video is blurry....
Hello and thank you for your comment! You may want to use the -q or -crf options to adjust the quality. For more: ua-cam.com/video/MPV7JXTWPWI/v-deo.html. Discussion starts at 5:19 in that video.
thanks for the video, but how do you specify the output video framerate for the showwaves filter?
Hello and thank you for your comment! You can specify the frame rate using the rate option, eg. "showwaves=rate=30" for 30fps output.
thanks for the reply, but the video will still encode in it's default framerate value which is 12.5fps.
This is what I typed :
ffmpeg -i "My sweet lord.flac" -filter_complex "showwaves=rate=60:mode=cline:size=3840x1440" sample.mp4
EDIT: this didn't work either:
ffmpeg -i "My sweet lord.flac" -filter_complex "showwaves=mode=cline:rate=60:size=3840x1440" sample.mp4
Hello again! Sorry about that - Looks like you need one more -r switch! This worked for me:
ffmpeg -i x.wav -filter_complex "showwaves=rate=60:mode=cline" -r 60 sample.mp4
thanks a lot man, appreciated your afford!
You're welcome! Glad to be of help =)
So for a work project, we are trying to find a way to determine how much entropy/movement occurs within the first couple seconds of an advertisement video for some ACR technology testing. I know FFMPEG has an entropy filter and I've played around with it and see that it lists the Y U V but wondering if you have any experience in using the entropy filter for FFMPEG and if you could explain it?
Our end goal is to run a script that downloads a video, analyzes the entropy of the first x amount of frames, and if that video has X value of entropy, delete and do not upload. Our platform has a hard time identifying videos with low entropy in the beginning frames. Just not sure the best way to create a "grading" of a said video based on how much entropy exists.
Hello and thank you for your comment! What an interesting use case! I have not used the entropy filter in FFMPEG before, so I can't really guide you in a practical context. I've had a few test runs and also taken a quick glance at the filter source code though, interesting stuff.
As you can imagine, large YUV values indicate large changes. (Maybe using Y alone is enough, as that is the brightness - Changes in brightness are far more easily detectable than changes in color).
What I would do in your situation is to have a script that calls FFMPEG to perform this analysis, and get an average of the returned YUV values. Use a few videos that you deem are acceptable or unacceptable to determine a threshold. Put your threshold in your code and you're good to go.
would you know how to make an audio lowpass filter stronger? i currently have "lowpass=f=400" in my "-filter:a". I want to cut off/dampen the frequences above 400 even more
Hello and thank you for your comment! One way to do this is to chain the filters several times (ie. Apply multiple instances of the filter), though it's not the most elegant solution. Reference: stackoverflow.com/questions/60787686/ffmpeg-lowpass-filter-increase-roll-off
@@NERDfirst thanks too and yes that's what i'm already doing, but it lowers the volume on all frequencies instead, tried increasing the poles, but limited to max of 2
You can do a normalization after the filter passes to bring the volume back up. Try the loudnorm filter.
@@NERDfirst thanks i ended up using "asuperpass=centerf=%center%:order=20" for a slightly better effect
Glad you figured it out!
Is sharpening filter syntax only for the image or the video file?
Hello and thank you for your comment! It works for videos as well.
hey man do you know how can i split a video file into multiple files using ffmpeg ? in a super fast way ?
Hello and thank you for your comment! You may want to refer to the following source: unix.stackexchange.com/questions/1670/how-can-i-use-ffmpeg-to-split-mpeg-video-into-10-minute-chunks
Use -c copy to avoid re-encoding, which will make the process faster.
Hi Icco612
Another great video mate! I saw what I believe to be Marina Bay Sands, so I guessed you were Singaporean!
Would like to ask you about your username and channel name! What is the significance of those letters and numbers? :)
I can see some of those filters possibly being useful if one wants to apply some quick colour correction to ones footage. Guess I will have to experiment one day! Anyways good to know what possibilities exist, so thanks for detailing out here what else we can do with FFmpeg.
By the way... just curious... what things are you currently working on or playing with at the moment image/video/tech wise... ?
Have a great weekend mate!
Hello and thank you very much for your comment! Yes I'm Singaporean, and what you saw in the video was indeed MBS!
lcc0612 comes from my name and birthday. It's horrible in terms of marketing because nobody can remember it =P
Unfortunately at present moment I'm quite overwhelmed with work so I haven't been experimenting a lot with image / video. My work actually puts me in contact with quite a bit of robotics and microcontroller platforms so I've been playing with those a bit!
Have a good weekend too!
how can we combine the frames in order to make a video without any loss using ffmpeg?
Hello and thank you for your comment! It's not very clear what exactly you're trying to do and what result you are expecting, but it sounds like you want to encode a higher frame rate video down to a lower frame rate one by combining frames?
If so, the filter involved is: -vf "tblend=all_mode=average" -r
You can manipulate the -q:v flag to further tweak quality if needed.
So how would I change the video encoding to SW libebml v1.3.7 +
libmatroska v1.5.0 ?
Hello and thank you for your comment! You can refer to the list of FFMPEG codecs to see if FFMPEG supports the codecs you are looking for. You may need to research further on alternative names, if they don't come up. www.ffmpeg.org/ffmpeg-codecs.html
Use the -acodec and -vcodec switches to set the codecs as necessary.
Although my English is very poor, only the so-called "Continental English" (speak Hungarian and German); nevertheless, this tutorial is useful for me, both for learning the language after voice and for the well-visible command line patterns. Thank You.
I was looking for a solution to image sharpening so I found your tutorial movie. I understood almost everything you said and presented on the subject, but unfortunately this doesn't work for me. Looking further, I discovered that there was a problem with the syntax. Maybe the 3 years difference, but today my FFmpeg doesn't accept >> -filter ”unsharp = lx = 3: ly = 3: la = 1.0”
Hello and thank you for your comment! FFMPEG was trying to apply unsharp (which is a video filter) to the audio channel of your file. Instead of writing -filter (which works in my example because I was using a single image), use -vf instead, ie:
ffmpeg -i [input filename] -vf "unsharp=lx=3:ly=3:la=1.0" [output filename]
Hello bro, can you help me out please. I have a list which contains pairs in the form of (startTime, endTime). I want to lower the volume of all the portions of an audio represented by the elements of the list. I can do it manually by using the volume filter of ffmpeg but i have to write a very long filter demonstration. Can you tell me a method so that i can store the filter description in a text file and then write an ffmpeg command which reads the filter description from the text file
Hello and thank you for your comment! I have not come across any FFMPEG feature that allows this. Seems like you'd have a better time using a full-blown programming language for this level of automation.
'well..' it was a wonder full tutorial :)
Hello and thank you for your comment! Glad you liked the video =)
Could you give a sample code to shrink a video?
I'm getting always errors!
Hello and thank you for your comment! Your code would look something like this:
ffmpeg -i infile -vf "scale=640:480" outfile
Replace "infile" and "outfile" with your desired input and output file names. Replace "640" with your target width and "480" with your target height. If that doesn't work, please copy the error message you're getting so I can better help you!
Awesome information can you guide me how i can use these filters in android app development
Hello and thank you for your comment! I don't have any experience with android app development so I can't comment on this.
besides ffmpeg, where else can we get the waveform of a audio channel
Hello and thank you for your comment! For me, I use the Audacity software to view and edit audio files. www.audacityteam.org/
I use audiowaveform. Get the binary from the github and read about the different command line options. It is easy to use and it's actually what audacity uses under the hood to generate it's waveform images.
Hey how can add muliple transition like fade,swap,circleopen in multiple video concat in one single video
Hello and thank you for your comment! Unfortunately if you're planning on using multiple videos / transitions things may start looking less pretty! I haven't tried it myself but I found someone else trying to do the same thing: stackoverflow.com/questions/35852622/combining-videos-with-ffmpeg-using-crossfades-and-plain-cuts
thank for helping
please tell me more about to make attractive multiple transition on images or video
I see no link annotation at 1:45. Just thought I'd let you know.
Hello and thank you very much for your comment! I've just added it in now, though it doesn't appear as an annotation, but as a card on the upper right. Didn't realize UA-cam has completely removed it's annotation editor.
Ah, yes. I see it up in the top-right. Thanks.
No problem! I did add it after your comment, so thanks for letting me know!
hi , can i add text in movie parmanent without adding .srt file in text base with timeline
Hello and thank you for your comment! Yes, you can use the *drawtext* video filter. For more info: stackoverflow.com/questions/17623676/text-on-video-ffmpeg
thankyou! very useful.:ok:
You're welcome! Glad to be of help =)
Hi ! i am interesting in filter asr . How use this filter whit mkv video to recognition speak? sorry for my terrible english a Im Argentinien! tanks
Hello and thank you for your comment! I'm afraid I don't have any experience with this filter, and it seems to me that the ready-to-use Windows versions of FFMPEG don't actually have this filter enabled. Seems like you need to compile the program from its source code if you want to use this feature. If you want to do speech recognition, you may have to consider some other way.
@@NERDfirst whats other way? I am student phd physics in Unne corrientes Argentina
I want an API where I can transfer pixels each frame to something that will store it as a mp4 file ...
Sequencing pictures are really annoying...
Hello and thank you for your comment! Hmm... While not really a use case I have any experience with, you might want to consider working with local frameservers, which can serve up video information without writing intermediate files. FFMPEG can then read from that frameserver and write a video file.
very int video
Hello and thank you for your comment! Glad you liked the video =)
kudos bro! good video! you must do more tutorial video on FFMPEG and earn from youtube!
Hello and thank you very much for your comment! That's the plan =) If you have any more requests for FFMPEG content (after next week's episode), feel free to let me know and I'll see what I can do!
i was actually searching on how to download video & getting url of videos embedded on website & came across your video. great job keep posting.
Can I use bot vf and filter at the same time
Hello and thank you for your comment! You'd probably not want to do that, since -vf is already an alias for -filter:v.
@@NERDfirst ok
You have 43 000 followers and this video has exactly 43 000 views as I am watching it. Just had to say this.
Wow cool! Grateful for all the support =)
can you do this for android / ios libs?? it will be useful
Hello and thank you for your comment! An interesting idea! Unfortunately I don't code for mobile natively so I won't be able to cover specific Android / iOS tools, but maybe some of my favorite python modules...
Is there any dehalo filter ??
Hello and thank you for your comment! FFMPEG does not have a filter called dehalo. However, you may want to refer to the FFMPEG filter documentation to see if there's anything else there that fits your needs: ffmpeg.org/ffmpeg-filters.html
@@NERDfirst so do you think it is better to do deinterlacing and then removing halo and ghosting ?? And what is the best method for removing ??
The order depends on the source of the problem. If ghosting appears _over_ the interlace lines, you might get better results if you remove those first.
But ultimately, what methods you use and what order you use them in requires trial and error. There's no single best method.
Hi, if you help me as a Programmer it will Really appreciate.
1. How to add effects using ffmpeg in the video. (If yes then how many effect in ffmpeg)
2. How to add Background image in the writing page.
3. Last how to add speed option using ffmpeg ( 1x ,2x 3x speed in video)
Thank you in ADVANCED.
Hello and thank you for your comment! With regard to how to add effects, you may want to refer to the basics video: ua-cam.com/video/MPV7JXTWPWI/v-deo.html
For the speed effect, the effect I've used before is SetPTS: ua-cam.com/video/ckCuy7dmyPI/v-deo.html
For more filters, refer to the FFMPEG filters documentation: ffmpeg.org/ffmpeg-filters.html
ffmpeg -i output.mkv -filter "unsharp=lx=7:ly=7:la=1.5" newoutput.mkv
the command doesn't work. Its l not 1 right? la instead of 1a? lx ; ly etc? Still doesnt work
cannont connect video filter to audio input
error reinteitiliatin giflters
fialed to inject frame into filter network: invalid rgument
erroe while processsing the decodded datat for stream 0:1
conversation failed
Before I delve too deep into this, let's address the obvious first.
Using "-filter" may tell FFMPEG to target both video and audio streams. Try using -vf (or -filter:v) to target only the video stream first.
okay using -vf instead of -filter worked properly on an mkv file (not so much on a .flv, made it go from like 1080p to 240p quality wise).
Can you show us how to convert .anyvideo to .gif without loosing its quality thanks
Hello and thank you for your comment! Firstly, please clarify - When you sat ".anyvideo", is there a particular file format with that extension you're looking at? Or do you mean any video in general?
Second, actually it's not quite possible to convert a video to GIF without loss of quality because of the way GIF represents color - Every pixel can only be one of 255 colors (aka 8-bit color) which is not quite enough to represent the full gamut of colors in a video.
sir can u play a mp4 file (AVC1 libavcodec h264)
Hello and thank you for your comment! That sounds fairly simple, but I'm afraid I can't advise further without knowing the context to your question.
hy how to concat multiple videos
Hello and thank you for your comment! Some ways are discussed here: trac.ffmpeg.org/wiki/Concatenate
@@NERDfirst hy but the problem I'm facing is that im using react native ffmpeg and I need to merge multiple videos from state and there is no proper documentation in react native ffmpeg
This seems to be something you have to take up with the folks who have written the react native ffmpeg tool. I have no exposure to that.
Regardless, if you are able to find out how to use filters with that tool, you can consider the concat filter. ffmpeg.org/ffmpeg-filters.html#concat
The filter is called unsharp and it sharpens. Probably went with the wrong name on that filter there.
Hello and thank you for your comment! Are you referring to some part of the video, I think I got it right? Unless I've got a typo somewhere =)
Hey ! I have a high level technical question to ask you about FFMEG and would pay you for your help. At which e-mail aaddres could we please communicate ?
-filter:v is the same as -vf ??
Hello and thank you for your comment! As far as I'm aware, yes, they're the same and I use them interchangeably.
contrast =-100
Shadoe=+30
White=40
Black=15
Temp=5183k
Tint=30
Saturation=75
Orrange=45
Yellow=35
clarity=-55
Dehaze=-5
Can you convert this preset into code. It is lightroom preset
Hello and thank you for your comment! It is unlikely for there to be an easy, direct correspondence between a set of FFMPEG filters and a lightroom preset. Experiment about with FFMPEG's filter options to see what options best recreate the desired effect!
do a video on labels ([in] [out] [0] [0:a] [0:v] [a] [v]..)
Ridiculous ffmpef does not have a decent GUI.
Hello and thank you for your comment! It is unfortunate, but seeing as that FFMPEG is free and open source, and non-profit, I'm glad it exists in the first place!
If you prefer GUI, you can look for ones created by third-parties. I used WinFF in the past and it was pretty good for basic conversions and storage of settings.