I finally did it, I managed to figure out a little process to automatically
remove the silent parts from a video.
Let me show y'all the process and the two main scripts I use to accomplish this.
1. Use FFmpeg filter silencedetect filter to generate an output of sections