It's definite he's sitting there on his l33t skills gamer chair waiting for the captions to generate, and then manually deleting them? These transcriptions were already fun for the shear absurdity of them. This fittingly absurd reaction from him is a delicious little twist.
Pretty much:
https://support.google.com/youtube/answer/2734705
So yes, you can remove them easily, but you cannot set it up to remove all auto generated subtitles from past videos or future videos. You have to do it for each fucking video. As they're uploaded. You can't even set it when its uploading, you have to wait for it to fully upload, fully process and then generate the captions (which is usually a wait of as long as the video is) and then manually delete them.