MightyBigCar is a user on octodon.social. You can follow them or interact with them if you have an account anywhere in the fediverse.
If you don't, you can sign up here.
Look, Wiley E. Coyote Super Genius shell programmer, bash + awk is not the right combination for heavy duty statistical stuff, especially if you have to process a few thousand files of over 100MB each. And particularly don't fork each file's handling in an awk process inside a bash for loop. We've got languages & libraries intended for this sort of thing: octave and matlab and scipy and R and more, all installed and ready to use.
Great googly moogly! It gets worse - Wiley doesn't even wait for all the processes in the forkbomb to complete before merging their outputs and generating & reporting the final statistics.
Which means we've been making engineering decisions based on a non-repeatable process.
Is it beer o'clock yet?
