Math is, sadly, one of the worst-taught subjects out there. There is no reason it needs to be dull or - below collegiate level - excessively difficult. What it needs is to be taught by enthusiastic teachers to students whose parents support them and understand that failing a lot in order to succeed once is a perfectly decent way to make it as a student. Unfortunately, far too many of us hit a wall and feel too embarrassed or stupid to say so, then we don't get the tools we need to realize that we can actually get over that wall and scale the giddy heights of numeracy.
Smartphones only make this problem worse, by masking mathematical illiteracy behind the veil of tip-calculating apps and suchlike. However, you do need to be able to do mental arithmetic and to know mathematical concepts and ideas without using anything that has an "on" switch. You need this because the language of math underlies everything we do. It helps keep your brain flexible and ready for work, and stops you having your life ruined by the errors of your accountant, bank or landlord. Math fluency is a vital life skill. Do you have it?