We all do!
It’s a big and quickly changing world. There are many possibilities, most of which are not apparent yet. Self-limiting statements like these always throw warning flags for me. Maybe that wasn’t your intention.
Trig is definitely helpful for figuring out how to place, draw or move things even for simple games. And algebra is helpful for trig. But algebra is also a pretty wide-ranging subject.
I think if you plan to rely on using ‘game engines’ for coding, you can probably avoid a lot of math. But you will be limited by the bounds of the engines.
If you want to code without engines, or create an engine or component of an engine, you are going to have to know enough math to at least pick and implement the right “recipes” on an as-needed basis.
If you are in school at the moment and having troubles, it could be a result of difficulty working with a particular teacher or text. A teacher with another style might present the material in a way that works better for you.
Also, math is not something you can learn by only giving it surface or split attention. It is more like a muscle that grows in capability with use. It requires some patience, a willingness to take some time with each step. I think this is probably the case because one is creating new neuronal connections (similar to creating or strengthening muscle mass?). These connections make it easier to “visualize” steps. But those connections and resulting mental skills won’t grow unless you actually use them.