It's a problem when people freeze to death, suffer extreme droughts, and wild fires threaten anything that can burn.
It will be a problem for you when the power goes off and fuel supplies are cut, and the basement fills up, and the roof blows off, etc.
And it's not only humans that suffer; all the native species who don't have heating and air conditioning and social security suffer much more than us.
Sure it can be, and may be a natural phenomenon, but that doesn't make it a good thing; and if there is any way to limit the damage caused by climate change, it should be pursued. Anthrax, arsenic, and asbestos are natural too.
4.5 billion years ago, humans weren't complaining about the weather.
If humanity and all other animal kind is to last longer than a blink of the eye in geological time, then someone has to do something to limit the damage coming for us, no matter what the source is. Whether we created the problem or not.
So doing nothing or blaming everyone else will get us nowhere, or dead quicker.
Eventually we will have to deal with extreme heat and radiation, and little atmosphere, extreme cold, and move away from our solar system, before the sun becomes a red giant.
Get used to climate change, nothing lasts forever.