Mathematicians are interested in trying to make sense of this kind of puzzle, which often comes up in physics too. As a teaser, let us prove that
As another example, let us talk about the sum of all natural numbers
In physics, singularities pop up here and there, which we are not well-equipped to deal with. But we can go past the singularity and find that there are still well-defined points beyond it. This is why ideas from complex analysis are helpful for theoretical physics. When we encounter this kind of infinite series, we try to proceed analytically, which means we try to come up with functions, such as the zeta function, that make sense even in regions where one would not expect them to. Sometimes the way to proceed analytically may not be unique, but if several methods gives us the same answer, then we can be more confident that we can use it in a physical theory.