We agree on the estimation/quantification of effort somehow. I only argue that doing it with "relative story points" wastes time.

I prefer points that correlate to reality but are not crazy granular. For example, 1 point equals half a day, and following the Fibonacci sequence leads to 8 points equaling about a week of work, 13 equaling two weeks. The bigger the effort, the more ambiguity in estimation is allowed. Anything more than 13 means it's too big. This is a very high-level simplification.