This is basically not true. The particular makeup of the calories you're consuming matters. E.g., it is likely (but not proven) that dietary fiber is causal for reducing rates of common cancers. And also likely that dietary saturated fats cause various kinds of heart and artery disease. Similarly protein is important for muscle mass which is associated with longevity. Additionally, people who are already underweight should not reduce their calorie consumption.