Humanism has been criticized as a philosophical and political stance from different points of view in recent decades. The paper summarizes four common types of criticism, stemming from political, ethical, technological, and ecological concerns. These criticisms relate back to a preoccupation with the respect for otherness or difference, either toward human or non-human beings. The paper tries to demonstrate that these concerns are also to be found as essential elements in the development of humanism itself, not only among its political and theoretical opponents. It does so with reference to Erich Fromm’s works, where a life-oriented ethics is coupled with a demand for sustained political relatedness to difference, without giving up notions of a radical humanism and the anthropology that accompanies it.