This article starts by identifying the crucial importance of the notion of historical handicap for the present-day social sciences of Latin America. Such notion is not an original invention made by Latinamericanists. On the contrary, I demonstrate that the genealogy of the notion of historical handicap must be sought in the tradition of Western political philosophy. Such genealogy must take into account the way it was integrated into ethnological descriptions. When and how did the Other become the backward, the primitive? While this relation was secondary for ancient Greek thought, theories of historical development became the main source of ethnological categories in the modern era. Interestingly enough, this modern synthesis suited the practical purpose of justifying two successive waves of European imperialistic: the era of discoveries, and 19th century colonialism. The article concludes by raising questions about the present role and application of the social sciences.