Ethnic decentralization which could emerge in the form of autonomy and/or federalism has become an important way of responding to the challenges of ethno-nationalist conflicts. Since 1991, Ethiopia has adopted an ethnic federal structure which provides territorial autonomy to its various ethnic groups. This approach to autonomy, however, has brought challenges to multiethnic cities and ethnic borderlands where different ethnic groups coexist. By examining the experience of Dire Dawa, the second largest city in Ethiopia, this article shows how federalism and territorial autonomy by themselves are not enough to address problems of participatory governance in multiethnic cities. The article finally underscores the need for policy innovations that would ensure power-sharing in multiethnic cities.