Ghana has adopted the Poverty Reduction Strategy, which emphasizes increased focus on poverty reduction in the design and implementation of its policies. Trade liberalization is one of the ways through which poverty could be reduced. However, trade liberalization results in decreased fiscal revenue of the government, which reduces public savings. However, this fiscal deficit could be financed through increased foreign borrowing, so that the public savings do not fall. The present study uses the CGE model and examines the impact of trade liberalization; in which lost tariff revenue is compensated by increased foreign borrowing, on the poverty and income distributions of various categories of households. The study has shown that elimination of trade related import duties accompanied by an increase in foreign borrowing reduces the incidence, depth, and severity of poverty, whereas the elimination of export duties accompanied by an increase in foreign borrowing increases the incidence, depth and severity of poverty. It is also shown that the income distributions of households improve when elimination of trade related import duties are accompanied by an increase in foreign borrowing, whereas the income distributions of households worsen when elimination of export duties are accompanied by an increase in foreign following.