This paper reports and assesses the results of a comparative survey on the costs and benefits of windmills and kerosene pumpsets for irrigation of subsidiary food crops in the Dry Zone of Sri Lanka. Secondary objectives are to draw out lessons from the survey (i) for other renewable energy technology programs and (ii) for evaluation methods. Survey results provide a windmill user evaluation, a cost analysis and a comparison of net crop income under the two techniques (windmill and kerosene pumpset). At both financial and economic prices the renewable energy technology is found inferior to the fossil-fuel based technology. The small data set requires caution in drawing final conclusions but does suggest that there is a critical loss in flexibility over cropping patterns by adoption of the windmill.