According to the Global Climate Risk Index, Bangladesh with its densely populated coastal areas is considered as one of the most vulnerable countries affected by climate change in the world. In this context, the goal of this research is to assess the social vulnerability of the south-western coastal communities of the country,which is becoming more vulnerable, trying to understand the underlying social conditions of coastal people who are dependent on limited natural resources. To do so, vulnerability indicators of exposure, sensitivity and adaptive capacity are analyzed using quantitative data collected from different sample areas and focus group discussions (FGD) were held with the local women in two study areas. The results show that a community in the area have close dependency on natural resources such as water, mangrove forest and also has a limited set of livelihood options. Also many households, above the traditional fishing and agriculture, have no secondary occupation or alternative livelihood options. Therefore, unpredictable seasonal patterns on the sea and land would threat livelihood and mainly their food security. Considering that the coastal areas have potential opportunities for nation’s sustainable development, assessing on social vulnerability to climate change will help to create regulation and awareness programs in order to minimize vulnerabilities.