The diagnosis of invasive adenocarcinoma of the gallbladder can sometimes be challenging. The presence of true desmoplastic reaction facilitates the diagnosis of invasion. However, desmoplasia-like changes can be observed in benign gallbladder conditions, and recognition of desmoplasia may be challenging based on morphology. In this study, we tested the expression pattern of microfibril-associated protein 5 (MFAP5), a promising immunohistochemical marker for desmoplasia, in benign gallbladders with desmoplasia-like reaction and gallbladders with invasive adenocarcinoma. We also evaluated the diagnostic utility of MFAP5 in challenging cases with an interobserver agreement study. The results showed that all benign cases retained intact/positive MFAP5 staining pattern in periglandular connective tissue, whereas 79.3% (23 out of 29) of cases of adenocarcinomas demonstrated diffuse and complete loss of MFAP5 staining in the tumor stroma. Interobserver agreement was improved by 2.66 times when images of MFAP5 immunohistochemistry were provided. In conclusion, MFAP5 expression is downregulated in the desmoplastic stroma of gallbladder adenocarcinoma and may provide a useful diagnostic marker in difficult cases.