The effect of polycomb chromobox (Cbx) proteins in cancer is context-dependent. The Chromobox homolog 8 (CBX8) was originally characterized as a transcriptional repressor, which inhibits cell proliferation in Ink4a-Arf-dependent and -independent manner. However, the role of CBX8 in colorectal cancer remains unknown. Here, we found that high CBX8 expression was associated with a low rate of distant metastasis and good prognosis in CRC patients, even though CBX8 was up-regulated in CRC cell lines and clinical samples. Knockdown of CBX8 inhibited CRC proliferation in vitro and in vivo, mostly by increasing p53 and its downstream effectors. However, knockdown of CBX8 enhanced CRC migration, invasion and metastasis in vitro and in vivo, in part through direct up-regulation of integrin β4 (ITGB4) that in turn decreased RhoA activity. Collectively, the knockdown of CBX8 inhibited CRC proliferation, while promoting its metastasis, thus exerting paradoxical effects in CRC progression.