Primary cilia have gained considerable importance in biology and disease now that their involvement in a wide range of human ciliopathies has been abundantly documented. However, detailed molecular mechanisms for specific targeting of sensory receptors to primary cilia are still unknown. Here, we show that the Arf and Rab11 effector FIP3 (also known as RAB11FIP3) promotes the activity of Rab11a and the Arf GTPase-activating protein (GAP) ASAP1 in the Arf4-dependent ciliary transport of the sensory receptor rhodopsin. During its passage out of the photoreceptor Golgi and trans-Golgi network (TGN), rhodopsin indirectly interacts with FIP3 through Rab11a and ASAP1. FIP3 competes with rhodopsin for binding to ASAP1 and displaces it from the ternary complex with Arf4–GTP and ASAP1. Resembling the phenotype resulting from lack of ASAP1, ablation of FIP3 abolishes ciliary targeting and causes rhodopsin mislocalization. FIP3 coordinates the interactions of ASAP1 and Rab11a with the Rab8 guanine nucleotide exchange factor Rabin8 (also known as RAB3IP). Our study implies that FIP3 functions as a crucial targeting regulator, which impinges on rhodopsin–ASAP1 interactions and shapes the binding pocket for Rabin8 within the ASAP1–Rab11a–FIP3 targeting complex, thus facilitating the orderly assembly and activation of the Rab11–Rabin8–Rab8 cascade during ciliary receptor trafficking.