Drosophila sensory organ precursor (SOP) cells are a well-studied model system for asymmetric cell division. During SOP division, the determinants Numb and Neuralized segregate into the pIIb daughter cell and establish a distinct cell fate by regulating Notch/Delta signaling. Here, we describe a Numb- and Neuralized-independent mechanism that acts redundantly in cell-fate specification. We show that trafficking of the Notch ligand Delta is different in the two daughter cells. In pIIb, Delta passes through the recycling endosome which is marked by Rab11. In pIIa, however, the recycling endosome does not form because the centrosome fails to recruit Nuclear fallout, a Rab11 binding partner that is essential for recycling endosome formation. Using a mammalian cell culture system, we demonstrate that recycling endosomes are essential for Delta activity. Our results suggest that cells can regulate signaling pathways and influence their developmental fate by inhibiting the formation of individual endocytic compartments.