Recent studies have shown that peripheral nerves play an important role in the progression of breast cancer. Breast cancer cells (BCCs) promote local peripheral nerve growth and branching by secreting neuroactive molecules, including neurotrophins and axon guidance molecules (AGMs). Sympathetic nerves promote breast cancer progression, while parasympathetic and sensory nerves mainly have anti-tumor effects in the progression of breast cancer. Specifically, peripheral nerves can influence the progression of breast cancer by secreting neurotransmitters not only directly binding to the corresponding receptors of BCCs, but also indirectly acting on immune cells to modulate anti-tumor immunity. In this review, we summarize the crosstalk between breast cancer and peripheral nerves and the roles of important neuroactive molecules in the progression of breast cancer. In addition, we summarize indicators, including nerve fiber density and perineural invasion (PNI), that may help determine the prognosis of breast cancer based on current research results, as well as potential therapeutic approaches, such as β-blockers and retroviral-mediated genetic neuroengineering techniques, that may enhance the prognosis of breast cancer. In addition, we propose suggestions for future research priorities based on a current lack of knowledge in this area.