Plant clathrin-mediated membrane trafficking is involved in many developmental processes as well as in responses to environmental cues. Previous studies have shown that clathrin-mediated endocytosis of the plasma membrane (PM) auxin transporter PIN-FORMED1 is regulated by the extracellular auxin receptor AUXIN BINDING PROTEIN1 (ABP1). However, the mechanisms by which ABP1 and other factors regulate clathrin-mediated trafficking are poorly understood. Here, we applied a genetic strategy and time-resolved imaging to dissect the role of clathrin light chains (CLCs) and ABP1 in auxin regulation of clathrin-mediated trafficking in Arabidopsis thaliana. Auxin was found to differentially regulate the PM and trans-Golgi network/early endosome (TGN/EE) association of CLCs and heavy chains (CHCs) in an ABP1-dependent but TRANSPORT INHIBITOR RESPONSE1/AUXIN-BINDING F-BOX PROTEIN (TIR1/AFB)-independent manner. Loss of CLC2 and CLC3 affected CHC membrane association, decreased both internalization and intracellular trafficking of PM proteins, and impaired auxin-regulated endocytosis. Consistent with these results, basipetal auxin transport, auxin sensitivity and distribution, and root gravitropism were also found to be dramatically altered in clc2 clc3 double mutants, resulting in pleiotropic defects in plant development. These results suggest that CLCs are key regulators in clathrin-mediated trafficking downstream of ABP1-mediated signaling and thus play a critical role in membrane trafficking from the TGN/EE and PM during plant development.