Xylan is a crosslinking polymer that plays an important role in the assembly of heterogeneous cell wall structures in plants. The pollen wall, a specialized cell wall matrix, exhibits diverse sculpted patterns that serve to protect male gametophytes and facilitate pollination during plant reproduction. However, whether xylan is precisely anchored into clusters and its influence on pollen wall patterning remain unclear. Here, we report xylan clustering on the mature pollen surface in different plant species that is indispensable for the formation of sculpted exine patterns in dicot and monocot plants. Chemical composition analyses revealed that xylan is generally present at low abundance in the mature pollen of flowering plants and shows plentiful variations in terms of substitutions and modifications. Consistent with the expression profiles of their encoding genes, genetic characterization revealed IRREGULAR XYLEM10-LIKE (IRX10L) and its homologous proteins in the GT47 family of glycosyltransferases as key players in the formation of these xylan micro-/nano-compartments on the pollen surface in Arabidopsis (Arabidopsis thaliana) and rice (Oryza sativa). A deficiency in xylan biosynthesis abolished exine patterning on pollen and compromised male fertility. Therefore, our study outlines a mechanism of exine patterning and provides a tool for manipulating male fertility in crop breeding.