Estimates of global primary bioenergy potentials in the literature span almost three orders of magnitude. We narrow that range by discussing biophysical constraints on bioenergy potentials resulting from plant growth (NPP) and its current human use. In the last 30 years, terrestrial NPP was almost constant near 54 PgC yr−1, despite massive efforts to increase yields in agriculture and forestry. The global human appropriation of terrestrial plant production has doubled in the last century. We estimate the maximum physical potential of the world's total land area outside croplands, infrastructure, wilderness and denser forests to deliver bioenergy at approximately 190 EJ yr−1. These pasture lands, sparser woodlands, savannas and tundras are already used heavily for grazing and store abundant carbon; they would have to be entirely converted to bioenergy and intensive forage production to provide that amount of energy. Such a high level of bioenergy supply would roughly double the global human biomass harvest, with far-reaching effects on biodiversity, ecosystems and food supply. Identifying sustainable levels of bioenergy and finding ways to integrate bioenergy with food supply and ecological conservation goals remains a huge and pressing scientific challenge.