I've never heard it being a sport like that, so that might be just in your world. But yeah, I haven't really seen many people riding on them here either - or maybe I just haven't been paying attention. But at least there are many stories about flying on them, though not sure how many other worlds have stories of witches and others flying on brooms but---

Come to think of it, maybe it'd be possible with kinetic or elemental magic or combo of them? [Because that includes moving items, flying, air from elemental magic...] I've seen our airbender flying with a glider in my home world, so if it's possible with bending, I wouldn't be surprised if it's possible with magic too.