Can I stay in the U.S. while my visa extension is pending?

Yes, if you applied before your current visa expired.

You’ll be in a “period of authorized stay

Leaving while pending may cause issues.

Yeah, you can stay in the U.S. while it’s pending, as long as you filed the extension before your current visa expired. Just don’t leave the country.