Can I use RStudio Package Manager in an offline, air-gapped environment?

Yes, there are a number of options for air-gapped environments; see the instructions in the getting started guide.