Yes, if you’re completing a test in the 'Brightspace Pulse' mobile app, you must be online. Any results from tests are recorded in MyKaplan and you’ll be able to see them when you log in from another device.
Tests are not currently available if you’re offline, i.e. if you do not have a Wi-Fi connection.