Sauce Labs

Some alternatives

BrowserStack - See our internal information page and their home page.

Getting a free SauceLabs trial and using it in Alithya GoTest with browsers

1A. Creating a SauceLabs trial

1. Go to https://signup.saucelabs.com/signup/trial.
2. Enter the necessary information and email. Finish the signup.
3. A validation email will be sent to your email address.
4. Open the email and click the validation link.
5. If necessary, log in with your new trial in SauceLabs.

1. At the top-right of your screen, click your username. A drop-down menu will be shown.
2. In the drop-down menu, click "My Account".

1. A new page will be shown
2. At the top-left of the screen, copy-paste your Username (e.g., Test11154) into your Notepad. It will be needed later.

1. Scroll down to the middle of the page.
2. Copy-paste the value of the Access Key (e.g., d6624ae8-14a9-4c52-b375-3f2fb74fc513) in your Notepad. It will be needed later.

1. Prepare the values in this: https://Test11154:d6624ae8-14a9-4c52-b375-3f2fb74fc513@ondemand.saucelabs.com:443/wd/hub.
2. Replace the Username and Access Key of the line above.

1B. First time using SauceLabs for browsers in Alithya GoTest

Simplified method example in Alithya GoTest

1C. Checking the results and video on SauceLabs

After automated test execution, SauceLabs provides information about the test. It also includes a video. 

1. Log in to SauceLabs.
2. Go to https://app.saucelabs.com/dashboard/tests.
3. Click the "Automated Tests" section.
4. Click the test job you want to check details on.
5. On the right side, you can see your test's steps according to HTTP requests.
6. On the left side, you can click to run the test's video.

1D. Choosing capabilities for SauceLabs browser tests

 
We want to ensure our Alithya GoTest test results with SauceLabs are consistent. Thus, capabilities should be set to ensure a specific OS, browser version, and other options are always the same from test to test.
To see a list of supported browsers and platforms: https://saucelabs.com/platforms To choose capabilities, click https://wiki.saucelabs.com/display/DOCS/Platform+Configurator# Some additional information on capabilities can be found here: https://wiki.saucelabs.com/display/DOCS/Desired+Capabilities+Required+for+Selenium+and+Appium+Tests
 
Example to pick capabilities for Chrome browser

1. Go to https://wiki.saucelabs.com/display/DOCS/Platform+Configurator#/
2. Click the "Selenium" button.
3. As your device, pick "PC".
4. As your Operating System, pick "Windows 10".
5. As your browser, pick "Chrome", and version "75.0".
6. Scroll down the page.
7. Copy-paste the generated capabilities from your previous choices into your Notepad.

1. Go to your Alithya GoTest project using a SauceLabs hub.
2. Click the "Variable Editor" button.
3. On the variables page, click the "Plus" sign to add a new variable.
4. Write a variable name.
5. Select "Dictionary" as your variable type for this case.
6. Write the capabilities in the Value edit box. Their header and value must be separated by an = sign. For example: caps.setCapability("platform", "Windows 10"); must be written as the line platform=Windows 10.
7. Save your new variable.

1. Go to your Alithya GoTest test, which has the "Open Browser" keyword.
2. Modify the "Capabilities" argument of your "Open Browser" to use the variable as &{DESKTOP_CAPABILITIES_CHROME}. It must use an "&" character instead of a "$" character for this case.
3. Ensure the browser being used is the correct one.
4. Ensure your SauceLabs hub reference is correct.
5. Run your Alithya GoTest test to ensure everything is correct.
6. Normally, your Alithya GoTest test will run correctly.

1E. Scripting further your Selenium tests

For the documentation of Selenium keywords, see 3-Frequently useful keywords in Alithya GoTest.

Getting a free SauceLabs trial and using it in Alithya GoTest with native mobile applications

2A. Creating a SauceLabs trial

1. Go to https://signup.saucelabs.com/signup/trial
2. Enter the necessary information and email. Finish the signup.
3. A validation email will be sent to your email address.
4. Open the email and click the validation link.
5. If necessary, log in with your new trial in SauceLabs.
6. At the top-right of your screen, click your username. A drop-down menu will be shown.
7. In the drop-down menu, click "My Account".

1. A new page will be shown.
2. At the top-left of the screen, copy-paste your Username (e.g., Test11154) into your Notepad. It will be needed later.

1. Scroll down to the middle of the page.
2. Copy-paste the value of the Access Key (e.g., d6624ae8-14a9-4c52-b375-3f2fb74fc513 ) into your Notepad. It will be needed later.

1. Prepare the values in this: https://Test11154:d6624ae8-14a9-4c52-b375-3f2fb74fc513@ondemand.saucelabs.com:443/wd/hub
2. Replace the Username and Access key of the line above.

2B. Finding native mobile application files

To test native mobile applications with SauceLabs, the following are required:

• An APK file if it is an Android native application.
• An IPA file if it is an iPhone native application.

APK files are fairly easy to find on the Internet. However, IPA files are much more difficult. IPA files often require the source code to be compiled on a Mac computer.
For your first time, we will use APK and IPA files of Wikipedia, which can be found here: https://apps.askida.com/artifactory/webapp/#/artifacts/browse/tree/General/askida-ct-mobile-demo-app

2C. Uploading native mobile application files to SauceLabs

The next step is to upload the APK file or the IPA file to your SauceLabs account. It will render it usable for your Alithya GoTest tests.

1. If you are on Windows, download MINGW64 at https://sourceforge.net/projects/mingw-w64/ or an equivalent to send the needed command, "curl". Otherwise, with Linux, you can already send the command.
2. Prepare your curl command. The curl command to send is similar to: curl -u Test11154:d6624ae8-14a9-4c52-b375-3f2fb74fc513 \ -X POST -H 'Content-Type: application/octet-stream' \ https://saucelabs.com/rest/v1/storage/Test11154/WikipediaSample.apk?overwrite=true \ --data-binary @"C:/path/to/app/file/WikipediaSample.apk"
   1. Modify the orange part to be your username (e.g., Test11154)
   2. Modify the blue part to be your access key. (e.g., d6624ae8-14a9-4c52-b375-3f2fb74fc513)
   3. Modify the green part to be the application name you want to prefer (e.g., WikipediaSample.apk)
   4. Modify the pink part to refer to the application APK or IPA on your desktop (e.g., "C:/path/to/app/file/WikipediaSample.apk").
3. Send the curl command.
4. Wait for the file upload to finish.
5. If it is successful, you will receive a message that contains data with no mention of an error.
6. The value after "filename" is the reference to your application for later tests.

2D. Determining the phone device to use in SauceLabs

1. Go to https://wiki.saucelabs.com/display/DOCS/Platform+Configurator#/.
2. Choose "Appium".

1. Click "Select a device".
2. Click the "Android Emulators" tab.
3. Select an Android emulator such as "Samsung Galaxy Tab S3 GoogleAPI".

1. Click "Select an operating system".
2. Select "Android 8.1".

1. Click "Select a version".
2. Select an Appium version such as "1.13.0".
3. Click "App Testing".
4. The "Specify App Url" will be shown. Write your application name, which was uploaded with the curl command.
5. Scroll down the page. Copy-paste the capabilities shown into Notepad.

2E. Executing a native application test with SauceLabs in Alithya GoTest

The information from the previous sections is required, including:

• Your account information, such as Test11154:d6624ae8-14a9-4c52-b375-3f2fb74fc513
• The capabilities of the phone device, such as:

1. Go to your Alithya GoTest project using a SauceLabs hub.
2. Click the "Variable Editor" button.
3. On the variables page, click the "Plus" sign to add a new variable.
4. Write a variable name.
5. Select "Dictionary" as your variable type for this case.
6. Write the capabilities in the value edit box. Their header and value must be separated by a = sign. For example: caps.setCapability("appiumVersion", "1.13.0"); must be written as the line appiumVersion=1.13.0.
7. Save your new variable.
8. Go to your Alithya GoTest test, which has the "Open Application" keyword.
9. 
10. Modify the "Capabilities" argument of your "Open Application" to use the variable as &{ANDROID_CAPABILITIES_WIKIPEDIA}. It must use an "&" character instead of a "$" character for this case.
11. Ensure the used browser is the correct one.
12. Ensure your SauceLabs hub reference is correct (for example, https://Test11154:d6624ae8-14a9-4c52-b375-3f2fb74fc513@ondemand.saucelabs.com:443/wd/hub)
13. 
14. Run your Alithya GoTest test to ensure everything is correct.
15. It is preferable to add the "Get Source" and "Capture Page Screenshots". (Appium version) keywords. This is to see the XML/HTML on your Android or iPhone to help you determine which XPaths to script.

2F. Checking the results and video on SauceLabs

After automated test execution, SauceLabs provides information about the test. It also includes a video. 

1. Log in to SauceLabs.
2. Go to https://app.saucelabs.com/dashboard/tests.
3. Click the "Automated Tests" section.
4. Click the test job you want to check details on.
5. On the right side, you can see your test's steps according to HTTP requests.
6. On the left side, you can click to run the test's video.

2G. Further scripting your native application Appium tests

For some documentation of Appium keywords, see Mobile Testing. However, that documentation is written without using SauceLabs.

Pricing

See https://billing.saucelabs.com/plans for the prices.
However, for real mobile devices, there is another page with different prices.

Useful links

List of platforms/browsers: {+}https://saucelabs.com/platforms
Platform configurator: https://wiki.saucelabs.com/display/DOCS/Platform+Configurator#/
Desired capabilities info: https://wiki.saucelabs.com/display/DOCS/Desired+Capabilities+Required+for+Selenium+and+Appium+Tests