Christian Meder inovex. Sauberes Grün QS für Android

Transkript

1 Konferenz Christian Meder inovex Sauberes Grün QS für Android

2 Sauberes Grün: QS für Android W-JAX, 2011 Christian Meder inovex GmbH Chief Technology Officer

3 Speaker Christian Meder Schwerpunkte open source (free software) Linux Web Java

4 Agenda Motivation Scope Tools Projekte Bewertung

5 Motivation

6 Motivation Korrektheit Zuverlässigkeit Robustheit Effizienz Benutzerfreundlichkeit Wartbarkeit Wiederverwendbarkeit Portierbarkeit Kompatibilität Vertrauenswürdigkeit

7 Scope

8 Scope Sehr dynamisches Thema Konzentration auf die IMHO relevantesten Tools Kein Anspruch auf Vollständigkeit

9 Tools

10 Tools Unit-Tests UI/Application Exerciser Monkey Robotium Android Web Driver CI mit Jenkins Emma, pmd,

11 Projekte

12 Unit tests builtin, SDK Auch UI Activity testing Content provider testing Service testing

13 Unit tests

14 Unit tests Activity testing Baseclass: InstrumentationTestCase UI Test: sendkeys UI Test: TouchUtils ActivityInstrumentationTestCase2 Normale Systemumgebung Mock intents Kein mock context oder application

15 Unit tests Activity testing Baseclass: InstrumentationTestCase UI Test: sendkeys UI Test: TouchUtils ActivityUnitTestCase Isolierte Systemumgebung Mock context und application Keine mock intents

16 Unit tests Activity testing Mock objects ViewAsserts Alignment Groups Screen coordinates MoreAsserts assertcontainsregex assertcontentsinanyorder assertcontentsinorder

17 Unit tests Activity testing package com.company.app.tests; import android.content.intent; import android.test.activityunittestcase; import android.widget.textview; import com.company.app.loginactivity; public class LoginActivityTest extends ActivityUnitTestCase<LoginActivity>{ public LoginActivityTest() { super(loginactivity.class); } private LoginActivity mactivity; private Intent protected void setup() throws Exception { super.setup(); } } mstartintent = new Intent(Intent.ACTION_MAIN); //injecting MOCK Application setapplication(new MockCompanyApplication());

18 Unit tests Activity testing package com.company.app.tests; import android.content.intent; import android.test.activityunittestcase; import android.widget.textview; import com.company.app.loginactivity; public class LoginActivityTest extends ActivityUnitTestCase<LoginActivity>{ public void testusernameverification() { startactivity(mstartintent, null, null); mactivity = getactivity(); assertnotnull(mactivity); //test some usernames assertequals("passed null, expected false", false, mactivity.val idateusername(null)); assertequals("passed empty String, expected false", false, mactivity.validateusername("")); assertequals("valid username given, expected true", true, mactivity.validateusername("jon.doe")); assertequals("missed divider, expected false", false, mactivity.validateusername("jondoe")); assertequals("missed second part, expected false", false, mactivity.validateusername("jondoe.")); assertequals("passed only divider, expected false", false, mactivity.validateusername(".")); } }

19 Unit tests Activity testing package com.company.app.tests; import android.content.intent; import android.test.activityunittestcase; import android.widget.textview; import com.company.app.loginactivity; public class LoginActivityTest extends ActivityUnitTestCase<LoginActivity>{ } public void testdatadisplay() { startactivity(mstartintent, null, null); mactivity = getactivity(); assertnotnull(mactivity); TextView tv = (TextView) mactivity.findviewbyid(com.company.app.r.id.login_text); assertnotnull(tv); asserttrue("activity should display the text passed in from the application", tv.gettext().equals(mockcompanyapplication.static_data)); }

20 Unit tests Activity testing: Testfälle Intents Lifecycle Events z.b. Orientierung Eingabevalidierung

21 Unit tests Content provider testing ProviderTestCase2 MockContentResolver IsolatedContext

22 Unit tests Content provider testing: Testfälle Resolver Methoden Konstanten Alle Methoden Invalide Daten Logik des Providers

23 Unit tests Service testing ServiceTestCase MockApplication MockContext

24 Unit tests Service testing: Testfälle Logik Lifecycle z.b. oncreate bei Context.startService() Mehrere startservice() Aufrufe

25 Unit tests Testfälle Batterie Orientierung Netzwerk, s. Network speed emulation Konfiguration

26 Monkey fuzzer Strom von events Einschränkbar in event types und auf packages Report bei crash Report bei application not responding

27 Robotium It's like Selenium, but for Android Test über mehrere Aktivitäten Kompakt, hohe Lesbarkeit Testen ohne Sourcen von apks möglich

28 Robotium Beispiele app.sendkey(solo.menu); app.clickontext("more"); app.clickonmenuitem("preferences"); app.clickontext("edit File Extensions"); Assert.assertTrue(app.searchText("jpg )); app.clearedittext(2); app.entertext(2, "robotium"); app.clickonbutton("save"); app.goback(); Assert.assertTrue(app.waitForText("FOO", 1, 8000));

29 Web Driver It's Selenium, but for the Android Browser Mobile extensions (taps, scrolls, long presses,...) HTML5 (local storage, application cache,...) device, emulator und remote möglich

30 Web Driver Läuft nicht im 2.3 Emulator (bug) WebDriver apk installieren Port forwarding

31 Web Driver Beispiel public void testgoogleworks() { // Loads driver.get(" // Lookup the search box on the page by it's HTML name property WebElement searchbox = driver.findelement(by.name("q")); // Enter keys in the search box searchbox.sendkeys("android Rocks!"); // Hit enter searchbox.submit(); // Ensure the title contains "Google" asserttrue(driver.gettitle().contains("google")); // Ensure that there is at least one link with the keyword "Android" asserttrue(driver.findelements(by.partiallinktext("android")).size() > 1); }

32 Jenkins Android Emulator Plugin Parametrierbar Emulator handling App Installation Monkey Integration EC2 Integration

33 Jenkins Configuration matrix

34 Jenkins Beispiel

35 Bewertung

36 Bewertung The road ahead Unit Tests: Logik, Lifecycle, Device Context Robotium: Test der nativen Android UI WebDriver: Android Browser Tests, relativ neu Jenkins: unterschiedliche Devices und Konfigurationen

37 Vielen Dank für Ihre Aufmerksamkeit! inovex GmbH