Im Testen nichts Neues. 9-Nov TAV

Größe: px

Ab Seite anzeigen:

Download "Im Testen nichts Neues. 9-Nov TAV"

Etta Siegel
vor 6 Jahren
Abrufe

1 . 9-Nov TAV

2 2016, das Jahr der Jubiläen 2

3 1996 3

4 Meine Welt der automatischen Testgenerierung damals 4

5 Umsetzung von abstrakten Tests in ausführbare Tests 5

6 und warum es nicht funktionierte 6

7 G&D has been growing through continuous innovation We safeguard reliable transactions and authenticity. Server Software and Services Token and embedded security Cards for payment and telecommunications Government Solutions Banknote processing Banknote and security paper Global leader in secure solutions Banknote and security printing

8 Was wir tun 8

9 Agile Entwicklung als große Umwälzung im Test Approval Track Includes final System Acceptance Testing and Approval Activities System- Test Track Includes final System Integration and Regression Testing Dev Track Includes full System Testing of Feature / Bugfix Potentially shipable system! Final system integration done and system regression tested! 2 weeks 2 weeks 2 weeks 2 weeks 2 weeks 2 weeks 2 weeks 2 weeks Potentially shipable software! All features and bugfixes tested! V 1.0 V weeks 2-4 weeks 2 weeks 9

Test Staging (software-focused) Features Bugfixes Approval Track 1) Test Test Analyst/ Analyst/ Sys-Tester Prod-Tester System- Test Track 1) Test Test Analyst/ Analyst/ Sys-Tester Sys-Tester Dev

10 Test Staging (software-focused) Features Bugfixes Approval Track 1) Test Test Analyst/ Analyst/ Sys-Tester Prod-Tester System- Test Track 1) Test Test Analyst/ Analyst/ Sys-Tester Sys-Tester Dev Track PO SW-Dev SM SW-Dev Test Test-Aut. Analyst/ Sys-Tester App-Test Strategy System-Test System-Test Strategy Plan Dev-Test Strategy App-Test Plan Dev-Test Plan Sprint Backlog Dev Sprint Regr-Test Backlog Delivered System-Test Sprint [non-critical] bug detected App-Test Backlog Executed [critical] unplanned work item "bugfix" Approval Sprint [on release only] WIP-Test-Limit SAP BOM Update Customer Documentation Release Notes Acceptance Tests Configuration- and Adaptation Tests Release / Upgrade / Hotfix Installation Tests Potentially Tests at Customer Site Tests using different Machine Variants Installation, Configuration, Adaptation Tests Regression Tests Volume-, Performance-, Endurance-Tests Extended Component Failure Tests Extended Usability- and Security-Tests System-wide Integration Tests Partial Regression, Performance, Tests Feature / Bugfix Tests (Manual Machine Tests) Code Quality Checks Automated Feature Regression Tests Module (Unit) Tests Approval Activities Acceptance Smoke / Regression System Integration Smoke / Regression SW Integration System System Integration Autom. Regression Autom. Module Branch Mainline Technical Backlog Feature Backlog Bug Backlog 10

11 Die Testpyramide 11

... und das Problem der Umsetzung currentdatetime = currentdatetime.date + TimeSpan.FromDays(1) + TimeSpan.FromHours(OlympDataGenerator.START_OF_WORK_HOURS); Assert.IsTrue(this.dataGenerator.

12 ... und das Problem der Umsetzung currentdatetime = currentdatetime.date + TimeSpan.FromDays(1) + TimeSpan.FromHours(OlympDataGenerator.START_OF_WORK_HOURS); Assert.IsTrue(this.dataGenerator.CountAllSections() >= ipspershift * 6 - ipspershift / ); Assert.IsTrue(this.dataGenerator.CountAllSections() <= ipspershift * 6 - ipspershift / ); Was wird hier getestet Was bedeutet es, wenn der Test fehlschlägt 12

13 Lesbare Anforderungen Feature: 1.1 Assign Permissions form of CC Security plug-in Scenario Outline: The existing matrix view of the form shall be preserved, i.e. all permissions are shown in rows and all groups are shown in columns, also column Description shall be preserved. Given main form is visible Then I should see in column Row 0 Column 1 the following <permissions>. Examples: permissions ControlCenter.Adjustment ControlCenter.AdaptationTool 13

14 Implementierung (glue code) form is visible")] public void GivenMainFormIsVisible() { Assert.IsFalse(_appWindow.IsOffScreen); } [Then(@"I should see in column (.+) the following (.+)")] public void ThenIShouldSeeInColumnPermissionTheFollowing( String colname, String celltext) { var grid = (Table) _appwindow.get(searchcriteria.byautomationid(gridname)); Assert.IsNotNull(grid); Assert.IsTrue(grid.FindAll(colName, celltext).count == 1); } 14

15 Property-based Testing 15

16 16

17 17

DIAMONDS - Security Testing CORAS Risk Analysis Behavioural Fuzzing Data Fuzzing with TTCN-3 Risk Analysis (CORAS) Security Test Pattern Identification Test Generation Test Code

uses Security of information systems is ensured in many cases by a strict and clear definition of what constitutes valid behavior sequences from the security perspective on those

18 DIAMONDS - Security Testing CORAS Risk Analysis Behavioural Fuzzing Data Fuzzing with TTCN-3 Risk Analysis (CORAS) Security Test Pattern Identification Test Generation Test Code Generation (TTCN-3) Test Execution Pattern name Usage of Unusual Behavior Sequences Context Test pattern kind: Behavior Testing Approach(es): Prevention Problem/Goal Solution Known uses Security of information systems is ensured in many cases by a strict and clear definition of what constitutes valid behavior sequences from the security perspective on those systems. For example Test procedure template: Model-based behavioural fuzzing of sequence diagrams is an application of this pattern

19 19

20 Questions? 20

21 Who I am and what we do Dr. Andrej Pietschker Director, Head of Automation Lab Research & Development Giesecke & Devrient GmbH andrej.pietschker@gi-de.com 21

Ähnliche Dokumente

End-to-End Agility Sind Sie schon agil genug? Mag. Christoph Leithner c.leithner@celix.at

End-to-End Agility Sind Sie schon agil genug? Mag. Christoph Leithner c.leithner@celix.at www.celix.at September 2015 celix Solutions GmbH Spezialist für Team Collaboration und IT Prozess Management Agile