Testen damals und heute: Was hat sich in 25 Jahren (nicht) geändert?

Transkript

1 Testen damals und heute: Was hat sich in 25 Jahren (nicht) geändert? 25 Jahre TAV: Rudolf van Megen, co-founder of SQS Software Quality Systems AG

2 Agenda! Today s World in Software! Quality Metrics! QM, QA and Testing! Development Model! Test Methodology! Product Development! Resumeé

3 Introduction Rudolf van Megen Building a global business needs to be constant, but try new things, have experiences and change if necessary More than 35 year s experience in Business Experience: building up SQS as Professional Service Organisation from scratch to a global organisation with more than 2,100 employees in 15 countries (today 4.500, 20 countries). Coming from an entrepreneurial background makes things easier Making some mistakes is alright and part of the learning cycle We didn t know how international/global we would become when we started, but at some point it started to become a necessity Local vs. global: what does it mean from different perspectives: Clients, Processes, Finance and Employees? It s a great experience last but not least from a personal perspective S.T.O.L. Verwaltung GmbH Testen damals und heute: Was hat sich in 25 Jahren (nicht) geändert? June

4 Rudolf van Megen New Developments S.T.O.L. Verwaltung GmbH Testen damals und heute: Was hat sich in 25 Jahren (nicht) geändert? June

5 Today s World in Software Overview Situation " Complex application " Extended over many years " Testing # Different people; different times # Different types; wrong people # Little testing time; less documentation Video/Forbes.com Pain Points: Testing is in a mess " Complicated testing " Too many tests " Too few of the right tests " Missing tests S.T.O.L. Verwaltung GmbH Testen damals und heute: Was hat sich in 25 Jahren (nicht) geändert? June

6 Quality metrics Additional objectives for the new world! Reliability, functional suitability, performance once had been added by: " Usability, " Security, " Portability. CHANGED S.T.O.L. Verwaltung GmbH Testen damals und heute: Was hat sich in 25 Jahren (nicht) geändert? June

7 QM, QA and Testing The difference between QM, QA &Testing is still not obvious Reminder: the difference The aim of Software Quality Management (SQM) is to manage the quality of software and of its development process. Software quality assurance (SQA) consists of a means of monitoring the software engineering processes and methods used to ensure quality. Software testing is an investigation conducted to provide stakeholders with information about the quality of the product or service under test. Testing of requirements and design could easily be done by MVP, but often not complete. QM UNCHANGED Fund- Require- Specifi- RfD* Develop- RfT* RfO* Operations ments ing cation ment * RfP Request for Proposal, RfD - Ready for Development, RfT - Ready for Testing, RfO - Ready for Operations QA S.T.O.L. Verwaltung GmbH Testen damals und heute: Was hat sich in 25 Jahren (nicht) geändert? June

8 DevOps Many things are growing together, but you can t change the basis! Do we need different roles? Specification Coding Testing Yes, but working together! CHANGED blog joecolantonio.com S.T.O.L. Verwaltung GmbH Testen damals und heute: Was hat sich in 25 Jahren (nicht) geändert? June

9 Test Methodology Software Testing Life Cycle STLC S.T.O.L. Verwaltung GmbH Testen damals und heute: Was hat sich in 25 Jahren (nicht) geändert? June

10 Test Methodology Software Testing Life Cycle STLC UNCHANGED S.T.O.L. Verwaltung GmbH Testen damals und heute: Was hat sich in 25 Jahren (nicht) geändert? June

11 Test Methodology The methodology has not changed but some things need to be looked at slightly differently. Test planning and test control are even more important than in the past The better test preparation is performed, the higher the quality of the tested software Only manual test execution is impossible today; the number of test cases is much higher due to software complexity and the speed for execution is really important, mostly. UNCHANGED S.T.O.L. Verwaltung GmbH Testen damals und heute: Was hat sich in 25 Jahren (nicht) geändert? June

12 Test Methodology Fundamental basics are still the same but many are more complex, more extended and more integrated. CHANGED S.T.O.L. Verwaltung GmbH Testen damals und heute: Was hat sich in 25 Jahren (nicht) geändert? June

13 Testing Tools Few tools; there could be more, especially integrated ones. Gartner Magic Quadrant for Integrated Quality Suites CHANGED

14 Product development Service and quality are becoming more and more important they will be the success factors of the future. CHANGED mobil S.T.O.L. Verwaltung GmbH Testen damals und heute: Was hat sich in 25 Jahren (nicht) geändert? June

15 Product development Taking care of your clients is the most important point for the future. Sales must know how the maket online ticked Your competitor is one click away CHANGED Technicans must know how to built up a lovable product from the buyers point of view Answering client request via social media Management system for rebounds S.T.O.L. Verwaltung GmbH Testen damals und heute: Was hat sich in 25 Jahren (nicht) geändert? Jue

16 Test Analysis - Process based Testing (SQS Think Model) Testing is moving up to IT Portfolio Model and its Layers Business Layer BP Scenario (BPSC) BP Step User Stories Business Process (BP) Decis BP Step BP Step BP Step BP Step BP Step Internet of Things BP Domain XYZ BP Step BP Domain A BP Step BP Domain B BP Step Big Data Application Layer Application Process (AP) Act Act Act Act SubP Akt Act Act SubP System Process (SP) System Process (SP) System Process (SP) SubP SQS Service Management Test Analysis FT MOD 01 06/08/

17 Testing across the globe Testing has spread out intensively over the last 25 years It has become a business in its own right. CHANGED Crowd testing Cloud Testing User Stories,, Internet of Things Big Data Mobile Testing S.T.O.L. Verwaltung GmbH Testen damals und heute: Was hat sich in 25 Jahren (nicht) geändert? June

18 Resumeé No Breakthroughs over last 5 years Within the last 5 years not many break through scenarios have happened in testing: no big brushes Not In Agile/DevOps two important facts: Most important is integration " start early and make sure that planned result/sprint can be integrated " Make sure the integrated result delivers what it should deliver Test level changed " Testing business has moved from the small units (functions or applications) to the business level. " A type of new discipline in testing did come up: Simulation of the real business at the BP Model level, E2e-testing with new tenologies for test prep and exec " This will also address the business qualification of testers Far more usability need to be tested more consequently New trends: Cloud Testing, Crowd testing, User Stories, Internet of Things, Big Data, Mobile Testing S.T.O.L. Verwaltung GmbH Testen damals und heute: Was hat sich in 25 Jahren (nicht) geändert? June

19 S.T.O.L. Verwaltung GmbH Sophienstr Köln, Deutschland Telefon: Fax: r.van_megen@stol-service.com Thank s for Your Attention

20 Summary "Testen damals und heute: Was hat sich in 25 Jahren (nicht) geändert? Die gute Nachricht: Es wird immer noch getestet, und wenn man die Welt der Digitalisierung oder Industrie 4.0 verfolgt, wird der Bedarf für systematisches Testen in der Zukunft eher größer denn geringer. Einige Aspekte haben einen anderen Stellenwert bekommen: wenn früher die Funktionalität, Richtigkeit, und Robustheit im Vordergrund des Testens stand, sind heute bzw. insbesondere auch in der Zukunft zusätzliche Qualitätsmerkmale wie Sicherheit, Usability oder Response time gefragt. Dafür müssen dann auch geeignete Methoden, Verfahren und Werkzeuge bereit stehen, aber die sind bzw. werden bei Apps halt andere sein als bei klassischen Back-Office Systemen. Und - Gott sei Dank - haben die Tester heute - wie damals - eine große Zukunft."