ECLIPSE – IOT WG MEETING 2017-03-01 Titan Dr. György Réthy, Ericsson

ECLIPSE – IOT WG MEETING 2017-03-01 Titan Dr. György Réthy, Ericsson Hungary (ETH) Test Competence Center [email protected]

What is Titan? › Titan is a full-featured TTCN-3 test toolset to develop, execute and evaluate tests › One of most widely used test automation toolsets in Ericsson – 4200 active users, 15 years of development › Has been open sourced in 2014-2015 – An Eclipse Tools project, EPL 1.0 license www.eclipse.org/titan › Types of testing – Functional (conformance, function, integration verification) – Performance (performance, high load, stability) › Interest from various areas – Avionics, Automotive (C-ITS), Webservices, Mobile user equipment (3G/4G) testing, Smart metering, IoT testing Titan in open source Public Ericsson AB 2016 2016-07-19 Page 2

What is TTCN-3? › Standard test language – Continuous language development and maintenance financed by ETSI › Built-in features for automated testing – Parallelism – Communication handling › Message-based and procedure-based › Wide set of wildcards to check received content › Handling alternative responses (incl. no response) – Imports XSD and ASN.1 specifications – Supports binary (e.g. CoAP), textual (e.g. HTTP), ASN.1 (e.g. mobile, C-ITS), XML and JSON message formats – Many more Number of pages of the TTCN-3 standards (without conformance test suite) 1600 1400 1200 1000 800 600 400 200 0 Core language TTCN-3 tool Language mappings TTCN-3 extensions TTCN-3 pages total 02 06 12 04 09 06 07 06 04 04 06 06 3- 05- 07- 08- 08- 09- 10- 11- 12- 13- 14- 150 20 20 20 20 20 20 20 20 20 20 20 20 No. of parts of the TTCN-3 standards Axis Title 16 14 12 10 8 6 4 2 0 2 2 9 7 4 6 6 -0 7-1 8-0 0-0 2-0 4-0 6-0 3 0 1 1 1 1 0 0 20 20 20 20 20 20 20 Titan in open source Public Ericsson AB 2016 2016-07-19 Page 3 No. of all parts

Why should I learn (yet) another language? › To execute already created test suites › In Model-based Testing - You need not! › To change existing tests and develop own test cases - Yes, you need http://www.ttcn-3.org/index.php/learn/tutorials › TTCN-3 allows more precise and efficient testing than other languages › Comparison with Python http://www.site.uottawa.ca/ bernard/A%20comparison%20between%20ttcn-3%20and%20python%20v%2012.pdf https://mail.python.org/pipermail/python-list/2008-August/491315.html Titan in open source Public Ericsson AB 2016 2016-07-19 Page 4

IoT projects

oneM2M IoT conformance testing http://support.iotocean.org:7591/onem2m/conformancetesting/oneM2MTester Titan in open source Public Ericsson AB 2016 2016-07-19 Page 7

EU project Armour › Develops security feature tests using TTCN-3 › Model-based security testing with TTCN-3 code generation http://www.armour-project.eu/wp-content/uploads/2016/08/D21-Generic-test-patterns-and-test-mo dels-for-IoT-security-testing.pdf http://www.armour-project.eu/wp-content/uploads/2016/08/D22-Test-generation-strategies-for-larg e-scale-IoT-security-testing-v1.pdf Titan in open source Public Ericsson AB 2016 2016-07-19 Page 8

IoT-T Project › German project supported by Industrial and academic partners and the Federal Ministry of Economics and Technology http://www.iot-t.de/en/ › IoT Testware is being developed by Fraunhofer FOKUS SQC – It is considering free online services, dedicated protocol tester and test features from IoT development kits Titan in open source Public Ericsson AB 2016 2016-07-19 Page 9

Open source Model-driven test toolchain › We have carried out a successful pilot with CoAP Model Test Execution Test Generation Diversity http://projects.eclipse.org/projects/modeling.efm Titan in open source Public Ericsson AB 2016 2016-07-19 Page 10

Titan in open source Public Ericsson AB 2016 2016-07-19 Page 11