node.js - NodeJS Code Coverage of Automated Tests -


as part of custom testing framework nodejs rest api, i'd automatically detect when tests no longer providing proper coverage comparing possible outcomes test suite received.

what methods exist doing this? can assume it's being used rest api list of entry functions (api endpoints) need coverage analysis, , each entry function end known 'exit function' responds requester in standard way.

here's i've found far:

1: basic solution (currently implemented)

  • when writing each rest endpoint, manually create list of possible outcome 'codes' [success, failureduetox, failureduetoy] example
  • after tests have run, ensure every code in list has been seen test suite each endpoint.

pros: basic , easy use; doesn't change performance testing times

cons: highly prone error lots of manual checking; doesn't flag issues if there 5 ways 'failduetox' , test 1 of them. basic definition of 'coverage'

2: static analysis

  • parse code sort of parse tree , instances of 'exit function'
  • traverse tree until api endpoint reached, , add exit instance endpoint expected output (needs keep record of stack trace there via hash or similar)
  • when tests run, endpoints return stack trace hash or similar , compared expected output list.

pros: automatic; catches different branches may result in same output code

cons: generating parse tree non trivial; doesn't detect dead code never gets run; test suite needs kept in sync

3: profiling

i've done in past on embedded systems greenhills code coverage tools

  • start profiler dtrace , record stack log each test separately
  • parse stack log , assign 'test' each line of code
  • manually analyse code-with-annotations find gaps.

pros: semi automatic; gives more information total coverage developer; can see

cons: slows down tests; unable performance testing in parallel; doesn't flag when possible outcome never made happen.

what else there, , tools can me static analysis , profiling goals?

combinatorial testing (different name suggestion appreciated)

  • loosely based on idea of quickcheck
  • requires initial extraction of endpoints (and static analysis mentioned in #2), creates list of potential endpoints , arguments, , executes them
  • validation:
    • light: app shall stable handle possible inputs
    • strong: requires written specification regarding endpoints able validate against it

pros:: semi automatic (having proper tools)

cons:: specification validation tricky. i'm not aware of existing implementation.

potentially helpful node modules:


Comments

Post a Comment

Popular posts from this blog

html - How to style widget with post count different than without post count -

i have border below li elements in wordpress widget types appropriate. element inside set block gives them nice easy click full width. the problem, when choose option "show post count" when adding widget such categories or archives displays post count plain text after tag , because tag block pushes post number text line below. whether choose show post count or not show post count still gives exact same element identifyer example "widget_categories". how style post count not on next line still keep links non post count list items full width? here's example on sidebar www.bbmthemes.com/themes/modular/blog-standard/ in order solve problem need remove display:block; for ul.widgets ul a , add in it's place line-height: 33px; what going achieve have same visual effect. what going lose doing links going work on text , not on "box". the other way out of find post count coming , make changes this. example change text count i
Read more

How to remove text and logo OR add Overflow on Android ActionBar using AppCompat on API 8? -

have researched death , cannot find answer. i have actionbar using appcompat. supporting api v7 (api v8 do). actionbar works api v11. api < v11 has problem of removing icon (and feature) actionbar without supplying overflow. big picture have app logo, app title, , 3 icons squidging same actionbar on low end phone. trying make room! i happy 1 of 2 solutions. either: a method of getting overflow functionality can retrieved pull down. (preferred) method of removing icon , text actionbar below current xml api 11+: <resources> <!-- base application theme api 11+. theme replaces appbasetheme res/values/styles.xml on api 11+ devices. --> <style name="appbasetheme" parent="theme.appcompat.light.darkactionbar"> <item name="android:actionbarstyle">@style/liteactionbarstyle</item> <item name="actionbarstyle">@style/liteactionbarstyle</item> </st
Read more

javascript - storing input from prompt in array and displaying the array -

i want take the inputs user prompt, store input in array, , display it. want take 10 inputs user using for loop. have tried do-while shown below. var givennames = new array(); var pattern = /[\w\d]{1,}/ig; do{ var name = prompt("enter names. letters , digits accepted!\nentering empty field stops asking",""); if(name && name.match(pattern)){givennames.push(name);} } while(name != ""); function displaynames(){ if(givennames.length > 0){ document.getelementbyid("list").innerhtml = "<span style='color:navy;font- weight:bold;'>given names are:<\/span><br><br>" + givennames.join("<br><br>"); } else { document.getelementbyid("list").innerhtml = "<span style='color:navy;font-weight:bold;'>nothing has been given!<\/span>"; } } how replace for loop? var givennames = new array();
Read more