Changelog

2.0.0 - 2015-12-19

gemini update command: ability to update only new and changed references (@sipayRT)
SuiteCollection: new API to run separate suites and states (@j0tunn)
Fix: free browser when reset failed (@j0tunn)
Fix: provide image for errors during actions chain execution (@leonsabr)
Run heavy operations in separate processes (@j0tunn)
Force quit on second Ctrl+C (@j0tunn)
Do not get browser session for suites without states (@j0tunn)
Do not get browser session and do not perform any pre-actions for skipped suite (@j0tunn)

BREAKING CHANGES:

New skip method API (@leonsabr)
- Browser now can be specified only by browser id matcher (string or RegExp)
- skip now accepts optional second parameter - reason, which will be displayed in reporters
Deprecated options removed: strictComparison, referenceImageAbsence (@SevInf, @j0tunn)
Deprecated API method gemini.buildDiff removed (@j0tunn)
Russian documentation removed (@j0tunn)
gemini.readTests now returns SuiteCollection instance instead of rootSuite object (@j0tunn)
gemini gather deprecated in favor of gemini update (@sipayRT)

1.1.6 - 2015-12-04

Remove restirction for maximum open concurrent sockets (@j0tunn)

1.1.5 - 2015-12-03

Show reference image if test failed due to lack of it (@sipayrt)
Fixed result in HTML report for sibling states appear several times on retry (@SwinX)

1.1.4 - 2015-11-27

Fix: in LimitedPool next browser request will be triggered if failed to receive browser from underlying pool (@SwinX)

1.1.3 - 2015-11-25

Implemented TestCounter class for reporters (@SwinX)
Fixed undefined session id in vflat reporter (@SwinX)
Immediately quit browser if failed to create it (@SwinX)

1.1.2 - 2015-11-20

Fix: wrong initial-scale meta data (@sipayrt)
Fix: build crashed on 'gather' command (@SwinX)

1.1.1 - 2015-11-18

Fix: html reporter correctly handles error event if no data about state passed

1.1.0 - 2015-11-18

Implemented suite retry on compare diff and critical errors (@SwinX)
Only maximize PhantomJS browser if windowSize is not configured (@davidchin)
Allow tests to skip by browser id (@davidchin)
Do not fail tests on error from grid-side (@sipayrt)
Fix: run 'afterHook' if some state failed (@j0tunn)
Fix: run 'postActions' if state or 'afterHook' failed (@j0tunn)
Fix: free browser after cancel (@j0tunn)
Fix: keep original error if 'afterHook' or 'postActions' failed (@j0tunn)

1.0.6 - 2015-11-06

Show error message + whole page screenshot on test fail (@sipayrt)
Fix: clean browsers pool after finalization (@SwinX)
Fix: check for global window variable on client-side (@eroshinev)

1.0.5 - 2015-11-03

Do not fail tests if browsers specified from env does not exists in config (@sipayrt)

1.0.4 - 2015-10-13

Fix counting of skipped test by flat reporter (@sipayrt)
Pass sessionId on events for correctly TC work (@sipayrt)

1.0.3 - 2015-10-12

Fix: return correct exit code on test failing (@sipayrt)

1.0.2 - 2015-10-12

Fix handling of END_RUNNER event (@sipayrt)

1.0.1 - 2015-10-08

Fix: END_RUNNER event delivered to plugins in case of critical error (@SwinX)
Fix: make screenshot after prepareScreenshot() has been executed (@sipayrt)
Remove spaces from env GEMINI_BROWSERS (@sipayrt)

1.0.0 - 2015-10-05

Add Android support (@SevInf)
Fix: return same config object for each config.forBrowser request (@j0tunn)
Fix "undefined" output instead of browser name in the flat reporter (@scf2k)
Show current image for tests which have no reference images (@hatroman)
Screenshot whole page when gemini can't find a selector (@scf2k)
Add retry option. See docs (@sipayrt)
Fix: fire END_SUITE event when nested suites are done (@scf2k)

0.13.5 - 2015-09-09

Added the vflat reporter (@unlok)

0.13.4 - 2015-08-30

Path to the plugin configuration fixed (@SevInf)
Sets support (@j0tunn)

0.13.3 - 2015-08-27

mouseUp action: make element argument optional (@just-boris).
Print browserId and sessionId in critical error reports (@SevInf).
html report: load report images in lazy mode (@scf2k).

0.13.2 - 2015-08-17

Fix: correct handling of no-ref-image error (@j0tunn).

0.13.1 - 2015-08-15

Inline sourcemaps support in coverage calculation (@j0tunn).
Create HTML report dir before copying files (@SevInf).
API: do not override options with CLI flags and env vars by default (@SevInf).

0.13.0 - 2015-08-10

Fail when removed option is detected and warn if removed env var is detected (@SevInf).
Reports now always will be generated, even when there is a critical error (@zumra6a).
Correctly cancel queued tests after critical error (@SevInf).
Produce more debug information in various modules (@SevInf).
In case of a critical error, try to print what test was executed when it happened (@SevInf).
Corrected updates (@maximerassi).

0.13.0-beta.1 — 2015-07-31

Previous version was published without a tarball once again. Republishing.

0.13.0-beta — 2015-07-29

BREAKING CHANGE: new config format. See docs.

New config allows to set many previously global options on per-browser basis. The following things have changed in this config:
- rootUrl, gridUrl, tolerance, strictComparison, screenshotsDir, windowSize options can now be set separately for each browser:
```
gridUrl: http://grid.example.com
browsers:
  firefox:
    # Uses gridUrl from top level
    desiredCapabilities:
      ...
  chrome:
    # Overrides top-level value
    gridUrl: http://chrome.example.com
    desiredCapabilities:
      ...
```
- projectRoot, sourceRoot, plugins, debug, parallelLimit, diffColor, referenceImageAbsence are moved into system section and can not be set per-browser.
```
system:
  debug: true
  diffColor: #ff0000
  plugins:
    teamcity: true
  ...
```
- browsers are no longer default to phantomjs. If you've used this default, set up the browser explicitly:
```
browsers:
  phantomjs:
    desiredCapabilities:
      browserName: phantomjs
```
- coverage settings are now grouped under system.coverage section:
  - to enable coverage, set system.coverage.enabled to true.
  - coverageExclude is moved to system.coverage.exclude.
  - coverageNoHtml is replaced by system.coverage.html. Set it to false to disable html report generaion.
- --noCalibrate custom capability is replaced by calibrate option which can be set for every or any particular browser.
- browser capabilites are set in desiredCapabilites option.
```
browsers:
  chrome:
    desiredCapabilities:
      browserName: 'chrome',
      version: '45'
```
- top-level capabilities option is replaced by desiredCapabilites option.
- http settings are removed. Use new option httpTimeout to set timeout. Setting retires is no longer possible.
- sessionMode is replaced by more flexible suitesPerSession setting (see below).
The way config options are overriden by CLI flags and environment variables are now unified (option path is converted to --option-path for cli and gemini_option_path for environment variables). Due to this change, some old flags and environment variables won't work:
- --sorce-root and GEMINI_SOURCE_ROOT becomes --system-source-root and gemini_system_source_root respectively.
- --debug and GEMINI_DEBUG becomes --system-debug=true and gemini_system_debug respectively.
- --coverage and GEMINI_COVERAGE becomes --system-coverage-enabled=true and gemini_system_coverage_enabled respecitvely.
- --coverage-no-html and GEMINI_COVERAGE_NO_HTML becomes --system-coverage-html=false and gemini_system_coverage_html respectively.
- GEMINI_ROOT_URL becomes gemini_root_url.
- GEMINI_GRID_URL becomes gemini_grid_url.
- GEMINI_SCREENSHOTS_DIR becomes gemini_screenshots_dir.
- GEMINI_WINDOW_SIZE becomes gemini_window_size.
API: Gemini constuctor does not accepts overrides object anymore.
sessionMode is replaced by suitesPerSession option which specifies number of test suites to run in a single WebDriver session. Value of .inf is equivalent to perBrowser session mode and value of 1 is equivalent to perSuite. This option can be set globally or separately for each browser.
New option sessionsPerBrowser allows to launch multiple session for each browser and run tests in parallel.

0.12.8 - 2015-07-23

Correctly restore window size when setWindowSize is called in before callback (@SevInf).

0.12.7 - 2015-07-20

Correctly calculate element position if WebDriver returns screenshot thinner then document (@SevInf).

0.12.6 - 2015-06-16

More clear error when capture are is hidden (@hatroman).
Mouse cursor is moved to (0,0) before the first test (@j0tunn).

0.12.5 - 2015-05-28

Republish 0.12.4 due to another npm bug.

0.12.4 - 2015-05-28

Fix calibration to work in Chrome 43+ (@SevInf).
Original window size is restored after suite with setWindowSize action is finished (@scff).
windowSize option is ignored in Opera Presto browsers (@SevInf).

0.12.3 - 2015-05-21

Sizzle: work with selectors ending with space (@SevInf).

0.12.2 - 2015-05-19

Fix client bridge script injection (@SevInf).

0.12.1 - 2015-05-18

CRITICAL BUG WAS INTRODUCED IN THIS VERSION.

Version was deleted from npm, use 0.12.2 instead.

If CSS3 selectors are not supported by particular browser, Sizzle.js will be used for all queries in that browser (@SevInf).
Coverage now correctly detects intersection of the elements and capture area (@scff).

0.12.0 - 2015-05-07

When capturing element is visible compltely in the viewport do not scroll to element's location while taking the screenshot (@scff).

0.11.5 - 2015-04-30

Fix calibration in IE8 and add functional tests for it (@SevInf).

0.11.4 - 2015-04-29

Calibration affects only top and left sides of the screenshot (@scff).

0.11.3 - 2015-04-24

Take into account horizontal scrolling when validating capture area for viewport screenshot (@scf2k).
Add missing pollyfills for IE8. This allows to gather coverage in ie8 (@SevInf).
Correctly report execptions, thrown during coverage gathering (@SevInf).

0.11.2 - 2015-04-21

Republish 0.11.1 due to npm registry bug.

0.11.1 - 2015-04-21

Fix crash after all tests are finished (@SevInf).

0.11.0 - 2015-04-18

Plugins support (@Saulis).

Check out documentation and some plugin examples:
- gemini-sauce
- gemini-express
Add flick action for touch devices (@scf2k).
Add sessionMode property which allows to choose when new WebDriver session is created (@SevInf).
Automatically kill browser session on SIGHUP, SIGINT and SIGTERM (@j0tunn).
Allow to switch image background in HTML reoport (@unlok).
url.resolve is not used anymore for computing absolute URLs from rootUrl and suite URL. It is now just joined with a single / in between (@j0tunn).
Update png-image so it can be built with gcc 4.6 (@j0tunn).
Correctly expose __gemini variable in client scripts (@vlkosinov).
Grep pattern now checked when suites load, not when they are executed (@hatroman).
HTML report refactoring (@hatroman).

0.10.0 - 2015-04-06

Fix calibration to work in IE8 again (@SevInf)
Client scripts which gemini injects into page are now bundled together and minified (@scf2k).
Update png-img version bringing support for node v0.12 and iojs (@j0tunn).
Don't inject main client script twice (@scf2k)
Ported 0.9.9 changes (@SevInf)

0.10.0-beta.2 - 2015-03-26

Use document height instead of body height to determine whether webdriver returns document or viewport screenshot (@SevInf)

0.10.0-beta.1 - 2015-03-19

Basic support for IE8 browser (@SevInf).

This change required a large rewrite of the all client-side scripts which can cause some breaking changes. For example, bounds of a capture region are calculated more precisely now. You'll probably need to re-gather your screenshots.
Calibration now correctly works in IE9 (@SevInf).
Added an option referenceImageAbsence (@hatroman).

This option allows to change default behaviour of the tests to produce the warning if there is no reference image. Default behaviour is still the test failure.
Re-add tolerance setting, which now sets max allowed CIEDE2000 difference between image colors. It is now configurable on 3 levels:
- tolerance option in config
- setTolerance method for a suite
- optional parameter to capture method:
```
suite.capture('name', {tolerance: 20}, function() {});
```
Programmatic API method buildDiff is now deprecated: it has access only to global tolerance, so diff it produces might not show exactly what caused test to fail. Method is kept for backward compatibility, but users of a programmatic API now encouraged to use saveDiffTo method of test result (passed to reporter) instead.
Warn if coverage for CSS file cannot be calculated due to same-origin policy (@SevInf)

0.9.9 - 2015-04-06

Adds new option --browser to the CLI and browsers to the API which allows to run tests in a subset of browsers (@SevInf).

0.9.8 - 2015-02-11

Work correctly if WebDriver implementation returns screenshot with a browser chrome. This is done via calibration step after first launch of the browsers (@scf2k).
Add ability to ignore certain elements when comparing screenshots. Use suite.ignoreElements(selector1, selector2, ...) to specify the selectors to ignore (@SevInf).
Add tap action for touch devices (@scf2k).
gemini is now works correctly if page changes during the test (@scf2k).
Correctly handle missing timeout in waitForElementXXX (@SevInf).
Correctly report image path in gather API (@SevInf).

0.9.7 - 2015-02-09

Add new wait methods (@SevInf):
- waitForElementToShow
- waitForElementToHide
- waitForJSCondition

0.9.6 - 2015-01-27

Work on a pages that modify Array.prototype (@SevInf).

0.9.5 - 2014-12-10

Works on Windows again (@SevInf).

0.9.4 - 2014-12-03

Add sendFile action which now should be used instead of sendKeys to set a file to input[type=file] elements (@SevInf).
Correctly parse box-shadow in IE9 (@scf2k).
Fail only single test if reference image is not found (@SevInf).

0.9.3 - 2014-11-07

Coverage generator now follows symlinks while resolving the paths to CSS files. So the final report will have real paths but not pointing to symlinks.

0.9.2 - 2014-11-07

Move the coverage HTML templating code to separate module (gemini-coverage).
Detailed error message when capture region exceeds screenshot area. Such error also will now fail only single state instead of a whole testing process (@SevInf).

0.9.1 - 2014-10-23

Ignore @keyframes at-rule while collecting coverage (@scf2k).

0.9.0 - 2014-10-22

Replace GraphicsMagick with lightweight png-img library (@j0tunn). As for this version, gemini no longer requires any external tool for image processing.
CSS coverage now supports source maps (@scf2k).

If your CSS has the sourcemap, coverage report will show original files.

You can use sourceRoot option to tell gemini where are your sources located on a filesystem.
CSS coverages statistics will now also be written to coverage.json file (@scf2k).
Add coverageExclude option to allow exclude certain files from coverage report (@scf2k).
Add index page to coverage report and improve appearance of a the coverage pages (@scf2k).
Restructure documentation and add quick start guide in russian and english (@jk708).

0.8.2 - 2014-10-06

Reset cursor position before reloading the page. When resetting it just after page load, old cursor position may trigger some transitions which will not be finished before first screenshot.

0.8.1 – 2014-09-30

test command will exit with correct codes

0.8.0 - 2014-09-30

New image comparison algorithm is implemented:
- gm compare replaced with custom diff. For now, GraphicsMagick is still required for other image manipulations.
- tolerance setting is removed in favor of "strict mode": by default, only noticable changes (according to ciede2000 metric) will be treated as failure, to treat all changes that way user can enable strictComparison option.
- in case if some element in focus during test can potentially have blinking caret displayed, diff will try to ignore caret.
Remove built-in TeamCity reporter. If you really want it, you can adapt 0.7.x reporter to the current version of gemini and publish it in separate package.
Remove legacy ability to specify browsers as array which was deprecated since 0.4.0.
Add experimental programmatic API.
Add --grep option to gather and test commands, which allows to execute only suites, matching the pattern (@scf2k).
Show required dimensions in error message when origin does not fir to full-page screenshot (@scf2k)

0.7.0 - 2014-09-15

Show meaningful error when capture area origin does not fit to full-page screenshot. This change can break some of your tests (@scf2k).
Add experimental CSS-coverage report. Enable with --coverage CLI flag or coverage: true in config (@scf2k).
Add ability to override gridUrl,rootUrl, screenshotsDir, debug config options by their respective CLI options or environment variables (@arikon).
Add config option windowSize to specify default size of the browser windows (@scf2k).
Add action setWindowSize to specify browser window size during the tests (@scf2k).

0.6.5 - 2014-09-12

Was republished as 0.7.0 due to a breaking change.

0.6.4 - 2014-08-13

Add command line completion (@unlok).
Show an error, when config file has unknown options.
Add focus(element) action (@arikon).

0.6.3 - 2014-08-05

Allow to use empty string with sendKeys. It can be used to focus on an element without changing states.

0.6.2 - 2014-08-01

Reset mouse position for each suite. Previously, cursor may stay at the position left from a previous suite and some elements was captured with hover effect when there shouldn't be any.

0.6.1 - 2014-07-30

Fix incorrect capture region rounding, causing bottom row of the element to be cropped sometimes.

0.6.0 - 2014-07-28

:before and :after pseudo-elements outline and shadow are now taken into account when calculating capture region(@incorp).

This change can break some of your tests. Re-gather reference images to fix the problem.
Added tolerance config option which can be used to specify maximum error rate before images will be treated as unequal. Default tolerance to 0. This is stricter then previous versions: now every, even slightest difference between reference and current images will fail tests.

Set tolerance to 0.001 in .gemini.yml to restore 0.5.x behavior.
Coordinates of capture region are now rounded to capture maximal area. Previously, border pixels could be cropped, due to rounding error. This change can break some of your tests. Re-gather reference images to fix the problem.
Added ability to change diff highlight color in config file.
Change diff highlight style
Global installations of gemini now runs local one, if available.

0.5.0 - 2014-07-17

Browsers are now launched once for each run (previously, they were launched once per suite). This greatly reduces total tests run time, but can break some of your code, i.e. each mouseDown should always be closed by mouseUp.

Previously, this was not required if mouseDown was used once for suite.

It will show warning if versions of the modules does not match.
flat reporter replaces tree. Tree reporter can not work with new browser launch model.
Add parallelLimit option that allows to limit number of browsers run in parallel.
Add suite.after() which can be used to perform some action after all of the states without taking screenshot.
Unknown errors, returned by Selenium have more detailed report.
Fix --version option.

0.4.2 - 2014-06-25

Fix missing images in html report.

0.4.1 - 2014-06-19

Correctly detect crop region in Firefox

0.4.0 - 2014-06-18

Crop region for screenshots is calculated via client script inside browser instead of gemini. This allows to issue fewer requests to Selenium Server speeding up total tests run time. This feature breaks compatibility with old browsers (IE < 9).

New config format, which allows to specify full set of capabilities for browsers:

browsers:
  phantomjs: phantomjs
  opera12:
      browserName: opera
      version: '12.06'
      platform: 'WINDOWS'
  firefox28:
      browserName: firefox
      version: '28.0'
  firefox27:
      browserName: firefox
      version: '27.0'

Correctly capture screenshots of regions out of initial browser viewport in browsers, that can't capture full page (Opera and Chrome at the time of writing).
outline-width of an elements is now also taken into account when calculating crop region.
Add debug options to config file. If set to true, gemini will print debug logs to STDOUT. (@arikon).
Add http section to config file which allows to configure HTTP timeout (http.timeout) retry count (http.retries) and delay between retries (http.retryDelay). (@arikon).
Asynchronous errors stacktraces in browser actions (such as not found element) will point to users code.
More HTTP requests to Selenium will run in parallel speeding up gather/test commands (@arikon).
If gemini is run without subcommand, help text will be shown.

0.3.4 - 2014-05-28

Enhanced html report:
- suites are now collapsible;
- all but failed suites are collapsed by default;
- buttons to expand all, collapse all and expand only errors are added;
- stats of total numbers of tests run, failed, succeeded and skipped are shown at the top.

0.3.3 - 2014-05-19

Allow to use multiple reporters in test command.
Throw error when creating multiple suites of the same name within the same parent.
Throw error when creating multiple states of the same name within the suite.
Throw error when creating suite that will be unable to run ( has states and hasn't url or capture region);
Check argument types of SuiteBuilder methods.
Check argument types of all actions methods.
Shorter stacktraces for invalid elements errors.
Correctly handle offsets in mouseMove actions.
Fix error when gridUrl was required even if there is only phantomjs browser.

0.3.2 - 2014-05-15

Allow to override gridUrl and rootUrl settings with cli options --grid-url and --root-url.
Correctly report error, when wrong argument passed to an action.

0.3.1 - 2014-05-13

Ability to set additional capabilities for all browsers, using capabilities option in .gemini.yml:
```
capabilities:
  option1: value,
  option2: value
```
Non-existent directories, passed to gather and test commands will be filtered out
If fatal error occurs, gemini will always exit with 1 status code
If test fails or state error occurs, gemini will always exit with 2 status code.
When gemini is unable to launch browser, more clearer error message will be displayed.

0.3.0 - 2014-04-30

Elements to take screen shots of and elements to perform action on are now defined differently. setElements and setDynmaicElements methods removed.

New way to define elements for screenshot:
```
suite.setCaptureElements('.selector1', '.selector2', ...)
```
Or using array:
```
suite.setCaptureElements(['.selector1', '.selector2', ...])
```
To get element to perform action on, you can now pass selectors directly to the actions:
```
suite.capture('state', function(actions, find) {
    actions.click('.button');
});
```
To avoid multiple lookups for the same element you can use find function which is now passed to the state callback:
```
suite.capture('state', function(actions, find) {
    var button = find('.button');
    actions.mouseMove(button);
           .click(button);
});
```

Add suite.before(function(action, find)) which can be used to perform some actions before the first state. Context is shared between before hook and all of suite's state callbacks.

You can use before to look for element only once for the state:

suite.before(function(actions, find) {
    this.button = find('.buttons');
})
.capture('hovered', function(actions, find) {
    actions.mouseMove(this.button);
})
.capture('pressed', function(actions, find) {
    actions.mouseDown(this.button);
});

Or to perform some actions before first state without taking screenshot:

suite.before(function(actions, find) {
    actions.click('.button');
});

Add suite.skip() method which allows to skip suite in some set of browsers:
- suite.skip() - skip in all browsers.
- suite.skip('chrome') - skip in all versions of Chrome.
- suite.skip({name: 'chrome', version: '33.0'}) - skip in Chrome 33.0
- suite.skip(['chrome', 'opera']) - skip in Chrome and Opera
Public API now has constants for special keys to use in sendKeys actions (i.e. gemini.CONTROL for CTRL key).

0.2.1 - 2014-04-23

Fix a bug with incorrect reference to the suite in states. Because of this bug dynamic elements was not updated properly.

0.2.0 - 2014-04-22

New test suites API. Plans are replaced by test suites defined by explicit call.

Old version:

module.exports = function(plan) {
    plan.setName('some name')
        .setElements(...)
        .setDynamicElements(...)
        .capture(...)

};

New API:

var gemini = require('gemini');

gemini.suite('some name', function(suite) {
    suite.setElements(...)
        .setDynamicElements(...)
        .capture(...)

};

Suites also can be nested. In this case, child suite inherits all properties from the parent.

gemin.suite('parent', function(suite) {
    gemini.suite('child', function(child) {
        gemini.suite('grandchild', function(grandchild) {

        });
    });
});

.reload() method is removed. Use nested suite if you need to reload browser.

Added action to run any JS code in browser context:

actions.executeJS(function(window) {
    window.alert('Hello!');
});

sendKeys action can optionally take an receive an element to send keys to.
```
actions.sendKeys(elements.someInput, 'hello');
```
Added ability to specify browser version in .gemini.yml
```
browsers:
  - {name: 'phantomjs', version: '1.9'}
```
Tree reporter is now used for gather command.

0.1.1 - 2014-04-08

phantomjs always starts maximized. This fixes the error, when some shadows didn't fit in crop rectangle.
Action on dynamic element that does not currently exists causes non-fatal error. Such error will fail only one state, the rest will continue running.
gather command now reports browser name.
browsers are always closed, even if there was an error.

0.1.0 - 2014-03-27

Initial release

Files

CHANGELOG.md

Latest commit

History