## Change Log

### upcoming (2018-08-14)
- [78918ec](https://github.com/bda-research/node-crawler/commit/78918ec0bbdee265bb3587ae444c64888b0a225b) remove node v4.x in travis-ci (@mike442144)
- [f66c405](https://github.com/bda-research/node-crawler/commit/f66c40527875b7b99eee9caa21d14318c4fccae1) Switch to eslint code checker and updated README.md (@mike442144)
- [26b2360](https://github.com/bda-research/node-crawler/commit/26b23604d9a3c8acfcdaf8396d765e2e208202df) fix conflict in README (@mike442144)
- [be14d99](https://github.com/bda-research/node-crawler/commit/be14d9959054b5b146de2406eed7257c057f5628) added coveralls dependency (@mike442144)
- [#280](https://github.com/bda-research/node-crawler/pull/280) 20180611 updatetestwithnock (@Dong-Gao)
- [baed4ef](https://github.com/bda-research/node-crawler/commit/baed4ef66a0456cef7eccc0ce98e136e9dbd4a06) remove travis before install script (@mike442144)
- [#278](https://github.com/bda-research/node-crawler/pull/278) Added filestream require to download section (@swosko)
- [78d5953](https://github.com/bda-research/node-crawler/commit/78d595348f0cb6de50717187c3174841883d54e0) nock added (@Dong-Gao)
- [7de207a](https://github.com/bda-research/node-crawler/commit/7de207a41ed1775b0481f9f4032e17b2ecdd93d6) nock added (@Dong-Gao)
- [69585ff](https://github.com/bda-research/node-crawler/commit/69585ff6df0e9e7d95568396ad24af5ebfc0f2e2) nock added (@Dong-Gao)
- [27f4d6b](https://github.com/bda-research/node-crawler/commit/27f4d6b7ac648bcc5440a93aff15bbb26c073bc9) Update README.md (@mike442144)
- [52aeec8](https://github.com/bda-research/node-crawler/commit/52aeec8ce3e9fa6b18980deb1e4a45e5b8247c0d) Added filestream require to download section (@swosko)
- [479b733](https://github.com/bda-research/node-crawler/commit/479b733f4f1228ea8893fc4f90269c43f6100681) update clearAll (@mike442144)
- [742bc57](https://github.com/bda-research/node-crawler/commit/742bc57da2bb76041ecde156e50217a2ace9e5bc) Merge branch '20180611_updatetestwithnock' of https://github.com/bda-research/node-crawler into 20180611_updatetestwithnock (@patrickzxk)
- [3547c8b](https://github.com/bda-research/node-crawler/commit/3547c8b624a1687bb94b9f7e248f6c4fd37995a1) update to match jshint requirements (@patrickzxk)
- [4234572](https://github.com/bda-research/node-crawler/commit/423457226dd0949c8538262d6cefb738e357c3be) clean nock interceptors before each test (@darrenqc)
- [9cb327d](https://github.com/bda-research/node-crawler/commit/9cb327d2cf4822e2b2750cc01f27b16089e46052) add nock.cleanAll() (@patrickzxk)
- [f27cddf](https://github.com/bda-research/node-crawler/commit/f27cddf24ec574e59934073a670d4ac9ac70c0e7) add 'jshint expr:true' (@patrickzxk)
- [00379ea](https://github.com/bda-research/node-crawler/commit/00379ea331cc8899c0fb1528bd9eae8a7ae28165) replace httpbin with nock
- [7172e8d](https://github.com/bda-research/node-crawler/commit/7172e8d3ae19accddf35acf7b3d4e7cd969a2e54) fix cover script timeout (@mike442144)
- [4465ffd](https://github.com/bda-research/node-crawler/commit/4465ffd288733fddd356223d6c8bc17f3265f5de) encoding and requests test (@mike442144)
- [aa79b04](https://github.com/bda-research/node-crawler/commit/aa79b0453953b46e6113de8e54ee7e2848075213) Merge branch '20180611_updatetestwithnock' of github.com:bda-research/node-crawler into 20180611_updatetestwithnock (@mike442144)
- [751f529](https://github.com/bda-research/node-crawler/commit/751f529ff4b29d1728886fb2604a258a6ef38851) Merge branch '20180611_updatetestwithnock' of https://github.com/bda-research/node-crawler into 20180611_updatetestwithnock (@darrenqc)
- [0a20c20](https://github.com/bda-research/node-crawler/commit/0a20c20a13bf4cd6b2fb9264eb3fda0f4d53ef20) update 6/17 tests (@darrenqc)
- [3e077cb](https://github.com/bda-research/node-crawler/commit/3e077cb54c226bfbd6a1c802ff68d8cdb48c9309) added istanbul dependency (@mike442144)
- [03a2532](https://github.com/bda-research/node-crawler/commit/03a2532ac929780096fb5c96f8b27c6fde8e740c) added coveralls.io integration (@mike442144)
- [b250d42](https://github.com/bda-research/node-crawler/commit/b250d4281d946df647a4ff5baf8fe39220a4b13c) added cover and hint scripts (@mike442144)
- [c816026](https://github.com/bda-research/node-crawler/commit/c816026e7e563fc9faec68749baac4540fc2f898) refactor callback.test.js (@mike442144)
- [c94404e](https://github.com/bda-research/node-crawler/commit/c94404e50e5434c64d2e8ee712e12e1ba2d2be6a) update direct.test.js (@darrenqc)
- [3ec8704](https://github.com/bda-research/node-crawler/commit/3ec870437ef4fa3733f724a902ca1aa9573981e3) examples -> README (@mike442144)
- [a116947](https://github.com/bda-research/node-crawler/commit/a116947cf240444bf10230915dc97d688252b575) 1.1.4 (@mike442144)
- [#270](https://github.com/bda-research/node-crawler/pull/270) fix the ";" problem in content-type of type-is (@h2012c106)
- [#272](https://github.com/bda-research/node-crawler/pull/272) Added examples documentation (@sunnyhuang2008)
- [7bcf5ce](https://github.com/bda-research/node-crawler/commit/7bcf5ceddc60913e9c918c256090aa5dd29e0623) add trim()
- [b2e311a](https://github.com/bda-research/node-crawler/commit/b2e311aa94de46dea8134fee84966671c359b767) Revised documentation again (@sunnyhuang2008)
- [8934779](https://github.com/bda-research/node-crawler/commit/8934779c5ca0f0e50f5ba25ca6992b5465be6f45) Revised documentation (@sunnyhuang2008)
- [c19664d](https://github.com/bda-research/node-crawler/commit/c19664dedbf00d7ff3db844f0879668e048dc201) Added examples (@sunnyhuang2008)
- [65080a8](https://github.com/bda-research/node-crawler/commit/65080a8f8cc216d09d5dbfb22d7f8203e3d12e5a) Merge branch 'master' of github.com:bda-research/node-crawler (@mike442144)
- [8d33a3d](https://github.com/bda-research/node-crawler/commit/8d33a3db74d9d591994125dfb270cbf0d33b70bc) init examples folder (@mike442144)
- [b3aaf13](https://github.com/bda-research/node-crawler/commit/b3aaf1306723bfb6a0712e786426dacda8036b96) fix the ";" problem in content-type of type-is
- [#269](https://github.com/bda-research/node-crawler/pull/269) Allow to retry when skipDuplicates is enabled (@thomas-hilaire)
- [#268](https://github.com/bda-research/node-crawler/pull/268) Fix typo in readme (@lahaxearnaud)
- [ac63844](https://github.com/bda-research/node-crawler/commit/ac638444d6d109961d9aa75cd09bfeb71df12dd1) Allow to retry when skipDuplicates is enabled (@thomas-hilaire)
- [b70b3a1](https://github.com/bda-research/node-crawler/commit/b70b3a170c53cf6f2290c39466ba16dbd693504a) Fix typo in readme (@lahaxearnaud)
- [65d25f2](https://github.com/bda-research/node-crawler/commit/65d25f28aaa81d89951693d3a28cdaeb23c8189b) Merge branch 'master' of github.com:bda-research/node-crawler (@mike442144)
- [dc83c24](https://github.com/bda-research/node-crawler/commit/dc83c246c928d430a06dc32bdd5dbda46c43dd30) upgrade dependency (@mike442144)
- [#252](https://github.com/bda-research/node-crawler/pull/252) python 3 and more recent node-stretch (@gardsted)
- [#253](https://github.com/bda-research/node-crawler/pull/253) fix code block languages (@brad811)
- [e074bd9](https://github.com/bda-research/node-crawler/commit/e074bd9e40226d66e9e348d5a39092d073fc021f) fix code block languages (@brad811)
- [#2](https://github.com/bda-research/node-crawler/pull/2) use python3 and later node-stretch (@gardsted)
- [02d835f](https://github.com/bda-research/node-crawler/commit/02d835f467661a252f0e9f635d523fe7fb80f7d4) Update Dockerfile (@gardsted)
- [#1](https://github.com/bda-research/node-crawler/pull/1) cffi - new version, python.h needed for compile (@gardsted)
- [2eaccd6](https://github.com/bda-research/node-crawler/commit/2eaccd622a5001d25fcdd4a4443c69461b41b3c1) cffi - new version, python.h needed for compile (@gardsted)
- [121e2e8](https://github.com/bda-research/node-crawler/commit/121e2e8691c27da2aa49e562ab2790b45446e6e0) update jshintrc (@mike442144)
- [f4344ab](https://github.com/bda-research/node-crawler/commit/f4344ab6e18a4beb52bf8c9d649e772db5f29259) Merge branch 'master' of github.com:bda-research/node-crawler (@mike442144)
- [498fff8](https://github.com/bda-research/node-crawler/commit/498fff8a6a1b07cac53d6be08f06d62e1ab7ce70) 1.1.2 (@mike442144)
- [#246](https://github.com/bda-research/node-crawler/pull/246) Allow options to specify the Agent for Request (@darket-software)
- [46d933f](https://github.com/bda-research/node-crawler/commit/46d933f4ef32e957694113ebce0a82360f976f1a) Merge branch 'master' of github.com:bda-research/node-crawler (@mike442144)
- [e3bcb87](https://github.com/bda-research/node-crawler/commit/e3bcb87ae73a3619b77ab9615e619d6271139b81) add logo and Chinese docs link (@mike442144)
- [81ca9e4](https://github.com/bda-research/node-crawler/commit/81ca9e4daec820ffa64cbdad9f694de4e29cc05f) upload logo (@mike442144)
- [5b8d861](https://github.com/bda-research/node-crawler/commit/5b8d861235764e87319a3a89e380e4cef8a8095f) Allow options to specify the Agent for Request (@spectral-sys0p)
- [#245](https://github.com/bda-research/node-crawler/pull/245) Recognize all XML MIME types to inject jQuery (@nolandg)
- [8babcc7](https://github.com/bda-research/node-crawler/commit/8babcc7b6ce5cdb62a6088a4d59f71f63a8e3565) Recognize all XML MIME types to inject jQuery (@nolandg)
- [fbda80c](https://github.com/bda-research/node-crawler/commit/fbda80c0febc71fd452145bf7ab95eaeba680355) update badges (@mike442144)
- [9bb51bd](https://github.com/bda-research/node-crawler/commit/9bb51bdcdc9d9cb43128267b65cba9073d716f5d) add link (@mike442144)
- [201a2e2](https://github.com/bda-research/node-crawler/commit/201a2e2aca24ab42ab331c60d912c019e74b838c) update CHANGELOG (@mike442144)
- [097b008](https://github.com/bda-research/node-crawler/commit/097b008c72ea793fce8e01167663f7ff165f1a9b) #241 (@mike442144)
- [83c855f](https://github.com/bda-research/node-crawler/commit/83c855f2a22b572a5416bbd1677e29d0b431722a) fix #240 (@mike442144)
- [11983af](https://github.com/bda-research/node-crawler/commit/11983af6ea9d53383921600ab89fce990bd31536) fix #208, upgrade request version (@mike442144)
- [de8aacc](https://github.com/bda-research/node-crawler/commit/de8aacc69e44f0a43814e76b3a3c020f825ac3be) Merge branch 'master' of github.com:bda-research/node-crawler (@mike442144)
- [4214909](https://github.com/bda-research/node-crawler/commit/42149097ffa5ab7152a2bc6eb5abd3e2ed32f4a8) uri undefined when retry (@mike442144)
- [1483634](https://github.com/bda-research/node-crawler/commit/1483634510fc27f8a15f8d90d8b202fd1f21fd45) fig bug#233 (@darrenqc)
- [8702511](https://github.com/bda-research/node-crawler/commit/870251155f3759582e25b0390f532bfc57f8e9ad) Update README.md (@darrenqc)
- [fee903d](https://github.com/bda-research/node-crawler/commit/fee903df0ee00e4d0ebd66d061b7b1194f09a6df) test case and package.json (@darrenqc)
- [2cbf177](https://github.com/bda-research/node-crawler/commit/2cbf177ab90d062d50dcecf643b23716bb630e59) add preRequest, setLimiterProperty, direct request and fix logger bug when using configured winston logger (@darrenqc)
- [#224](https://github.com/bda-research/node-crawler/pull/224) request not requests (@tleb)
- [bc5a130](https://github.com/bda-research/node-crawler/commit/bc5a130b2d68dc5f730a81b3ea9618e63d258af9) request not requests (@tleb)
- [d1ea1cd](https://github.com/bda-research/node-crawler/commit/d1ea1cdad696b5ff1d17bab14694263befdf8712) update README (@mike442144)
- [0f3a27d](https://github.com/bda-research/node-crawler/commit/0f3a27d4e89d93fcf9c27a417adbba6fab9dde2e) resolve conflict (@mike442144)
- [e751b35](https://github.com/bda-research/node-crawler/commit/e751b359e74af000fe2c43814877fe6ae20a7fba) fix defect #213 (@mike442144)
- [08ff542](https://github.com/bda-research/node-crawler/commit/08ff542461b7ef343fc84f011290e83f8929050a) fix #210 (@darrenqc)
- [052171a](https://github.com/bda-research/node-crawler/commit/052171a21f78c1a6798fdc243cd4c0fadd12c905) Merge branch 'master' of github.com:bda-research/node-crawler (@mike442144)
- [57e0ae4](https://github.com/bda-research/node-crawler/commit/57e0ae465833b5531a57ce90d929fdc3b2abda98) #211 (@mike442144)
- [#212](https://github.com/bda-research/node-crawler/pull/212) fix typo in README.md (@bryanchriswhite)
- [7f6d8e3](https://github.com/bda-research/node-crawler/commit/7f6d8e398e7897ec6d3bae31d888e3f105a9fb2a) fix type in README.md (@bryanchriswhite)
- [2f87910](https://github.com/bda-research/node-crawler/commit/2f87910eacaf4d55f8b617da8805452ea43cc2b8) update README (@mike442144)
- [aa194c6](https://github.com/bda-research/node-crawler/commit/aa194c6f7c4132c33b274c633a239c0ed73962dd) Merge branch 'master' of github.com:bda-research/node-crawler (@mike442144)
- [a1c81f1](https://github.com/bda-research/node-crawler/commit/a1c81f1f4bda853245ea8312dfa2a3781cca032a) update README (@mike442144)
- [489041b](https://github.com/bda-research/node-crawler/commit/489041b4ff1846eeb22a1c5ed493a34cd208c2d2) add gitter badge (@mike442144)
- [a4af6cb](https://github.com/bda-research/node-crawler/commit/a4af6cbea64670a30c1a4db342e620b902904680) Create CNAME (@mike442144)
- [c1a2fa1](https://github.com/bda-research/node-crawler/commit/c1a2fa1eb2045020f786a532ef590746ff19cd02) Set theme jekyll-theme-tactile (@mike442144)
- [be16f2a](https://github.com/bda-research/node-crawler/commit/be16f2abec4a1458af9b7a4ed8ccd6f624d09fbe) Add todo list item (@mike442144)
- [#206](https://github.com/bda-research/node-crawler/pull/206) Remove unused 'url' import (@AlexTes)
- [16e372b](https://github.com/bda-research/node-crawler/commit/16e372b3aea52ab06ef21a39255067939a03a76b) add changelog (@mike442144)
- [4542cf3](https://github.com/bda-research/node-crawler/commit/4542cf348f38aa9ebdd0702ef2bf60664947f9d7) Merge branch 'master' of github.com:bda-research/node-crawler (@mike442144)
- [31afe2f](https://github.com/bda-research/node-crawler/commit/31afe2f4e49867d86a2ada33e5c55795026c6fcf) fix #203 (@mike442144)
- [bcab748](https://github.com/bda-research/node-crawler/commit/bcab74855ca65ba0870b9e99592c91c8625d2f24) Remove unused 'url' import (@alextes)
- [#198](https://github.com/bda-research/node-crawler/pull/198) Inject JQuery in xhtml documents (@suhaibtamimi)
- [#197](https://github.com/bda-research/node-crawler/pull/197) Update README.md. it is not required to deal with compiling C++ (contextify) in order to use JSDOM (@suhaibtamimi)
- [144edc2](https://github.com/bda-research/node-crawler/commit/144edc2180940c4398b518e2047d84771da3cafb) Inject JQuery in xhtml documents (@SuhaibMujahid)
- [9ab0a9d](https://github.com/bda-research/node-crawler/commit/9ab0a9df31667c1bb26d32c424c111c6c658fb38) Update README.md (@SuhaibMujahid)
- [e7b8db6](https://github.com/bda-research/node-crawler/commit/e7b8db60256e22bdd26907d7794b5677fa9afa5e) modify doc.bottleneck, fix bug for global only option (@darrenqc)
- [#191](https://github.com/bda-research/node-crawler/pull/191) spelling typo fixes and JSDOM reference case consistency. (@prashantghimire)
- [f4f67fa](https://github.com/bda-research/node-crawler/commit/f4f67fa43d1725759e09d56e726a4a29c5f734cd) Update README.md (@prashantghimire)
- [499cc6a](https://github.com/bda-research/node-crawler/commit/499cc6a877f8190f2c05c6890d322796ec100f5b) spelling typo fixes and JSDOM reference case consistency. (@prashantghimire)
- [f3b730c](https://github.com/bda-research/node-crawler/commit/f3b730ca881a433e3ff77828dabff1445889f83f) fix #182 (@mike442144)
- [497b982](https://github.com/bda-research/node-crawler/commit/497b98225d0e608870619aae077fa3741c0b0e11) fix #185 (@mike442144)
- [a1cd581](https://github.com/bda-research/node-crawler/commit/a1cd5817b0e4cbf6e70cf85f1989df188b9aeeb3) add engin to package.json (@mike442144)
- [90c8ebe](https://github.com/bda-research/node-crawler/commit/90c8ebe9784d799215cca4da6aad4f3fc854479b) 1.0.1 (@mike442144)
- [4e7405c](https://github.com/bda-research/node-crawler/commit/4e7405c4e017de7c01b13315309a8024fe84801b) release (@mike442144)
- [9ba170f](https://github.com/bda-research/node-crawler/commit/9ba170ffef1cd82b7b3dd399866245c370989bc7) update CHANGELOG (@mike442144)
- [444b438](https://github.com/bda-research/node-crawler/commit/444b4382e944b9c3109f4ed00dc7d4ffd599a13c) fix bug in test case (@mike442144)
- [2d1a4ff](https://github.com/bda-research/node-crawler/commit/2d1a4ff958d0a0d571ecad0821576e25d3578371) change callback api, move $ into response (@mike442144)
- [11d8029](https://github.com/bda-research/node-crawler/commit/11d80293e7f30005c200750e02a796b473fccfff) Update README.md (@darrenqc)
- [717abde](https://github.com/bda-research/node-crawler/commit/717abde02d25b7e7c43968439bf58bc62d991fa2) update test (@mike442144)
- [bfb2f78](https://github.com/bda-research/node-crawler/commit/bfb2f781eb499562ac4f1f36f861c1064955be4c) Merge branch '1.0.0-beta' of github.com:bda-research/node-crawler into 1.0.0-beta (@mike442144)
- [83161c8](https://github.com/bda-research/node-crawler/commit/83161c8a5e5593b851f6d46b1337df15090d2516) update README, CHANGELOG and test case (@mike442144)
- [f2598bc](https://github.com/bda-research/node-crawler/commit/f2598bc6c422b1b3faee892b01c50d8851fb0668) no message (@authuir)
- [1bcb3f8](https://github.com/bda-research/node-crawler/commit/1bcb3f8f7b740cef59a3ff13f4b5e95a93edfb29) Addtion of README (@authuir)
- [e2999ce](https://github.com/bda-research/node-crawler/commit/e2999ce9111f7abe44d4c28256060bf2fc1184f4) Modified README file (@authuir)
- [3b378d3](https://github.com/bda-research/node-crawler/commit/3b378d33b674e724d8ce4daae61009ceeddf9968) Merge branch '1.0.0-beta' of github.com:bda-research/node-crawler into 1.0.0-beta (@mike442144)
- [5bffbeb](https://github.com/bda-research/node-crawler/commit/5bffbebb75e710c1668ead09113ac4804cd7d9b8) fix bug of error without callback (@mike442144)
- [463357b](https://github.com/bda-research/node-crawler/commit/463357b4c60d502013cefa35f81f7c63d7cc6221) Modified test part of Dockerfile (@authuir)
- [847fe4f](https://github.com/bda-research/node-crawler/commit/847fe4f6c8195857074f9c9a64629fe6a214e4a8) fix bug of missing releasing bottleneck resource without no callback (@mike442144)
- [8dd4bc3](https://github.com/bda-research/node-crawler/commit/8dd4bc3638fa09ba57915ac75014be18f68b673f) call done when finish in callback (@mike442144)
- [503a45f](https://github.com/bda-research/node-crawler/commit/503a45fd63c4d865192b5623fa9584c0a344342b) change node version in ci (@mike442144)
- [9fd0401](https://github.com/bda-research/node-crawler/commit/9fd04014e2913fac8cfd295712990235cb24c88e) use latest node in docker (@mike442144)
- [c72c4a2](https://github.com/bda-research/node-crawler/commit/c72c4a27587310b68da0237ad861835a32bcf08b) depart node version when testing (@mike442144)
- [64b6604](https://github.com/bda-research/node-crawler/commit/64b6604be9499bb4bf789019ac22e431589ea946) add type-is dependency (@mike442144)
- [7188389](https://github.com/bda-research/node-crawler/commit/71883892bfb862b1914b04b0d49e9c0b71bd151a) solve conflict of CHANGELOG (@mike442144)
- [af0e388](https://github.com/bda-research/node-crawler/commit/af0e38849530dfb7f465719ab46c5066befcf32f) 1.0.0 (@mike442144)
- [4c0e6b3](https://github.com/bda-research/node-crawler/commit/4c0e6b3e4f5c0278a4ba7503ea777d4cf09fb498) Update CHANGELOG.md (@mike442144)
- [dbd2f5f](https://github.com/bda-research/node-crawler/commit/dbd2f5fbb9c4a07f3640b812b36c6eb2c0e72f13) Update README.md (@mike442144)
- [f77e78b](https://github.com/bda-research/node-crawler/commit/f77e78b7310185039f54f965adec94c96a0454ec) Update CHANGELOG.md (@mike442144)
- [b6f1abb](https://github.com/bda-research/node-crawler/commit/b6f1abb2eb3643e0d0c254deaa17af448d5511f0) Update CHANGELOG.md (@mike442144)
- [f3f944b](https://github.com/bda-research/node-crawler/commit/f3f944ba88b418f4bb95e7af9bac389237bf46c2) Update CHANGELOG.md (@mike442144)
- [9c6a6d2](https://github.com/bda-research/node-crawler/commit/9c6a6d2bb609a2eed82d2b975d178e89da6c7649) Update CHANGELOG.md (@mike442144)
- [b478234](https://github.com/bda-research/node-crawler/commit/b478234f57d236716feaf35aeeaf247e79e73fb3) Update CHANGELOG.md (@mike442144)
- [e860b98](https://github.com/bda-research/node-crawler/commit/e860b98d319fce6575fb4d3e4dd15dc4da7b04c8) remove support 0.10 and 0.12 (@mike442144)
- [e357052](https://github.com/bda-research/node-crawler/commit/e3570523e841c72af98bff12cdd2997b8de395bb) upgrade jsdom version (@mike442144)
- [ed07795](https://github.com/bda-research/node-crawler/commit/ed0779522b1625bd9eb0c3fe61a2f0d162848ea6) 1.0.0-beta (@mike442144)
- [6b924d2](https://github.com/bda-research/node-crawler/commit/6b924d239a05917ed641f15276cfe61109acda2e) apply to 0.7.5 version (@mike442144)
- [abedb7b](https://github.com/bda-research/node-crawler/commit/abedb7bbf6c9e35fc540389c2d7495f58e8fd94b) update README (@mike442144)
- [9f5339b](https://github.com/bda-research/node-crawler/commit/9f5339bcc8144a835227771c55e3d89f21979c4b) Update README.md (@sylvinus)
- [#161](https://github.com/bda-research/node-crawler/pull/161) Added response.bodyRAW that needed if server returns binary data (@Systerr)
- [24497fb](https://github.com/bda-research/node-crawler/commit/24497fbdcd411e05b3bc7c3bc0744334a09bab6c) add response.bodyRAW that needed if server returns binary file instead of text response (@Systerr)
- [ae3672c](https://github.com/bda-research/node-crawler/commit/ae3672c185ede4d0d1006f3a22e5b00ce0a7a4b5) Update README.md (@paulvalla)
- [587f31a](https://github.com/bda-research/node-crawler/commit/587f31a44c5e172a7637923b661dbcc8394b73d7) Update README.md (@paulvalla)
- [dc47a9e](https://github.com/bda-research/node-crawler/commit/dc47a9e257805219e1ab1a1e2c331288b9905dff) 0.4.3 (@paulvalla)
- [#147](https://github.com/bda-research/node-crawler/pull/147) Upgrade iconv version to work with node 0.12 (@digitalfrost)
- [8d39b65](https://github.com/bda-research/node-crawler/commit/8d39b65f52ef80f5b4e1c7ed48e7cdbc4e8f5ac1) upgrade mocha to version compatible with node 0.12 (@digitalfrost)
- [a761fc5](https://github.com/bda-research/node-crawler/commit/a761fc59d3bd24b357d38ded3d3d62ab1c622a01) upgrade iconv to version compatible with node 0.12 (@digitalfrost)
- [ee41ccc](https://github.com/bda-research/node-crawler/commit/ee41cccdcc573e6739fcbbffe811d13be0353211) 0.4.2 (@paulvalla)
- [4d770c0](https://github.com/bda-research/node-crawler/commit/4d770c0de4ac60beb07fd94b7555399c632fea7e) Update README.md (@paulvalla)
- [6822559](https://github.com/bda-research/node-crawler/commit/6822559cd2b49aa69e39ff07d61ca92b76fe03ca) queue instead of accidentaly pushToQueue options= undefined (@paulvalla)
- [2b416ba](https://github.com/bda-research/node-crawler/commit/2b416bac3f62b4b24ad2e36373c3d9e1fc466778) Merge git://github.com/TheSighing/node-crawler into refact (@paulvalla)
- [cc53e57](https://github.com/bda-research/node-crawler/commit/cc53e57c6f078fb82339fe1f9aa22bc70320cadc) by by node 0.8 (@paulvalla)
- [a27826e](https://github.com/bda-research/node-crawler/commit/a27826e8904952536bd6bfe8c2609964bf509032) Jsdom now works with malformed html (@paulvalla)
- [d851bca](https://github.com/bda-research/node-crawler/commit/d851bcaba6b66097b964d2a608d1d6f52cf59402) update jsdom dev deps (@paulvalla)
- [f19c96b](https://github.com/bda-research/node-crawler/commit/f19c96bfa503a7f2934e4d545fe78b4d1c78118f) Completed changes to push to contribute. (@TheSighing)
- [8c074eb](https://github.com/bda-research/node-crawler/commit/8c074eb364501ab8377b5323442a1180019fef0f) Completed changes to push to contribute. (@TheSighing)
- [#129](https://github.com/bda-research/node-crawler/pull/129) fixing the typo in the tests link (@curtisj44)
- [00b907e](https://github.com/bda-research/node-crawler/commit/00b907e0a842ef2ac698f39b114a239f9d265708) Added a Dockerfile to make it easy to run tests. Fixes #125 (@sylvinus)
- [9274d97](https://github.com/bda-research/node-crawler/commit/9274d97684001f1d930eb3f0e98b563e8c584250) fixing the typo in the tests link (@curtisj44)

### 0.4.1 (2014-11-14)
- [c1909ce](https://github.com/bda-research/node-crawler/commit/c1909ce58472e7f9d85098c21c62fca0515619da) 0.4.1 (@paulvalla)
- [6fa2fec](https://github.com/bda-research/node-crawler/commit/6fa2fecaa933118e5124799281048959bd9490be) Merge branch 'master' of github.com:sylvinus/node-crawler (@paulvalla)
- [5b17aee](https://github.com/bda-research/node-crawler/commit/5b17aeee58f1b54fd1b2939769d67cd0dd201193) If queue an undefined value, should skip it (@paulvalla)
- [b46dd84](https://github.com/bda-research/node-crawler/commit/b46dd849c3e96b243c85e69aa4fa2d1e208fb938) Update README.md (@paulvalla)
- [#124](https://github.com/bda-research/node-crawler/pull/124) 'skipDuplicates' bug  + test case (@touzbi)
- [e0f228f](https://github.com/bda-research/node-crawler/commit/e0f228f3b28808d57ca8f4c156efc073031b1e90) test 'should not skip one single url when skipDuplicates is active' now passing (@tzbee)
- [dbb3b62](https://github.com/bda-research/node-crawler/commit/dbb3b6291effe078abaf603a41092a837250303f) New test 'should not skip one single url when skipDuplicate is active', not passing (@tzbee)
- [#123](https://github.com/bda-research/node-crawler/pull/123) Added http status code tests (400, 401, 403) (@touzbi)
- [7d789ce](https://github.com/bda-research/node-crawler/commit/7d789ce05eedb35506b0621ae6878a3133fe0003) Added http status code tests (400, 401, 403) (@tzbee)
- [1730188](https://github.com/bda-research/node-crawler/commit/1730188051b6fdf3de101a0962ee54f161dddaaf) update todolist (@paulvalla)

### 0.4.0 (2014-11-08)
- [2daf980](https://github.com/bda-research/node-crawler/commit/2daf980381ff46dd18b215e83f4c8aab7e9f4696) 0.4.0 (@paulvalla)
- [8f6e992](https://github.com/bda-research/node-crawler/commit/8f6e992d4c6b5b4ce4f96f69aa1d812b566f0bbb) Merge branch 'master' of github.com:paulvalla/node-crawler (@paulvalla)
- [93ee443](https://github.com/bda-research/node-crawler/commit/93ee44397c38357cdf9bd7fdf6f615faea5648b1) Update README.md (@paulvalla)
- [077634d](https://github.com/bda-research/node-crawler/commit/077634debaa2ca2cf1ce8a5eba411328a5624bf7) Update README.md (@paulvalla)
- [657295e](https://github.com/bda-research/node-crawler/commit/657295e6e0ab53cd7c2e489c626ee70bae679c34) Update README.md (@paulvalla)
- [89aeb26](https://github.com/bda-research/node-crawler/commit/89aeb260835af8bd7ffabfbf1b7d142c5de9e345) Added cheerio and jsdom doc (@paulvalla)
- [10b86ac](https://github.com/bda-research/node-crawler/commit/10b86ac5d8eb4ad45e4c2d54529ad8934e577e82) Update README.md (@paulvalla)
- [23476c0](https://github.com/bda-research/node-crawler/commit/23476c02d9f8e9c4002ff24c9b8f0253e3fc5fc8) Add a test for the recursive queue example in README using cheerio (@paulvalla)
- [26b6ed6](https://github.com/bda-research/node-crawler/commit/26b6ed68e450063690ba6e565d0e0bf5bcedd5b4) Update README.md (@paulvalla)
- [3144b1d](https://github.com/bda-research/node-crawler/commit/3144b1d4f3d64f800eaeddbede157fa78ca9be42) Update README.md (@paulvalla)
- [bb50cf4](https://github.com/bda-research/node-crawler/commit/bb50cf4c3289706276c4e9a1c749145388e153c9) Update Doc (@paulvalla)
- [c006643](https://github.com/bda-research/node-crawler/commit/c0066436b44cd52d7f2b1cc6898fa3de8665acb0) To use jsdom, you need to require it externally (@paulvalla)
- [91ce367](https://github.com/bda-research/node-crawler/commit/91ce367893065117a8aa671b2f2400e68d4c717c) Enable cheerio by default (@paulvalla)
- [57fbaa7](https://github.com/bda-research/node-crawler/commit/57fbaa7f805fe22908ecee40addc75e26a3ddbbc) up to cheerio 0.18 (@paulvalla)
- [fccc208](https://github.com/bda-research/node-crawler/commit/fccc208d3ec41df5112057b54d443eb7531bf389) up to cheerio 0.18 (@paulvalla)
- [7d94c8a](https://github.com/bda-research/node-crawler/commit/7d94c8af276e8796cc4e8566d62f312fd62370e4) re-organized test files (@paulvalla)
- [2f97765](https://github.com/bda-research/node-crawler/commit/2f977655fc3ba99da88f0efeddc92a8c5c74ba60) Remove dead code (@paulvalla)
- [e53c200](https://github.com/bda-research/node-crawler/commit/e53c2009b5e3d83846523a865bcb1c01876be988) renamed test to tests (@paulvalla)
- [8e1dcbc](https://github.com/bda-research/node-crawler/commit/8e1dcbc4ebe46cd14431d05e90ca88e8b33d7b65) Dead code removed (@paulvalla)
- [89576bb](https://github.com/bda-research/node-crawler/commit/89576bb7e28a68565ffdd253e4edd13b1527dfe8) The JSHINT effect (@paulvalla)
- [7570b46](https://github.com/bda-research/node-crawler/commit/7570b468a31d1eace2120c2ea889dd4137e11490) add a jshintrc file for code consistency (@paulvalla)
- [bde1020](https://github.com/bda-research/node-crawler/commit/bde102047ff56d0e18fc72b581ad00007b52ca15) Test cheerio options loading (@paulvalla)
- [71951db](https://github.com/bda-research/node-crawler/commit/71951db7caef1f94cdb78601c019a7a009671229) Add a test to detect if jquery is set to undefined, then jquery is not injected (@paulvalla)
- [f869cad](https://github.com/bda-research/node-crawler/commit/f869cadba59132ffedb6c81aadd9471f54630535) Update jquery tests (@paulvalla)
- [3860022](https://github.com/bda-research/node-crawler/commit/3860022c94c6cc761902fef62d453c45f82f2790) Moved jquery test from simple to a specific test file (@paulvalla)
- [5276ce3](https://github.com/bda-research/node-crawler/commit/5276ce319d8edf50f173eb3faf6fc7a3bf22bdcc) Install data provider for mocha (@paulvalla)
- [51f60e9](https://github.com/bda-research/node-crawler/commit/51f60e9a337c2958224920b04ac243b0bcdaa970) Moved request only test to a separate file (@paulvalla)
- [8ae1946](https://github.com/bda-research/node-crawler/commit/8ae19469a103fc5b83d33e312d181bb099278965) Use strict (@paulvalla)
- [2909f62](https://github.com/bda-research/node-crawler/commit/2909f6297f16ddcefc142cc63f6258a2ad72c1f5) First Cheerio Draft (@paulvalla)
- [94485e4](https://github.com/bda-research/node-crawler/commit/94485e40b3ec526fbbec6c22f995d3c141ff3132) First Cheerio Draft (@paulvalla)
- [011ffa1](https://github.com/bda-research/node-crawler/commit/011ffa1020c59743590d95bd51f4b4395da2f2ea) return emit (@paulvalla)
- [a2ccc81](https://github.com/bda-research/node-crawler/commit/a2ccc814a67269716f037df73134c6fd6567af85) Rename addToQueue to pushToQueue (@paulvalla)
- [8e91405](https://github.com/bda-research/node-crawler/commit/8e91405dac164bd848466bbf5dba4ec807a752dc) Use node events to pool drain (@paulvalla)
- [8a87b2d](https://github.com/bda-research/node-crawler/commit/8a87b2d1597fe83a3749ab8ab88a025d03cc3574) Code cleaning (@paulvalla)
- [c034e3d](https://github.com/bda-research/node-crawler/commit/c034e3d5cb86d37e78a26b1f9eca7969d1515868) Avoid anon functions (@paulvalla)
- [d54ca12](https://github.com/bda-research/node-crawler/commit/d54ca127b0f0343b44cb8eceb2338684ce738dd3) Use node events (@paulvalla)

### 0.3.1 (2014-10-23)
- [de997e4](https://github.com/bda-research/node-crawler/commit/de997e489bedabdc362d307959f72f0ac71467c0) 0.3.1 (@paulvalla)
- [bf62dda](https://github.com/bda-research/node-crawler/commit/bf62dda2e9ca5a9c4f80243a7cef059c76baa5d1) Fix for https://github.com/sylvinus/node-crawler/issues/120 (@paulvalla)
- [5f4a262](https://github.com/bda-research/node-crawler/commit/5f4a262c155d4af64b244869fcdfaaac8b848e79) Update README.md (@paulvalla)

### 0.3.0 (2014-10-22)
- [e8ad75e](https://github.com/bda-research/node-crawler/commit/e8ad75ebee1258de5f0a1db10e909aa04fa42261) 0.3.0 (@paulvalla)
- [df38d83](https://github.com/bda-research/node-crawler/commit/df38d83dc5431fc946c5670e754ada37bd702b45) Merge branch 'master' of github.com:paulvalla/node-crawler (@paulvalla)
- [0de37f7](https://github.com/bda-research/node-crawler/commit/0de37f7d6574c622b326ededbcde4fa621035e3b) merge (@paulvalla)
- [f679184](https://github.com/bda-research/node-crawler/commit/f679184eaae4dd01d32584c5b6c767ace26da61a) Conflicts: 	lib/crawler.js (@paulvalla)
- [83b42a0](https://github.com/bda-research/node-crawler/commit/83b42a06af1014db1508162e8d76828a0b9b7622) Merge branch 'dev' of github.com:ConnorWeng/node-crawler into ConnorWeng-dev (@paulvalla)
- [b171b3e](https://github.com/bda-research/node-crawler/commit/b171b3e1607e9e0b3a43427eac1ab0460de4e74e) add test for rate limits and update readme (@ConnorWeng)
- [1fbb562](https://github.com/bda-research/node-crawler/commit/1fbb5621a4ab71aa8cd28252e8a922715ba0a4ba) Update README.md (@paulvalla)
- [c18f3ca](https://github.com/bda-research/node-crawler/commit/c18f3ca25dddb8cd71ad3ec13f841bc0a59d78b3) Added node version support (@paulvalla)
- [79070b1](https://github.com/bda-research/node-crawler/commit/79070b1fad2d15ba7bc2fbdea5aff8ab3734b496) Added node version support (@paulvalla)
- [8ba184f](https://github.com/bda-research/node-crawler/commit/8ba184f1b73e4988792e005d6edaf26f67597435) Allow test failure for node 0.11 until mocha can run on 0.11.14 (@paulvalla)
- [a6708e9](https://github.com/bda-research/node-crawler/commit/a6708e9af802ba406ed22364a257d8daa3acfb85) Can use jquery or jQuery (@paulvalla)
- [a984f59](https://github.com/bda-research/node-crawler/commit/a984f599d1e8a796c3a781a758dc244e1083002e) Added uri as a function test from Readme (@paulvalla)
- [c84e145](https://github.com/bda-research/node-crawler/commit/c84e1450d35deb4e698b9755f485fe6ec1926bb4) Added uri as a function test (@paulvalla)
- [e5876ec](https://github.com/bda-research/node-crawler/commit/e5876ec01ed572612106aac16a3eaf2ec5510222) Forgot queuItemSize and queuItemSize (@paulvalla)
- [b273bc8](https://github.com/bda-research/node-crawler/commit/b273bc8d25aec7e4a3af03e30f42fb2493b27e37) Move stuff around (@paulvalla)
- [c4cf7a6](https://github.com/bda-research/node-crawler/commit/c4cf7a6b5f96452fa5c9be6c4e9b946e2eee100b) simply implement crawling rate limits (@ConnorWeng)
- [c35578d](https://github.com/bda-research/node-crawler/commit/c35578dda1d9d94408cfa245c055c0bab1228923) Cleaning code, renaming function, variables (@paulvalla)
- [918813e](https://github.com/bda-research/node-crawler/commit/918813e8b3dbe053446ed5d554d0eed0a55dc6c2) use old package.json notation (@paulvalla)
- [820eb65](https://github.com/bda-research/node-crawler/commit/820eb652417c95191e0c0a679980c594cb6e883a) switch to lodash (@paulvalla)
- [14ca221](https://github.com/bda-research/node-crawler/commit/14ca2212290b7bd7b8c8009704a8285c83a51f9d) replace underscore by lodash (@paulvalla)
- [8c72043](https://github.com/bda-research/node-crawler/commit/8c72043363ec1a7ae3561a36bbb60fd56e832f39) Update doc to reflect node crawler module.export change (@paulvalla)
- [82f286b](https://github.com/bda-research/node-crawler/commit/82f286bbf3363447515a99f57873501408486bb2) Export crawler as a constructor for cleaner code (@paulvalla)
- [6e2a3c5](https://github.com/bda-research/node-crawler/commit/6e2a3c5e7902be524983fbc64f00825817267b6b) Added more error test (@paulvalla)
- [3f6f949](https://github.com/bda-research/node-crawler/commit/3f6f949410f517e06e2c59b412f8cc50501db152) Update error tests (@paulvalla)
- [0736325](https://github.com/bda-research/node-crawler/commit/0736325a32e5d34e37b668111c33427eb93532fe) Typo in package.json (@paulvalla)
- [91a0faf](https://github.com/bda-research/node-crawler/commit/91a0faf2e045e75a7c8025235701a9bf3a053274) Remove Leak Test Memwatch is too buggy atm (@paulvalla)
- [25a8e65](https://github.com/bda-research/node-crawler/commit/25a8e65f6d829f826e67e9085bdd046c0ba53b0e) Revert "Use a memwatch version that can compile on node 0.11" (@paulvalla)
- [5eba61e](https://github.com/bda-research/node-crawler/commit/5eba61e708308ee8bcb349fe9518c302469b0b06) Revert "Revert "Update leaks unit test"" (@paulvalla)
- [4ab8d87](https://github.com/bda-research/node-crawler/commit/4ab8d8710ad052476c58291e2eb75b608c99f82b) Revert "Update leaks unit test" (@paulvalla)
- [1df2daf](https://github.com/bda-research/node-crawler/commit/1df2dafac39fa189161739d124e7b0c67d951eb5) Use a memwatch version that can compile on node 0.11 (@paulvalla)
- [dbbc956](https://github.com/bda-research/node-crawler/commit/dbbc956c1c8fa28dd6d312fe8f9b77a66068a5b7) Update leaks unit test (@paulvalla)
- [f375f0a](https://github.com/bda-research/node-crawler/commit/f375f0adffb2e8fa2b97a70e3d3fa36042145017) Update leaks unit test (@paulvalla)
- [e411b34](https://github.com/bda-research/node-crawler/commit/e411b3461f22c460820ab468f56981ec76229fb1) Install httpbin on before_install step (@paulvalla)
- [81ef451](https://github.com/bda-research/node-crawler/commit/81ef451801b676daaf69ee326565585ba876a781) allow failure (for now) on node 0.11 (@paulvalla)
- [195e2d0](https://github.com/bda-research/node-crawler/commit/195e2d048ef8e21cc50bfa1a90d082b95a9a2b39) run gunicorn as a daemon (@paulvalla)
- [a3cee95](https://github.com/bda-research/node-crawler/commit/a3cee954f30f1492ff2694058c7ee5317778763a) run gunicorn as a daemon (@paulvalla)
- [def1982](https://github.com/bda-research/node-crawler/commit/def19822fb4e066b435c7ee735a6e4b856c2a736) install pip as sudo (@paulvalla)
- [9c2a79c](https://github.com/bda-research/node-crawler/commit/9c2a79c3f1954f346a3dbf928adfc2c027d7836d) Install httpbinlocally to run travis test (@paulvalla)
- [1f4259e](https://github.com/bda-research/node-crawler/commit/1f4259e2b0fbdb1cc177d545d30a111d1330febb) Added node 0.11 support for travis testing (@paulvalla)
- [22b3fcb](https://github.com/bda-research/node-crawler/commit/22b3fcb146660777e689db4fc560ba635882f3eb) Finish Simple test (@paulvalla)
- [af9a568](https://github.com/bda-research/node-crawler/commit/af9a568f5f4be580fdb71b25cc3cdc5e6b5a9a21) More refactoring of test (@paulvalla)
- [2dfcc07](https://github.com/bda-research/node-crawler/commit/2dfcc073ed47c94b86baaa704118dc3952ac2e10) disable before install script (@paulvalla)
- [0dca1af](https://github.com/bda-research/node-crawler/commit/0dca1af9a0d0bc13051cfa15d31f26083d573977) osx travis test (@paulvalla)
- [85d065b](https://github.com/bda-research/node-crawler/commit/85d065b97761ae8a1253ac1eac64eab6b2b7f2bc) since osx is experimental, allow failure (@paulvalla)
- [eb921d8](https://github.com/bda-research/node-crawler/commit/eb921d857dcd4f1e8f36794449e5b063fd27f483) experimenting with travis mac os feature (@paulvalla)
- [d60eaac](https://github.com/bda-research/node-crawler/commit/d60eaacc2bebff7bbfb6fff328634fd9f1482387) experimenting with osx travis conf (@paulvalla)
- [d21e55f](https://github.com/bda-research/node-crawler/commit/d21e55f536e231032361cfb2e7db91c7d867614d) enable osx testing (@paulvalla)
- [14aac1c](https://github.com/bda-research/node-crawler/commit/14aac1c0e5214208fe9c982aa74d330b6776618c) use this.timeout instead of setTimeout. Yes im tired (@paulvalla)
- [dc3ec3c](https://github.com/bda-research/node-crawler/commit/dc3ec3cb4b377557afb78fcd9ecd7043f90fd31c) sometimes timeout of 2000ms is exceeded (@paulvalla)
- [570e6da](https://github.com/bda-research/node-crawler/commit/570e6da0be6e68d152f61e9711b5186d6d23a117) Write mocha chai test for links (@paulvalla)
- [9a71110](https://github.com/bda-research/node-crawler/commit/9a711100a4557646fb526ae61279fbd93c5ff478) Added empty test mocha test (@paulvalla)
- [c4a749f](https://github.com/bda-research/node-crawler/commit/c4a749ff9ed2f0789494a734638dc2f92eda5786) Switched to mocha test (@paulvalla)
- [d574c78](https://github.com/bda-research/node-crawler/commit/d574c7813bdd5deb9c20d088f7e01e5507def8e1) remove old test files. switch to mocha test command (@paulvalla)
- [8fdc592](https://github.com/bda-research/node-crawler/commit/8fdc5924599072250f42992d7cab243e5ad20a0e) Replace QUNIT by mocha/chai in force UTF8 (@paulvalla)
- [913e3e0](https://github.com/bda-research/node-crawler/commit/913e3e021f56ce8d30a602aa310ab0da26711f8c) Update Dependencies (@paulvalla)

### 0.2.7 (2014-09-04)
- [55496e2](https://github.com/bda-research/node-crawler/commit/55496e27cd97d92e25800b56e8705e612c18dc97) 0.2.7 (@paulvalla)
- [f4bd13f](https://github.com/bda-research/node-crawler/commit/f4bd13f39be68494ea45fdcbfd019e9bbff51e62) Load jquery file on Windows (@paulvalla)
- [54d8b74](https://github.com/bda-research/node-crawler/commit/54d8b7447bfd64dc5cd18526ff9f98079b872b08) Update README for build tools needed (@paulvalla)
- [eb57159](https://github.com/bda-research/node-crawler/commit/eb57159c0d0861671b7213752016925de6519224) Update README.md (@paulvalla)
- [#108](https://github.com/bda-research/node-crawler/pull/108) Allow custom encoding using. (@ozlevka)
- [901b16d](https://github.com/bda-research/node-crawler/commit/901b16d6775572b0d18a6612320cd0d9451dbd3a) Update README.md (@ozlevka)
- [7340c30](https://github.com/bda-research/node-crawler/commit/7340c30f4cdab0ae636bce04c4222f886c39be80) Add stop test (@invalid-email-address)
- [a32b834](https://github.com/bda-research/node-crawler/commit/a32b8342679b609e286fd6b321ef1bb78dcd98c7) Allow custom encoding (@invalid-email-address)
- [#89](https://github.com/bda-research/node-crawler/pull/89) Adds referer header spoofing (@lsl)
- [#100](https://github.com/bda-research/node-crawler/pull/100) support redirect by using correct document URI (@shawnzhu)
- [038fc88](https://github.com/bda-research/node-crawler/commit/038fc883b7b8484c28e26b96cdf674f4735e3771) support redirect by using correct document URI
- [02ae742](https://github.com/bda-research/node-crawler/commit/02ae7421264ae719843623efd68e44048a619a00) 0.2.6 (@paulvalla)

### 0.2.6 (2014-07-03)
- [09a5f4a](https://github.com/bda-research/node-crawler/commit/09a5f4a8122afbc13a4e5e11901037df1c9a8808) update info and metadata (@paulvalla)
- [7853a17](https://github.com/bda-research/node-crawler/commit/7853a176184245d5938e0354bbc27567f9bfcc86) Change test order due to a strange behaviour of memwatch (@paulvalla)
- [ec59def](https://github.com/bda-research/node-crawler/commit/ec59def522259bbbc78537d59532d4666e30c43a) Conflicts: 	.gitignore 	.travis.yml 	package.json 	test/mockserver.js 	test/testrunner.js 	test/units/simple.js (@paulvalla)
- [9b52a18](https://github.com/bda-research/node-crawler/commit/9b52a18db200601321c05878021a6d7c16420940) A bug cause overflow in leaks test caused by memwatch (@paulvalla)
- [0d69d1a](https://github.com/bda-research/node-crawler/commit/0d69d1aab2ace870aa0bdc488e47c12f0a459b28) Update Qunit (@paulvalla)
- [4df8569](https://github.com/bda-research/node-crawler/commit/4df85691290cec90dccb7367867df1c0d0ec86bb) update maintener info (@paulvalla)
- [c8cf1ad](https://github.com/bda-research/node-crawler/commit/c8cf1ad9e7a3fcc793270a112838b11ed988d50a) Update travis.yml node version to node 0.10 (@paulvalla)
- [3914a1e](https://github.com/bda-research/node-crawler/commit/3914a1e7da3ffa2199774a4be15de6688c8a3349) Starting to use httpbin to test node-crawler and update dependencies (@paulvalla)
- [069514b](https://github.com/bda-research/node-crawler/commit/069514b844208ce2adb58724daddbaa32366519a) ignore jetbrain ide directory (@paulvalla)
- [0b33260](https://github.com/bda-research/node-crawler/commit/0b332602623ec8595d1ad017774e2ef1441c851f) remove duplicate declaration (@paulvalla)
- [0209516](https://github.com/bda-research/node-crawler/commit/020951619fb093cc083d7369868bf3f71958dece) Adds referer header spoofing (@lsl)
- [8b49670](https://github.com/bda-research/node-crawler/commit/8b49670bb230ef984e2c2a3ca079ed040bbb400f) Adds referer header spoofing (@lsl)
- [26f34b6](https://github.com/bda-research/node-crawler/commit/26f34b62f9b4fe6fac8ca4e0e43beb359ec68270) Update to express 3.4 in devDep for testing (@paulvalla)
- [bb41114](https://github.com/bda-research/node-crawler/commit/bb411141685ae577aa85cf1cd1506ff19e5d5d33) update dep (@paulvalla)
- [937925b](https://github.com/bda-research/node-crawler/commit/937925b17cb50b1a85ddfca9e4e65dbaf2db3b3a) node 0.6 is not supported officially any more (@paulvalla)
- [4eb75e3](https://github.com/bda-research/node-crawler/commit/4eb75e37da23f661561f2adb780760614dc5be72) Added test for "Malformed HTML causing a non-critical JSDOM errors" (@paulvalla)
- [481d6de](https://github.com/bda-research/node-crawler/commit/481d6de4676a76811336d347bb31af1ca1546701) remove duplicate declaration (@paulvalla)
- [84e8631](https://github.com/bda-research/node-crawler/commit/84e8631499e537de55daaa45993af847af110f09) change jsdom error management (@paulvalla)
- [32185e9](https://github.com/bda-research/node-crawler/commit/32185e92828c3f21c444df616414ba29a9ab344b) remove duplicate underscode dep (@paulvalla)
- [2671794](https://github.com/bda-research/node-crawler/commit/267179441e4fb2e61384cca234ab51b3b59adb65) Conflicts: 	lib/crawler.js (@sylvinus)
- [3ce401a](https://github.com/bda-research/node-crawler/commit/3ce401abc11fde8e694b7b2330dc70e5e88bd904) Conflicts: 	package.json (@sylvinus)
- [#47](https://github.com/bda-research/node-crawler/pull/47) Let `options.encoding = null` be really null (it should not accept `gzip`) (@trantorLiu)
- [#49](https://github.com/bda-research/node-crawler/pull/49) Update crawler.js (@chloe899)
- [#60](https://github.com/bda-research/node-crawler/pull/60) Support basic http auth request (@luap)
- [d45254a](https://github.com/bda-research/node-crawler/commit/d45254af1db62d57a8d62ec0414d5b94be55d0db) Dependency update (@sylvinus)
- [#51](https://github.com/bda-research/node-crawler/pull/51) Node 0.10.x (@bkw)
- [ac834e4](https://github.com/bda-research/node-crawler/commit/ac834e499690f773592f5ad877278ec80ea13d1a) Support basic http auth request (@paulvalla)
- [#50](https://github.com/bda-research/node-crawler/pull/50) syntax highlighting for example in readme (@namuol)
- [2072d52](https://github.com/bda-research/node-crawler/commit/2072d529a9f28760f0eb2447324923200b358a90) exit with status 1 on failed tests (@bkw)
- [cd15e86](https://github.com/bda-research/node-crawler/commit/cd15e8645f4ca47ace128e65cdc023e86e8813af) trigger travis build (@bkw)
- [ee68f2a](https://github.com/bda-research/node-crawler/commit/ee68f2a2bc0cff0eb9dddc021de8634a99b595f1) add node-0.10 to travis tests (@bkw)
- [cc891ea](https://github.com/bda-research/node-crawler/commit/cc891ea1e99f43a73ae03e2a99c3e77c84ee57f4) bump dependencies to current versions (@bkw)
- [b3ee9cf](https://github.com/bda-research/node-crawler/commit/b3ee9cfa4863108af699c8b02616cfacb9043e05) remove unused htmlparser dependency (@bkw)
- [650bbfd](https://github.com/bda-research/node-crawler/commit/650bbfdf447b83761c8f5eb59443bede369e0255) syntax highlighting for example in readme (@namuol)
- [23a4e3d](https://github.com/bda-research/node-crawler/commit/23a4e3d26ca2825aae9688f73ea228ed43780c92) Update crawler.js (@chloe899)
- [f3de6cf](https://github.com/bda-research/node-crawler/commit/f3de6cfa691e9c5c23c35d4d0b6970fb40ff4715) If I don't want to specify any encoding including gzip, (@trantorLiu)
- [f04c777](https://github.com/bda-research/node-crawler/commit/f04c777d68bef20de5d4d49bd93b3bee936b3385) experimental proxy list support (@sylvinus)
- [2d1a070](https://github.com/bda-research/node-crawler/commit/2d1a0706107e499c4a3fae289d8a6d5ebc1765e9) detect non-html reponses (@sylvinus)
- [3e90506](https://github.com/bda-research/node-crawler/commit/3e905062fa4351bee92ff5cd7fd82a3f30f510b3) More versatile test (@sylvinus)
- [168a754](https://github.com/bda-research/node-crawler/commit/168a7545b8748c314b12c2dcd2c86c2132961263) fix possible memleak (@sylvinus)
- [ad81027](https://github.com/bda-research/node-crawler/commit/ad810275d09251c26c7289158d48dc4813d0e696) Crawler 0.2.4 (@sylvinus)
- [99de83d](https://github.com/bda-research/node-crawler/commit/99de83dcc2b5f94a3aa30338a38019ed1387676f) Fix encoding:null change (@sylvinus)
- [#40](https://github.com/bda-research/node-crawler/pull/40) fix for jsdom crawler crash (@edrury)
- [0a9e1ba](https://github.com/bda-research/node-crawler/commit/0a9e1ba4b05b233a0bf8d9b4a252ae4e51e495a8) catch async jsdom init errors (@edrury)
- [5c9b996](https://github.com/bda-research/node-crawler/commit/5c9b996d3e703cecb25453c650fece30ebc56bf4) Fixed travis link (@sylvinus)
- [ddaf4ac](https://github.com/bda-research/node-crawler/commit/ddaf4ac879fe152e9b0376341bba24ba3e10aa7f) Link @mikeal's options (@sylvinus)
- [01c9cc1](https://github.com/bda-research/node-crawler/commit/01c9cc1babbd6677e278555315b47ca88a1a07a2) iconv-lite as a fallback (@sylvinus)
- [#29](https://github.com/bda-research/node-crawler/pull/29) Change from iconv to iconv-lite (@headconnect)
- [b128d0d](https://github.com/bda-research/node-crawler/commit/b128d0da6c226dde9fb6c867081d2193370a8299) Merge branch 'master' of github.com:sylvinus/node-crawler (@sylvinus)
- [bd79072](https://github.com/bda-research/node-crawler/commit/bd79072121614047e20a111e72a4bb50af10b4e9) Adding gzip & userAgent support - fixes #38 & #37 (@sylvinus)
- [#39](https://github.com/bda-research/node-crawler/pull/39) The sample code in readme.md had a little mistake in its $.each call. (@Racheet)
- [fe8c120](https://github.com/bda-research/node-crawler/commit/fe8c120e1b3ad7d2319509a60711bcaf39e489e5) fixed incorrect jquery.each call in readme.md (@Racheet)
- [d6b2443](https://github.com/bda-research/node-crawler/commit/d6b24433530aaff03c8d2f28b582e90bc0c1e938) Memory leak test (@sylvinus)
- [2c45fb4](https://github.com/bda-research/node-crawler/commit/2c45fb481ab141b95a8146e5ebd45cf9c8ff4ded) Updated jQuery to 1.8.3, fix+test always absolute a.href (@sylvinus)
- [8821db2](https://github.com/bda-research/node-crawler/commit/8821db2b8b65eb99348f83613a73fa63b10a8258) Merge branch 'master' of github.com:sylvinus/node-crawler (@sylvinus)
- [f8b5ccd](https://github.com/bda-research/node-crawler/commit/f8b5ccd9c0c0f834adc45917c7f427fdcb6fbe6e) 0.2.1 (@sylvinus)
- [#30](https://github.com/bda-research/node-crawler/pull/30) Bumped the JSDOM version in order to fix memory leak (@soitgoes)
- [ae1c114](https://github.com/bda-research/node-crawler/commit/ae1c114c2ae1d14c03428449a5499725fbd81e32) Conflicts: 	package.json (@sylvinus)
- [db839c3](https://github.com/bda-research/node-crawler/commit/db839c377f8e125dd3ce885d127ab5680166ed71) fix repo (@sylvinus)
- [bf398e5](https://github.com/bda-research/node-crawler/commit/bf398e5d69142f4ceccec48f615f4c91a6fdc3be) Bumped jsdom version in order to fix a memory leak (@soitgoes)
- [0903cf3](https://github.com/bda-research/node-crawler/commit/0903cf3b9fc44cbab01f704e19892bb7b25eb8be) Changed from "iconv" to "iconv-lite" for compatability (@headconnect)
- [cc7e508](https://github.com/bda-research/node-crawler/commit/cc7e5088aa2bdd9b21c9eaf88cdf2906658bc8bc) Fix package.json url syntax (@sylvinus)
- [d72053f](https://github.com/bda-research/node-crawler/commit/d72053f3fd97a618118e966210c82f1281889932) Added travis to README (@sylvinus)
- [4548682](https://github.com/bda-research/node-crawler/commit/45486823831d8d59735ef9b236f9a6e550faf821) Wrap jsdom in a try/catch block for #9 (@sylvinus)
- [96a7f3e](https://github.com/bda-research/node-crawler/commit/96a7f3e05907617ab811c063fb26d538f9651aac) Fixes #11  when empty responses (@sylvinus)
- [7f8642d](https://github.com/bda-research/node-crawler/commit/7f8642daf5ea7b2ba3de602ca11b4ddc540f5bc1) Fix tests (@sylvinus)
- [97025db](https://github.com/bda-research/node-crawler/commit/97025dbffd6fe75c785b35ddbb82ec870a0b7033) enable all tests (@sylvinus)
- [df1c227](https://github.com/bda-research/node-crawler/commit/df1c227169f7da3cbd62585b9f2d46ee80c0af03) Test status codes (@sylvinus)
- [fb41724](https://github.com/bda-research/node-crawler/commit/fb41724c200abde0dfc03090d14813d694cfbe2f) Big update, see README (@sylvinus)
- [#26](https://github.com/bda-research/node-crawler/pull/26) Don't like this kind of spam but well (@travis4all)
- [#23](https://github.com/bda-research/node-crawler/pull/23) Hi! I fixed some calls to "sys" for you! (@node-migrator-bot)
- [#25](https://github.com/bda-research/node-crawler/pull/25) Update package.json (@wadouk)
- [6bcae9c](https://github.com/bda-research/node-crawler/commit/6bcae9cd26b3c02fb0775b240ed133de74a4314a) :gem: Travis CI image/link in readme :gem:
- [c4cbb6d](https://github.com/bda-research/node-crawler/commit/c4cbb6dd556f96205a01ed8dc0c5c4db801f0da0) :gem: Added travis.yml file :gem:
- [a531772](https://github.com/bda-research/node-crawler/commit/a53177266ecce2799131872ae9cb1d8b4720d2a0) Update package.json (@wadouk)
- [51115f3](https://github.com/bda-research/node-crawler/commit/51115f3ae37b6e1cef868678b7270c70f76b1d66) [fix] Changed require('sys') to require('util') for compatibility with node v0.8 (@blakmatrix)
- [#15](https://github.com/bda-research/node-crawler/pull/15) Changed Repo URL in Package JSON (@eethann)
- [#18](https://github.com/bda-research/node-crawler/pull/18) Adding .gitignore to ignore node modules (@keithpitt)
- [#20](https://github.com/bda-research/node-crawler/pull/20) Just add x64 to cpu settings :). Please. (@purchease)
- [3d32369](https://github.com/bda-research/node-crawler/commit/3d3236951dedfa77780d408865409d14664624d3) Adding "x64" to "cpu" settings.
- [6faf9bc](https://github.com/bda-research/node-crawler/commit/6faf9bccfa78ee28e767079b1c87272a9c64884e) Adding .gitignore to ignore node modules (@keithpitt)
- [d7f74f4](https://github.com/bda-research/node-crawler/commit/d7f74f4487e8fac24b3814001f1877e0d957e37c) Switched repo to SSL.
- [#5](https://github.com/bda-research/node-crawler/pull/5) Missing comma (@Jellyfrog)
- [fdd06a8](https://github.com/bda-research/node-crawler/commit/fdd06a833d997dc4c560c5c2a6e8b340c47cea29) Missing comma (@Jellyfrog)
- [d4ca182](https://github.com/bda-research/node-crawler/commit/d4ca1820621187fc22e7f4170f2f85bc3fb1d622) Fix jQuery insertion with jsdom 0.2.0 env() method (@sylvinus)
- [be36e21](https://github.com/bda-research/node-crawler/commit/be36e213082de947d605801c48717333606a6c90) Conflicts: 	package.json (@sylvinus)
- [fa9bf32](https://github.com/bda-research/node-crawler/commit/fa9bf32f691fe7d14354ba71c9a0437e8c865af5) deps (@sylvinus)
- [736f735](https://github.com/bda-research/node-crawler/commit/736f735dcdc81db982bf397a3fbb077aaf972439) Fix a bug where the crawl would die early because crawl slots were not returned to the pool when skipDuplicates was enabled and a cache hit occurred (@jhurliman)
- [6f92771](https://github.com/bda-research/node-crawler/commit/6f92771f8cfa776ac7cf5a42f2043e135e747a47) If duplicate skipping is enabled, don't queue videos that have already been crawled. A more advanced version of this that checks the current work queue is coming (@jhurliman)
- [3012049](https://github.com/bda-research/node-crawler/commit/3012049ed5241e0d592f755cd9cbc01e11ce81a1) Added a response.uri property to crawling callbacks (@jhurliman)
- [4270218](https://github.com/bda-research/node-crawler/commit/42702188164c34c9d37fc95b498a73e5de6e28d9) Added the missing jsdom dependency back to package.json (@jhurliman)
- [932bbc2](https://github.com/bda-research/node-crawler/commit/932bbc2ac34e39aec1cacb7c70be760b91d3762f) Fixing a typo in the previous commit (@jhurliman)
- [a826c5a](https://github.com/bda-research/node-crawler/commit/a826c5a0d0517a30c92eebec0acd6beb31195f09) Moved qunit to devDependencies (@jhurliman)
- [71a877f](https://github.com/bda-research/node-crawler/commit/71a877f983e461a6ca4918b89ade4ba01ca6cb92) Don't cache pages when options.skipDuplicates is true and options.cache is false (@jhurliman)
- [cbcf0be](https://github.com/bda-research/node-crawler/commit/cbcf0be826e01fba1955b5a4fe7464733901429d) Fix a bug introduced in the switch to jQuery.extend, where Crawler.options was getting modified (@jhurliman)
- [f4101f9](https://github.com/bda-research/node-crawler/commit/f4101f9c13d40ecc480637f8964b4d8a546c4aff) - use jquery extend instead of self made clone method
- [47b8867](https://github.com/bda-research/node-crawler/commit/47b8867aa75b7e19a344abccee4a59a3db34ff3b) a specific jsdom is included with jquery... this same version, but better defer to jquery for the version
- [e93a312](https://github.com/bda-research/node-crawler/commit/e93a312fa495fb23708769c0428407869d469244) jQuery fix, Cache support, Retry support, updated dependencies (@sylvinus)
- [1565a50](https://github.com/bda-research/node-crawler/commit/1565a500b067add6bee29caf8241e3b9dbd432d9) response.content & dynamic URI support (@sylvinus)
- [7f7833a](https://github.com/bda-research/node-crawler/commit/7f7833ab911cf8e661f4aeea176678a1361ba9a0) Added basic priority support, debug mode & HEAD fix (@sylvinus)
- [7f6191d](https://github.com/bda-research/node-crawler/commit/7f6191dd14f1cc8f0d7d45f9b9698fc0bd640cee) Plugged official Sizzle tests ;-) (Not passing 100% yet though) (@sylvinus)
- [a7d4449](https://github.com/bda-research/node-crawler/commit/a7d444910813839e0df31cd5f71a4cbae8d1eb27) small fix (@sylvinus)
- [163f881](https://github.com/bda-research/node-crawler/commit/163f881571406e30ecb57baf78b4a4097b6c7ec3) fix repository path (@sylvinus)
- [9024093](https://github.com/bda-research/node-crawler/commit/9024093677f0918e9257d8e00e387862c2bf49ae) format (@sylvinus)
- [9566bef](https://github.com/bda-research/node-crawler/commit/9566bef9c334471dc558128853fec38c7c3b1eda) format (@sylvinus)
- [cf760c2](https://github.com/bda-research/node-crawler/commit/cf760c2129c1b965786fd9153b1baa035b2501eb) formatting.. (@sylvinus)
- [d82b6f8](https://github.com/bda-research/node-crawler/commit/d82b6f861278c93b2829c2be6c1a12edf29fa202) todolist (@sylvinus)
- [0696ddd](https://github.com/bda-research/node-crawler/commit/0696dddf43ff5cba6b2b5e4968a1137b9b6df85d) First working test :) (@sylvinus)
- [cd9b279](https://github.com/bda-research/node-crawler/commit/cd9b279b1a35e1d62fdab58a5e63a9344bf21f35) fix link (@sylvinus)
- [a1e69e6](https://github.com/bda-research/node-crawler/commit/a1e69e66d71030e0ccdf9a316038e52bb3ff2848) fix readme (@sylvinus)
- [a6a5cff](https://github.com/bda-research/node-crawler/commit/a6a5cff05898ee952ec14c2c85fe7459431f9bb3) First commit - WARNING, UNTESTED! Just simple code to toy around (@sylvinus)