Commit graph

  • c6c10689eb fix: fix broken links in toc generation Kenneth Gitere 2021-06-16 18:09:05 +0300
  • 282d229754 fix: fix ordering issue with merged articles Kenneth Gitere 2021-06-10 20:16:31 +0300
  • 4247fab1ea feat: add css library for EPUB exports Kenneth Gitere 2021-06-09 08:04:50 +0300
  • d50bbdfb58 fix: minor fixes Kenneth Gitere 2021-06-09 07:26:52 +0300
  • 8691b0166f fix: fix panic when unwrapping a base URI Kenneth Gitere 2021-06-08 20:35:52 +0300
  • 5fbfb9c806 refactor: move download function to http module Kenneth Gitere 2021-06-08 07:42:30 +0300
  • 95bd22f339 Merge branch 'dev' of github.com:hipstermojo/paperoni into dev Kenneth Gitere 2021-06-07 22:44:51 +0300
  • 5b41e785b8 Fix get_header_level_toc_vec Kenneth Gitere 2021-06-07 22:42:14 +0300
  • 16dc83ac62
    Merge pull request #15 from sadsnake42/output-directory Kenneth Gitere 2021-06-06 16:01:38 +0300
  • 67e86e4d74 Refactor LogError Mikhail Gorbachev 2021-06-06 15:52:30 +0300
  • aa9258e122 Fix from PR#15 Mikhail Gorbachev 2021-06-06 13:20:08 +0300
  • a1156e10fc Add generate_header_ids function Kenneth Gitere 2021-06-06 13:01:57 +0300
  • 8220cf29f7 Change function replace_metadata_value to replace_escaped_characters Kenneth Gitere 2021-06-06 10:10:00 +0300
  • 5548ba4ba5 Merge branch 'dev' of github.com:hipstermojo/paperoni into dev Kenneth Gitere 2021-06-06 09:24:17 +0300
  • 751b5702fe
    Merge pull request #17 from philwrenn/dev Kenneth Gitere 2021-06-06 09:23:01 +0300
  • fd161455b4 Removed unwrap to prevent unexpected panic. Philip Wrenn 2021-06-05 23:17:55 -0400
  • 13ad14e73d Add output_dir to cli argument Mikhail Gorbachev 2021-06-01 12:23:22 +0300
  • 8c9783b596 feat: add header level table of contents for articles Kenneth Gitere 2021-05-18 18:08:31 +0300
  • 3a8160412c refactor short_summary function in logs.rs to be less redundant Kenneth Gitere 2021-05-17 22:12:10 +0300
  • 1cbbc7527f Update version Kenneth Gitere 2021-05-24 20:28:23 +0300
  • c916fb8493 Edit README Kenneth Gitere 2021-05-13 12:26:23 +0300
  • 5ccbe1a17a Merge branch 'dev' of github.com:hipstermojo/paperoni into dev Kenneth Gitere 2021-05-13 12:25:11 +0300
  • 102304544d
    Merge pull request #14 from kxt/13-fix-lazy-images-laziness-check Kenneth Gitere 2021-05-12 07:12:46 +0300
  • 7649f6aa18 moz_readability/mod.rs: fix laziness check in fix_lazy_images KOVACS Tamas 2021-05-10 01:33:12 +0200
  • d50f08b875 moz_readability/mod.rs: add testcase for issue #13 KOVACS Tamas 2021-05-10 01:30:05 +0200
  • 312dff95e2
    Merge pull request #12 from kxt/11-image-status-codes Kenneth Gitere 2021-05-10 10:58:23 +0300
  • 8ec491ff06 http.rs: check response status for fetched images KOVACS Tamas 2021-05-09 13:55:26 +0200
  • 4581f07330 http.rs: extract process_img_response function KOVACS Tamas 2021-05-08 21:30:00 +0200
  • 474d97c6bd
    Merge pull request #10 from hipstermojo/dev Kenneth Gitere 2021-04-30 08:48:11 +0300
  • 538a65f6fd Update dependencies in lockfile Kenneth Gitere 2021-04-30 08:34:09 +0300
  • f93017ab73 Fix README formatting Kenneth Gitere 2021-04-30 08:21:46 +0300
  • 4fd71311a1 Fix bug when validating the download file name in merged mode Kenneth Gitere 2021-04-30 07:47:25 +0300
  • cae9227ab0 Update documentation Kenneth Gitere 2021-04-30 06:55:02 +0300
  • c00582ac29 Fix verbosity levels ordering Kenneth Gitere 2021-04-30 06:42:08 +0300
  • ae52cc4e13 Add features for logging and cli Kenneth Gitere 2021-04-29 19:58:37 +0300
  • 00d704fdd6 Move initializing logger to logs module Kenneth Gitere 2021-04-28 07:47:45 +0300
  • 36c3eb65c6 Add appendix page for listing the source of the article Kenneth Gitere 2021-04-27 20:34:26 +0300
  • 088699b2c3 Add debug flag Kenneth Gitere 2021-04-24 15:50:43 +0300
  • a9787d7b5a Add colored output and configuring of a paperoni root directory for logs Kenneth Gitere 2021-04-24 15:13:44 +0300
  • 65f8ebda56 Add logs crate for dealing with printing out the final download summary Kenneth Gitere 2021-04-24 13:58:03 +0300
  • a3de3fb6ff Add ImgError struct for representing errors in downloading article images Kenneth Gitere 2021-04-24 13:57:06 +0300
  • 910c45abf7 Add logging configured to send to a file by default Kenneth Gitere 2021-04-24 13:54:47 +0300
  • c0323a6ae4 Minor refactor and add non zero exit upon failure to download any article Kenneth Gitere 2021-04-24 09:00:18 +0300
  • b496abb576 Fix serialization issue with poorly defined attribute names Kenneth Gitere 2021-04-22 19:00:32 +0300
  • 313041a109 Update dependencies and restore redirect middleware in download_images Kenneth Gitere 2021-04-22 18:01:23 +0300
  • 960f114dc6 Minor fixes in moz_readability Kenneth Gitere 2021-04-21 19:14:25 +0300
  • dbac7c3b69 Refactor grab_article to return a Result Kenneth Gitere 2021-04-21 19:07:08 +0300
  • ae1ddb9386 Add printing of table for failed article downloads Kenneth Gitere 2021-04-20 21:09:38 +0300
  • 60fb30e8a2 Add url field in Extractor struct Kenneth Gitere 2021-04-20 21:06:54 +0300
  • b217448601 Add printing of tables upon successful extraction Kenneth Gitere 2021-04-20 14:02:56 +0300
  • 04a1eed4e2 Add progress indicators for the cli Kenneth Gitere 2021-04-17 17:27:38 +0300
  • 217cd3e442 Minor refactor Kenneth Gitere 2021-04-17 12:08:24 +0300
  • 7e9dcfc2b7 Add custom error types and ignore failed image downloads Kenneth Gitere 2021-04-17 12:04:06 +0300
  • d6cbbe405b Fix bug in inline_css_str_to_map Kenneth Gitere 2021-04-14 18:07:39 +0300
  • 2762bc5086
    Merge pull request #7 from hipstermojo/dev Kenneth Gitere 2021-02-24 13:28:56 +0300
  • b8c0cf29f1 Update README Kenneth Gitere 2021-02-24 13:17:13 +0300
  • e9f96d2970
    Merge pull request #6 from hipstermojo/dev Kenneth Gitere 2021-02-24 13:13:36 +0300
  • 165b2187be Bump version Kenneth Gitere 2021-02-24 13:03:52 +0300
  • 912bc9d915 Add flag for configuring maximum concurrent requests Kenneth Gitere 2021-02-21 12:40:17 +0300
  • b0c4c47413 Add support for merging articles into a single epub Kenneth Gitere 2021-02-11 13:51:21 +0300
  • f0a610c2ac Bug fix with empty titles Kenneth Gitere 2021-02-09 12:56:07 +0300
  • 65fdd967c1 Refactor image downloading and update README Kenneth Gitere 2021-02-09 10:33:02 +0300
  • 003953332f Refactor downloading of HTML pages Kenneth Gitere 2021-02-06 17:03:02 +0300
  • 6b62051942 Add replace_metadata_value function Kenneth Gitere 2021-02-06 13:53:04 +0300
  • b402472ba6 Add http and epub modules Kenneth Gitere 2021-02-06 12:59:03 +0300
  • 08f847531f Remove empty lines when reading from an input file Kenneth Gitere 2021-02-03 07:39:51 +0300
  • 3d56023592 Add -f flag for adding links from a file instead of needing to use cat Kenneth Gitere 2021-02-01 11:28:07 +0300
  • c82071a871
    Merge pull request #5 from hipstermojo/dev Kenneth Gitere 2021-01-24 18:00:50 +0300
  • b98c0a69a6 Bump version Kenneth Gitere 2021-01-24 17:54:33 +0300
  • 21c3ffd922 Refactor fetch_url Kenneth Gitere 2021-01-24 17:49:42 +0300
  • 1dc7b3432b Bug fixes Kenneth Gitere 2021-01-12 10:21:11 +0300
  • ca1f9e2800
    Merge pull request #4 from hipstermojo/dev Kenneth Gitere 2020-12-24 14:11:42 +0300
  • 8407c613df Bug fixes Kenneth Gitere 2020-12-24 12:16:30 +0300
  • 3c7dc9a416
    Merge pull request #3 from hipstermojo/dev Kenneth Gitere 2020-11-24 18:42:29 +0300
  • 3bfa82ba60 Update README and version Kenneth Gitere 2020-11-24 18:34:19 +0300
  • 725c73c83f Add basic redirect provided by surf and early exit of the program if the response is not a 200 Kenneth Gitere 2020-11-24 17:44:31 +0300
  • 5f99bddc10 Add custom serializer for XHTML Kenneth Gitere 2020-11-24 14:54:23 +0300
  • 37cb4e1fd2 Change from structopt to clap Kenneth Gitere 2020-11-24 09:58:50 +0300
  • cdfbc2b3f6 Refactor inline_css_str_to_map to use a better tokenizer Kenneth Gitere 2020-11-24 08:29:00 +0300
  • aff4054ca9 Update crates and fix bugs Kenneth Gitere 2020-11-23 15:55:58 +0300
  • ef3efdba81 Refactor to use temp directory and update surf Kenneth Gitere 2020-11-23 09:39:56 +0300
  • ab800d0174 Bug fix and add printing of the name of the extracted EPUB Kenneth Gitere 2020-11-23 09:01:05 +0300
  • b0e402d685 Resize logo Kenneth Gitere 2020-10-22 20:00:43 +0300
  • fbf2f0b3d8
    Merge pull request #2 from hipstermojo/dev Kenneth Gitere 2020-10-22 19:25:19 +0300
  • 566c3427be
    Merge pull request #1 from hipstermojo/readability Kenneth Gitere 2020-10-22 19:24:31 +0300
  • be48cc1e47 Fix alignment in README Kenneth Gitere 2020-10-22 19:10:11 +0300
  • 6aef1631e3 Add README Kenneth Gitere 2020-10-22 16:03:57 +0300
  • 1b4c4ee658 Change CLI option to allow for multiple arguments Add basic looping in async runtime Kenneth Gitere 2020-10-22 15:22:56 +0300
  • db11e78d8c Add template for epub output Change output format to name file with the title name Add getters in MetaData Kenneth Gitere 2020-10-22 13:55:02 +0300
  • 703de7e3bf Merge the readability module with the rest of the extractor Kenneth Gitere 2020-10-22 12:12:30 +0300
  • 679bf3cb04 Add logic for attempting different rounds for content extraction with different flags set Kenneth Gitere 2020-10-22 11:38:35 +0300
  • a0f69ccf80 Fix bug in is_probably_visible Kenneth Gitere 2020-10-22 11:34:12 +0300
  • a94798cc95 Add flags for conditional cleaning and removal of nodes Kenneth Gitere 2020-10-22 08:24:46 +0300
  • f17c9bfbc9 Add bug fixes for overflows in subtraction, giving a default for capture groups and in extracting nodes. Add fix in is_probably_visible Kenneth Gitere 2020-10-21 18:50:24 +0300
  • 350447d1c4 Change calls on replacing regexes to replace_all Kenneth Gitere 2020-10-21 16:21:53 +0300
  • aacb442b7a Move MetaAttr to moz_readability and rename to MetaData Kenneth Gitere 2020-10-20 22:23:31 +0300
  • d99b1c687b Fix counting of h2 nodes in prep_article Add test for prep_article Kenneth Gitere 2020-10-20 10:13:34 +0300
  • 94fa8db218 Fix bug in deletion of multiple nodes. When calling detach in a for loop or for_each iterator consumer, only the first node is ever deleted. Kenneth Gitere 2020-10-20 08:07:47 +0300
  • ccdbbb5a16 Add initial implementation of grabArticle Kenneth Gitere 2020-10-17 07:16:15 +0300
  • 3254064c0d Fix calls to select to return an iterator excluding the original calling node. Kenneth Gitere 2020-10-16 14:57:26 +0300