Commit Graph
576 Commits
Author SHA1 Message Date
Serene-ArcandAli Parlakci 77bdbbac63 Update test hash 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 7d71f8ffab Add regex for all 2xx HTTP codes 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 308853d531 Use standards in HTTP errors 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci e35dd9e5d0 Fix bug in file name formatter 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci bd9f276acc Rename module 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 3da58dbd5d Update README 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci ef0b2d437f Update list of unrecoverable HTTP codes 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 36291d5ea6 Add option to specify wait time as option 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci af95f3ff66 Fix some formatting 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci aa8032e95f Use config value to specify max wait time 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 0c960a4d0c Add minimum python version 2021-04-18 16:44:52 +03:00
SereneandAli Parlakci 34c8a9a5d0 Add option to download user comments (#258)
* Add option to download user comments

* Update README
2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 37ca413424 Change logger message to warning 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 49c82dc12a Fix some formatting 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 9aa1383b43 Add support for mobile Imgur links 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 97b10ee4e3 Fix line length 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci c90d98ac72 Add fix for Imgur gifv links 2021-04-18 16:44:52 +03:00
Ali Parlakci 7228bc572c Add //imgur.com/*.gifv 2021-04-18 16:44:52 +03:00
SereneandAli Parlakci 9bceafc3e9 Parse unicode escapes in file name fields (#254) 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 942ca2afea Update test 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 6704cd1dc0 Set log backup count from config 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 5fea34ffce Fix test 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci a291104144 Add defensive programming to site downloaders 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 9cb4dd4cf3 Rename function 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 1768096b85 Add filter for stream logger re exceptions 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci b255271016 Fix duplicate test name 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 2384c03170 Refactor method to base class 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 500cee4bae Remove erroneous test case 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 936cbd4747 Update test hash 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 9880d46853 Fix quotes 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci b5b163084f Add more informative errors when downloading Resource 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci c2c3d03205 Add support for direct links with parameters 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci 4b49991cd6 Correct logger message 2021-04-18 16:44:51 +03:00
Ali Parlakci ab29e17511 download_factory.py: check if url has ext first 2021-04-18 16:44:51 +03:00
Ali Parlakci 4e35f0db2b test_download_factory: add a new case 2021-04-18 16:44:51 +03:00
Ali Parlakci 6c98829fd8 test_imgur.py: Remove duplicate tests 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci bf078cbaf8 Switch to rotating log files 2021-04-18 16:44:51 +03:00
SereneandAli Parlakci 702295f1ea Allow multilevel folder schemes (#251)
* Improve some formatting

* Allow multilevel folder names
2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci dc9d02a28c Name log file with run time 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci f78856315d Switch to f-string 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci 1e1dae8eaa Alter some logging messages 2021-04-18 16:44:51 +03:00
SereneandAli Parlakci 2385867afb Refactor and optimise some tests (#245)
* Rename to follow actual directory name

* Remove unnecessary Reddit call from test

* Refactor test to reduce duplication

* Parameterise some tests

* Standardise formatting
2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci a05fa1a965 Add some to CONTRIBUTING 2021-04-18 16:44:51 +03:00
BlipRangerandAli Parlakci c9c864b71b Update regex to be more concise, add test for m.youtube. 2021-04-18 16:44:51 +03:00
BlipRangerandAli Parlakci a49d87e154 Add logic to handle mobile youtube (m.youtube) links. 2021-04-18 16:44:51 +03:00
SereneandAli Parlakci 32c9d6184c Archiver is smarter for comments (#242)
* Add comment name generation to file name formatter

* Refactor to reduce duplication

* Refactor archive entry classes

* Refactor archiver class a bit

* Refactor method

* Fix comment retrieval

* Add comment-downloading to archiver

* Update test

* Update test
2021-04-18 16:44:51 +03:00
Ali Parlakci 75d74a5362 test_download_factory: remove outdated marks 2021-04-18 16:44:51 +03:00
Ali Parlakci ab9dea0347 test_download_factory.py: hardcode submission links 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci 7d69c9a7af Fix typos 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci a170356738 Use slice to shorten name 2021-04-18 16:44:51 +03:00