Commit Graph
100 Commits
Author SHA1 Message Date
Serene-ArcandSerene a8c2136270 Add fallback downloader 2021-05-03 14:10:54 +10:00
Serene-ArcandSerene a86a41e6a5 Update README 2021-05-03 14:05:05 +10:00
Serene-ArcandSerene afa3e2548f Add customisable time formatting 2021-05-03 14:05:05 +10:00
Serene-ArcandSerene eda12e5274 Make downloadfilter apply itself to Resources 2021-05-03 14:02:03 +10:00
Serene-ArcandSerene 711f8b0c76 Add exception for r/all in subreddit check 2021-05-02 14:00:23 +10:00
Serene-ArcandSerene 14195157de Catch errors for banned or private subreddits 2021-05-01 13:36:38 +10:00
Serene-ArcandSerene b352549088 Add README for scripts 2021-05-01 13:24:37 +10:00
Serene-ArcandSerene db0f90b4e3 Add scripts to extract IDs 2021-05-01 13:24:37 +10:00
Serene-ArcandSerene 39935c58d9 Remove GifDeliveryNetwork module 2021-04-28 19:08:31 +10:00
Serene-ArcandSerene 9931839d14 Remove gifdeliverynetwork from download factory 2021-04-28 19:08:31 +10:00
Serene-ArcandSerene 760e59e1f7 Invert inheritance direction 2021-04-28 19:08:31 +10:00
Serene-ArcandSerene 3c6e9f6ccf Refactor class 2021-04-28 19:08:31 +10:00
Serene-ArcandSerene 7fcbf623a0 Catch additional errors in site downloaders 2021-04-28 15:20:02 +10:00
Serene-Arc 6a20548269 Catch additional error 2021-04-28 12:03:28 +10:00
Serene-Arc 17499baf61 Add informative error when testing user existence 2021-04-28 12:03:28 +10:00
Serene-Arc e6551bb797 Return banned users as not existing 2021-04-28 12:03:28 +10:00
Serene-Arc db46676dec Catch error when logfile accessed concurrently 2021-04-28 12:03:28 +10:00
Serene-Arc 667aa395e5 Update README 2021-04-28 12:03:28 +10:00
Serene-Arc cb41d4749a Add option to specify logfile location 2021-04-28 12:03:28 +10:00
Serene-Arc 3bc10ce1aa Fix formatting 2021-04-28 12:03:28 +10:00
Serene-Arc fbf8a2748e Fix formatting 2021-04-28 12:03:28 +10:00
Serene-Arc a28c2d3c73 Add missing default argument 2021-04-28 12:03:28 +10:00
Serene-Arc 12c040d85d Fix reference paths 2021-04-28 12:03:28 +10:00
Serene-Arc f5d11107a7 Remove unused imports 2021-04-28 12:03:28 +10:00
Serene-Arc 8cdf926211 Rename function 2021-04-28 12:03:28 +10:00
Serene-Arc 7438543f49 Remove unused variable 2021-04-28 12:03:28 +10:00
Serene-Arc ca495a6677 Add missing typing declaration 2021-04-28 12:03:28 +10:00
Serene-Arc 214c883a10 Simplify regex string slightly 2021-04-28 12:03:28 +10:00
Serene-Arc 386d5ea41c Format file 2021-04-28 12:03:28 +10:00
Serene-Arc 6767777944 Catch requests errors in site downloaders 2021-04-28 12:03:28 +10:00
Serene-Arc d960bc0b7b Use ISO format for timestamps in names 2021-04-28 12:03:28 +10:00
Serene-ArcandAli Parlakci c85ae3fc69 Escape characters 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 52e5120110 Update README 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 9e3e9fa3ef Update CONTRIBUTING 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 48dca9e5ee Fix mistaken backreference in some titles
This should resolve #267
2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci ab7a0f6a51 Catch errors when resources have no extension
This is related to #266 and will prevent the BDFR from
completely crashing when a file extension is unknown
2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci e672e28a12 Fix typing on function 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 4b195f2b53 Remove unneeded logger entry 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 5758aad48b Fix formatting 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 77bdbbac63 Update test hash 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 7d71f8ffab Add regex for all 2xx HTTP codes 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 308853d531 Use standards in HTTP errors 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci e35dd9e5d0 Fix bug in file name formatter 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci bd9f276acc Rename module 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 3da58dbd5d Update README 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci ef0b2d437f Update list of unrecoverable HTTP codes 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 36291d5ea6 Add option to specify wait time as option 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci af95f3ff66 Fix some formatting 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci aa8032e95f Use config value to specify max wait time 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 0c960a4d0c Add minimum python version 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 37ca413424 Change logger message to warning 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 49c82dc12a Fix some formatting 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 9aa1383b43 Add support for mobile Imgur links 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 97b10ee4e3 Fix line length 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci c90d98ac72 Add fix for Imgur gifv links 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 942ca2afea Update test 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 6704cd1dc0 Set log backup count from config 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 5fea34ffce Fix test 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci a291104144 Add defensive programming to site downloaders 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 9cb4dd4cf3 Rename function 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 1768096b85 Add filter for stream logger re exceptions 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci b255271016 Fix duplicate test name 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 2384c03170 Refactor method to base class 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 500cee4bae Remove erroneous test case 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 936cbd4747 Update test hash 2021-04-18 16:44:52 +03:00
Serene-ArcandAli Parlakci 9880d46853 Fix quotes 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci b5b163084f Add more informative errors when downloading Resource 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci c2c3d03205 Add support for direct links with parameters 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci 4b49991cd6 Correct logger message 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci bf078cbaf8 Switch to rotating log files 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci dc9d02a28c Name log file with run time 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci f78856315d Switch to f-string 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci 1e1dae8eaa Alter some logging messages 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci a05fa1a965 Add some to CONTRIBUTING 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci 7d69c9a7af Fix typos 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci a170356738 Use slice to shorten name 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci 5d86c2d400 Update out-of-date tests 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci cbcbf400bb Add test for nonexistent key 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci f0d3cfefc0 Remove splice and fix quotes 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci 8bd4b8b3a9 Split regex for download factory 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci 8753fa0e45 Add additional test 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci 20f525bd0d Update some logging levels 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci 91bebe5f68 Add some to ARCHITECTURE 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci 56347da07e Fix test creating unwanted folders 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci 3cb51e638b Preserve appended ID when shortening file names 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci 1cb8240eb6 Remove incorrect test marks 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci 771cc711e4 Calculate existing hashes in parallel 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci 79105f9f84 Fix typo 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci 0007912ad5 Scrub windows paths for invalid characters 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci b3c51f49ce Copy config file to config directory first time 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci d8b741191d Fix typos 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci c13f2806fa Fix case where Gfycat fails after redirect 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci 0d78e16b2d Make sure to log all exceptions to file 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci faa3c20713 Fix bug where folder is created too late 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci 72b2e30e90 Add some things to README 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci 3ca2df067f Fix bs4 warning by specifying parser 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci 1215bc69de Refactor Imgur class to be hardier 2021-04-18 16:44:51 +03:00
Serene-ArcandAli Parlakci ba2ab25c2c Rename options 2021-04-18 16:44:34 +03:00
Serene-ArcandAli Parlakci c9d2a23a5f Update README 2021-04-18 16:44:34 +03:00
Serene-ArcandAli Parlakci 2b885451e7 Add ability to make hard links for duplicates 2021-04-18 16:44:34 +03:00