Commit Graph

167 Commits

Author SHA1 Message Date
Arun Prakash Jana
22bec5871d Modify strings for MIME HEAD fetch 2016-11-09 01:59:02 +05:30
Arun Prakash Jana
b418b95099
Use only one instance of BHTMLParser 2016-11-09 01:13:53 +05:30
Arun Prakash Jana
fd30317265
Make page title a parser member. Rename variables. 2016-11-09 00:22:34 +05:30
Arun Prakash Jana
d521460bdc
top level domains can have 1 to 24 characters. 2016-11-08 23:43:32 +05:30
Arun Prakash Jana
809e6d155a
Use small b in ascii color code 2016-11-08 23:10:16 +05:30
Arun Prakash Jana
ac645e8140
Handle bad URLs, fetch only HEAD for known mimes
Add API to check URL validity
Add API to detect URLs to some non-page mimes which sans title
network_handler() returns more meaningful tuple
Handle interrupt during multiple indices and/or range update
With urllib3 URLs without preceding http(s) can be handled
2016-11-08 23:02:45 +05:30
Arun Prakash Jana
c40cd302bf Show only error and skipped if --tacit is used 2016-11-08 12:15:39 +05:30
Arun Prakash Jana
c80a5a8e82 Remove redundant retry count 2016-11-08 11:15:24 +05:30
Arun Prakash Jana
fabdc773b6 Use requests module for upstream version check
The requests module uses urllib3 internally.
2016-11-08 10:58:24 +05:30
Arun Prakash Jana
0b819944b8
Remove move_legacy_dbfile() API. We have mergedb(). 2016-11-08 08:45:11 +05:30
Arun Prakash Jana
15892e9eea
Fix markdown import issue with URL having brackets:wq. 2016-11-08 01:56:03 +05:30
Arun Prakash Jana
a7d3ce89a0 Remove metavar param, shorten argparse.SUPPRESS. 2016-11-07 23:28:54 +05:30
Arun Prakash Jana
ed01edf9fb
Remove option --st, redundant 'dest' in addarg. 2016-11-07 23:05:02 +05:30
Arun Prakash Jana
f314a19e8b
Use urllib3 to fetch titles and more...
Do not fetch title for txt and PDF links.
Disable logging.WARNING if debug mode is not enabled.
Support deflate compression.
2016-11-07 20:43:08 +05:30
Arun Prakash Jana
92093cfc63 1. Check for None resp before logging.
2. Update help
3. Show successful update in green in refreshdb()
2016-11-07 01:20:06 +05:30
Arun Prakash Jana
80413987d7 Merge branch 'setup-py' of https://github.com/asergi/Buku into asergi-setup-py 2016-11-07 00:48:39 +05:30
Alessio Sergi
4cf02b9fa9 Add setup.py for installation as a system tool. 2016-11-06 19:44:44 +01:00