Arun Prakash Jana
8441cebd50
Handle regex search independently.
2016-11-13 14:33:19 +05:30
Arun Prakash Jana
32b25e3d4f
Override feed(), remove redundant API to reset parser.
2016-11-13 00:02:38 +05:30
Arun Prakash Jana
299d95aa45
Documentation update.
2016-11-12 23:37:10 +05:30
Arun Prakash Jana
03b351b11e
Add URL shortening support.
2016-11-12 21:20:23 +05:30
Arun Prakash Jana
5e0bc15e28
Support custom db file. Optimizations.
2016-11-12 08:08:28 +05:30
Arun Prakash Jana
b387fc95e1
Use user-agent. Simply network_handler().
2016-11-09 22:44:31 +05:30
Arun Prakash Jana
22bec5871d
Modify strings for MIME HEAD fetch
2016-11-09 01:59:02 +05:30
Arun Prakash Jana
b418b95099
Use only one instance of BHTMLParser
2016-11-09 01:13:53 +05:30
Arun Prakash Jana
fd30317265
Make page title a parser member. Rename variables.
2016-11-09 00:22:34 +05:30
Arun Prakash Jana
d521460bdc
top level domains can have 1 to 24 characters.
2016-11-08 23:43:32 +05:30
Arun Prakash Jana
809e6d155a
Use small b in ascii color code
2016-11-08 23:10:16 +05:30
Arun Prakash Jana
ac645e8140
Handle bad URLs, fetch only HEAD for known mimes
...
Add API to check URL validity
Add API to detect URLs to some non-page mimes which sans title
network_handler() returns more meaningful tuple
Handle interrupt during multiple indices and/or range update
With urllib3 URLs without preceding http(s) can be handled
2016-11-08 23:02:45 +05:30
Arun Prakash Jana
c40cd302bf
Show only error and skipped if --tacit is used
2016-11-08 12:15:39 +05:30
Arun Prakash Jana
c80a5a8e82
Remove redundant retry count
2016-11-08 11:15:24 +05:30
Arun Prakash Jana
fabdc773b6
Use requests module for upstream version check
...
The requests module uses urllib3 internally.
2016-11-08 10:58:24 +05:30
Arun Prakash Jana
0b819944b8
Remove move_legacy_dbfile() API. We have mergedb().
2016-11-08 08:45:11 +05:30
Arun Prakash Jana
15892e9eea
Fix markdown import issue with URL having brackets:wq.
2016-11-08 01:56:03 +05:30
Arun Prakash Jana
a7d3ce89a0
Remove metavar param, shorten argparse.SUPPRESS.
2016-11-07 23:28:54 +05:30
Arun Prakash Jana
ed01edf9fb
Remove option --st, redundant 'dest' in addarg.
2016-11-07 23:05:02 +05:30
Arun Prakash Jana
f314a19e8b
Use urllib3 to fetch titles and more...
...
Do not fetch title for txt and PDF links.
Disable logging.WARNING if debug mode is not enabled.
Support deflate compression.
2016-11-07 20:43:08 +05:30
Arun Prakash Jana
92093cfc63
1. Check for None resp before logging.
...
2. Update help
3. Show successful update in green in refreshdb()
2016-11-07 01:20:06 +05:30
Arun Prakash Jana
80413987d7
Merge branch 'setup-py' of https://github.com/asergi/Buku into asergi-setup-py
2016-11-07 00:48:39 +05:30
Alessio Sergi
4cf02b9fa9
Add setup.py for installation as a system tool.
2016-11-06 19:44:44 +01:00