Commit Graph

887 Commits

Author SHA1 Message Date
Arun Prakash Jana
db45622207 Remove redundant initialization, reorder imports. 2017-01-03 22:21:14 +05:30
Arun Prakash Jana
302ddc98d2 Update Copyright year to 2017. 2017-01-02 00:00:03 +05:30
Arun Prakash Jana
7c8eab98e0
Reorder classes, organize comments. 2016-12-31 22:20:18 +05:30
Arun Prakash Jana
f30738090a Remove redundant custom option handlers. 2016-12-31 11:01:50 +05:30
Arun Prakash Jana
4ab1fade7e
Support opening multiple bookmarks. 2016-12-31 00:29:57 +05:30
Arun Prakash Jana
c86fb880f9
Move crypto globals to class scope. 2016-12-30 23:25:26 +05:30
Arun Prakash Jana
e95c7b7585 Update features list. 2016-12-30 16:13:25 +05:30
Arun Prakash Jana
d2d68accaa Update README. 2016-12-29 00:50:12 +05:30
Arun Prakash Jana
94482649c6 Fix test cases. 2016-12-27 22:58:28 +05:30
Arun Prakash Jana
84834a2355 Use _rec instead of _bm. 2016-12-27 21:18:55 +05:30
Arun Prakash Jana
9c7768e84d
Do not commit if no records deleted. 2016-12-27 09:10:08 +05:30
Arun Prakash Jana
aef76e94c8
Remove redundant join/split, show indices on failure. 2016-12-27 08:10:08 +05:30
Arun Prakash Jana
0ef67dbc67
Update documentation. 2016-12-26 09:20:03 +05:30
Arun Prakash Jana
f1fd227aff
Use single quotes. 2016-12-25 19:52:28 +05:30
Arun Prakash Jana
315f3595d8
Check if url is None in update_bm(). 2016-12-21 20:58:28 +05:30
Arun Prakash Jana
91479f7474
Add flag to DB by default. 2016-12-20 23:34:43 +05:30
Arun Prakash Jana
ec65ba9295
Immutable is not a class variable. 2016-12-20 22:37:14 +05:30
Arun Prakash Jana
ba474bb51e
Simpler blank tag handling. 2016-12-20 22:01:04 +05:30
Arun Prakash Jana
1a9ad1c1ca
Add option to show version. 2016-12-18 19:55:35 +05:30
Arun Prakash Jana
b1229854ea Update badges, availability. 2016-12-18 17:43:39 +05:30
Arun Prakash Jana
4f1b431956
Use hex in crypto macros. 2016-12-16 21:08:49 +05:30
Arun Prakash Jana
24506d281c
Change order of imports, error message 2016-12-12 22:05:34 +05:30
Arun Prakash Jana
2b90a2319f
Fix race condition, proxy auth handling
1. In case of a full DB refresh, the threads might enter a race condition while
generating the initial headers. Hence, decoupled the header generation logic.

2. Authorization information in https_proxy is now handled correctly in
urllib3 parse_url() way. This was a miss while completely removing urllib
dependency.

3. Handle exceptions due to malformed proxy URL in multiple places.
2016-12-11 20:53:48 +05:30
Arun Prakash Jana
6502fd7a64
Support tny.im shortened URL expansion. 2016-12-10 14:05:17 +05:30
Arun Prakash Jana
16069177b3
Remove dependencies atexit and inspect. 2016-12-10 02:23:32 +05:30
Arun Prakash Jana
09bb74b0a4 Use parse_url from urllib3, remove unquote(). 2016-12-10 00:19:14 +05:30
Arun Prakash Jana
4eb1d4fdf4 Update README. 2016-12-07 01:22:33 +05:30
Arun Prakash Jana
6b6315a815 Fix #102.: remove trailing '/'s from search tokens.
The behaviour is adapted from google's behaviour.
Please see the notes in the bug log for more details.
2016-12-06 08:42:48 +05:30
Arun Prakash Jana
cf5759d5d7
Update help. 2016-12-03 22:54:14 +05:30
Arun Prakash Jana
9364f3e75d
Reduce params to update_bm(). 2016-12-03 21:02:03 +05:30
Arun Prakash Jana
42ac27bbb1
Support https_proxy with --upstream and --shorten. 2016-12-03 19:33:14 +05:30
Arun Prakash Jana
2becef9b5e
Make number of network threads customizable. 2016-12-03 18:50:53 +05:30
Arun Prakash Jana
f01778fd9b
Set headers and proxy only once in refreshdb() 2016-12-02 00:34:52 +05:30
Arun Prakash Jana
4cbacd58bb
Renew PoolManager for each request.
This is to fix:
[ERROR] network_handler(), ln 1630: HTTPSConnectionPool(host='www.gnupg.org', port=443): Pool is closed.

Use 1 pool per PoolManager, fresh PoolManager for each request, clear on done.

Q: move on to requests?
2016-12-01 09:27:15 +05:30
Arun Prakash Jana
3e4f735bb7
check that all records are processed 2016-12-01 08:30:17 +05:30
Arun Prakash Jana
321fc05377
Limit thread count if less than default. 2016-12-01 02:20:36 +05:30
Arun Prakash Jana
5dfa8ace47
Set headers while setting up PoolManager.
Note: immutable records are not updated from network, so
they don't add to the bookmarks processed per thread count.
2016-12-01 02:03:15 +05:30
Arun Prakash Jana
4071e76c5c
Use correct format while printing logs 2016-12-01 01:14:23 +05:30
Arun Prakash Jana
f8d4d331d1
Multiple simultaneous notify() calls combine to 1.
Only one notify() is received in main thread
if multiple threads send call simultaneously.

Test: update only one record. The first 4 notify() come as 1.

Fix: Use a counter to track number of threads completed.
2016-12-01 00:45:29 +05:30
Arun Prakash Jana
bf6893dd92 Merge pull request #101 from szlin/master
Fix UnicodeDecodeError when opening buku.py
2016-11-30 18:51:07 +05:30
SZ Lin
dc606daade Open buku.py in UTF-8 mode
buku.py is an UTF-8 file but setup.py opened it in ASCII mode instead of UTF-8 mode.
2016-11-30 16:29:54 +08:00
Arun Prakash Jana
d30dc8109c
5 threads by default in refreshdb(). Write on 32 fetches. 2016-11-30 04:21:11 +05:30
Arun Prakash Jana
d7f0c7a143 Merge pull request #98 from DamianSiniakowicz/master
draft: multithreaded refreshdb
2016-11-30 01:49:37 +05:30
Arun Prakash Jana
3331e608cb
Prepare for version 2.7 release. 2016-11-30 01:19:24 +05:30
Damian
147c8d6469 final draft : cleaned everything up 2016-11-28 22:47:30 -05:00
Damian
ae09e6bf99 commented out close_quit on line 2561 2016-11-28 22:22:14 -05:00
Damian
93715929c6 removed multi-connection solution 2016-11-28 20:53:32 -05:00
Damian
1965956dbf Merge remote-tracking branch 'jarun_master/master'
jarun made a change before I fixed my pull request
2016-11-28 20:47:18 -05:00
Arun Prakash Jana
46f2f5a1bd Remove redundant DB commit on delete. 2016-11-28 22:21:19 +05:30
Damian
b8cc710461 draft: multithreaded refreshdb 2016-11-27 23:00:42 -05:00