Commit Graph

915 Commits

Author SHA1 Message Date
Arun Prakash Jana
2b90a2319f
Fix race condition, proxy auth handling
1. In case of a full DB refresh, the threads might enter a race condition while
generating the initial headers. Hence, decoupled the header generation logic.

2. Authorization information in https_proxy is now handled correctly in
urllib3 parse_url() way. This was a miss while completely removing urllib
dependency.

3. Handle exceptions due to malformed proxy URL in multiple places.
2016-12-11 20:53:48 +05:30
Arun Prakash Jana
6502fd7a64
Support tny.im shortened URL expansion. 2016-12-10 14:05:17 +05:30
Arun Prakash Jana
16069177b3
Remove dependencies atexit and inspect. 2016-12-10 02:23:32 +05:30
Arun Prakash Jana
09bb74b0a4 Use parse_url from urllib3, remove unquote(). 2016-12-10 00:19:14 +05:30
Arun Prakash Jana
4eb1d4fdf4 Update README. 2016-12-07 01:22:33 +05:30
Arun Prakash Jana
6b6315a815 Fix #102.: remove trailing '/'s from search tokens.
The behaviour is adapted from google's behaviour.
Please see the notes in the bug log for more details.
2016-12-06 08:42:48 +05:30
Arun Prakash Jana
cf5759d5d7
Update help. 2016-12-03 22:54:14 +05:30
Arun Prakash Jana
9364f3e75d
Reduce params to update_bm(). 2016-12-03 21:02:03 +05:30
Arun Prakash Jana
42ac27bbb1
Support https_proxy with --upstream and --shorten. 2016-12-03 19:33:14 +05:30
Arun Prakash Jana
2becef9b5e
Make number of network threads customizable. 2016-12-03 18:50:53 +05:30
Arun Prakash Jana
f01778fd9b
Set headers and proxy only once in refreshdb() 2016-12-02 00:34:52 +05:30
Arun Prakash Jana
4cbacd58bb
Renew PoolManager for each request.
This is to fix:
[ERROR] network_handler(), ln 1630: HTTPSConnectionPool(host='www.gnupg.org', port=443): Pool is closed.

Use 1 pool per PoolManager, fresh PoolManager for each request, clear on done.

Q: move on to requests?
2016-12-01 09:27:15 +05:30
Arun Prakash Jana
3e4f735bb7
check that all records are processed 2016-12-01 08:30:17 +05:30
Arun Prakash Jana
321fc05377
Limit thread count if less than default. 2016-12-01 02:20:36 +05:30
Arun Prakash Jana
5dfa8ace47
Set headers while setting up PoolManager.
Note: immutable records are not updated from network, so
they don't add to the bookmarks processed per thread count.
2016-12-01 02:03:15 +05:30
Arun Prakash Jana
4071e76c5c
Use correct format while printing logs 2016-12-01 01:14:23 +05:30
Arun Prakash Jana
f8d4d331d1
Multiple simultaneous notify() calls combine to 1.
Only one notify() is received in main thread
if multiple threads send call simultaneously.

Test: update only one record. The first 4 notify() come as 1.

Fix: Use a counter to track number of threads completed.
2016-12-01 00:45:29 +05:30
Arun Prakash Jana
bf6893dd92 Merge pull request #101 from szlin/master
Fix UnicodeDecodeError when opening buku.py
2016-11-30 18:51:07 +05:30
SZ Lin
dc606daade Open buku.py in UTF-8 mode
buku.py is an UTF-8 file but setup.py opened it in ASCII mode instead of UTF-8 mode.
2016-11-30 16:29:54 +08:00
Arun Prakash Jana
d30dc8109c
5 threads by default in refreshdb(). Write on 32 fetches. 2016-11-30 04:21:11 +05:30
Arun Prakash Jana
d7f0c7a143 Merge pull request #98 from DamianSiniakowicz/master
draft: multithreaded refreshdb
2016-11-30 01:49:37 +05:30
Arun Prakash Jana
3331e608cb
Prepare for version 2.7 release. 2016-11-30 01:19:24 +05:30
Damian
147c8d6469 final draft : cleaned everything up 2016-11-28 22:47:30 -05:00
Damian
ae09e6bf99 commented out close_quit on line 2561 2016-11-28 22:22:14 -05:00
Damian
93715929c6 removed multi-connection solution 2016-11-28 20:53:32 -05:00
Damian
1965956dbf Merge remote-tracking branch 'jarun_master/master'
jarun made a change before I fixed my pull request
2016-11-28 20:47:18 -05:00
Arun Prakash Jana
46f2f5a1bd Remove redundant DB commit on delete. 2016-11-28 22:21:19 +05:30
Damian
b8cc710461 draft: multithreaded refreshdb 2016-11-27 23:00:42 -05:00
Arun Prakash Jana
82551c5706 Update documentation. 2016-11-28 02:18:41 +05:30
Arun Prakash Jana
c9f8b124b1 Optimize tag delete and replace APIs. 2016-11-28 00:32:06 +05:30
Arun Prakash Jana
8bbc199709 Update documentation. 2016-11-27 22:11:09 +05:30
Arun Prakash Jana
6a2471cd3e
Support --noprompt in subprompt. 2016-11-27 20:44:23 +05:30
Arun Prakash Jana
39f307358b Update features and dependencies. 2016-11-27 09:09:57 +05:30
Arun Prakash Jana
f1dd53f1bb
Fix #97: Show index in Json output. 2016-11-27 07:46:54 +05:30
Arun Prakash Jana
314ee1c840 Documentation update. 2016-11-26 20:26:23 +05:30
Arun Prakash Jana
6beed4e183
Update program help. 2016-11-25 23:40:25 +05:30
Arun Prakash Jana
038be099a2 Add notes on database sync. 2016-11-25 22:00:31 +05:30
Arun Prakash Jana
a28bd09013 Shorten debug API calls. 2016-11-23 00:59:26 +05:30
Arun Prakash Jana
804c8ce503 Update program requirements. 2016-11-21 22:43:42 +05:30
Arun Prakash Jana
de18fd0e0b
Show record when removing tag. 2016-11-21 19:33:04 +05:30
Arun Prakash Jana
b82b2194bf
Show prompt when listing tags. 2016-11-20 23:50:23 +05:30
Arun Prakash Jana
b4fe5c5fd7
Search results honour --format if --json is also specified. 2016-11-20 23:07:04 +05:30
Arun Prakash Jana
3a39685a1b
Update searchdb to handle special keywords. 2016-11-20 22:40:54 +05:30
Arun Prakash Jana
1609b5a135 API to fix tags from earlier versions. Update image. 2016-11-20 20:57:17 +05:30
Arun Prakash Jana
ff8bc645a6 Handle invalid regex search expression.
Example query:
$ buku --sreg c[m-l]x

Updated image.
2016-11-20 20:00:59 +05:30
Arun Prakash Jana
c6a0ec7b0d
Show usage count of tags in listing. 2016-11-20 19:01:02 +05:30
Arun Prakash Jana
63bce1004d Store tags in lower case. 2016-11-20 12:46:23 +05:30
Arun Prakash Jana
e56c04a315
Handle exception if no tags in DB. 2016-11-20 11:11:09 +05:30
Arun Prakash Jana
36ac3aaca6 Update asciinema demo. 2016-11-20 00:40:58 +05:30
Arun Prakash Jana
94bd49aa37
Username and password support in proxy auth. 2016-11-18 22:06:09 +05:30