Commit Graph

1535 Commits

Author SHA1 Message Date
Arun Prakash Jana
8c991ae178
Combine export with search options 2018-08-28 05:59:32 +05:30
Arun Prakash Jana
1fda4a45b4
Update mentions (add Open Source For You) 2018-08-26 12:31:57 +05:30
Arun Prakash Jana
d321918cff
Change user agent to latest Firefox on Ubuntu.
Certain websites are not flexible enough to recognize other patterns.
E.g. ifconfig.me
2018-08-26 10:55:27 +05:30
Arun Prakash Jana
f571b5fdda
Fix install instruction from AUR 2018-08-12 19:36:07 +05:30
rachmadaniHaryono
abebe31520
chg: test: report test time 2018-08-08 20:50:59 +05:30
Arun Prakash Jana
bf99c98d91
Refine tag and desc parse 2018-08-07 06:35:57 +05:30
Arun Prakash Jana
67e7e329e6
For update from DB in editor, show empty desc/title as empty line 2018-08-07 04:29:45 +05:30
Arun Prakash Jana
bf48169204
Fix test result 2018-08-07 03:22:50 +05:30
Arun Prakash Jana
03475041e4
Add check for trivial cases 2018-08-06 23:20:18 +05:30
Arun Prakash Jana
5113fe5b6a
Fix lint issue 2018-08-06 23:18:02 +05:30
Arun Prakash Jana
59606427b0
Match unusual tags agains title and tags 2018-08-06 22:56:31 +05:30
Arun Prakash Jana
e00b10d272
We need to add a delimiter for correct ratio 2018-08-06 22:03:20 +05:30
Arun Prakash Jana
f9621e4b1a
Reduce redundant newline 2018-08-06 21:18:57 +05:30
Arun Prakash Jana
99b82c3055
Fix #300: detect non-tag keywords 2018-08-06 21:13:02 +05:30
Arun Prakash Jana
c0400c72c3
Merge pull request #301 from rachmadaniHaryono/feature/pytest
fix for new feature
2018-08-06 19:01:48 +05:30
rachmadaniHaryono
f823a6aecc chg: test: simplify test_get_PoolManager 2018-08-06 15:51:36 +08:00
rachmadaniHaryono
9d2b414384 fix: test: test_add_rec_add_invalid_url 2018-08-06 15:47:38 +08:00
rachmadaniHaryono
41b8785a4e fix: test: test_network_handler_with_url 2018-08-06 15:42:46 +08:00
rachmadaniHaryono
551bf5a53d chg: dev: add html5lib package 2018-08-06 15:05:02 +08:00
rachmadaniHaryono
c0af32544a chg: test: use http for example.com 2018-08-06 14:37:28 +08:00
rachmadaniHaryono
3327cf0e7a chg: doc: error on to_temp_file_content 2018-08-06 14:25:22 +08:00
rachmadaniHaryono
8e6c53f404 chg: test: more test on to_temp_file_content func 2018-08-06 14:19:21 +08:00
rachmadaniHaryono
f80e5b241a fix: test: test_to_temp_file_content 2018-08-06 13:58:44 +08:00
rachmadaniHaryono
098d0d5e71 chg: test: remove test_get_page_title 2018-08-06 13:18:13 +08:00
rachmadaniHaryono
77fc10b6ee chg: test: remove BukuHTMLParser 2018-08-06 13:15:55 +08:00
Arun Prakash Jana
7989666250
Do not update title in case of network failures 2018-08-06 07:43:04 +05:30
Arun Prakash Jana
6b58bb9a8d
Add certifi as a requirement. 2018-08-06 06:34:58 +05:30
Arun Prakash Jana
eaea7ddcb0
Use certificate verification.
We keep getting:
"InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised."

Explanation:
https://urllib3.readthedocs.io/en/latest/user-guide.html#ssl
2018-08-06 06:21:26 +05:30
Arun Prakash Jana
bcd2aaf03f
Lint fixes 2018-08-06 05:47:42 +05:30
Arun Prakash Jana
70b6ae318a
Change user agent to X11 mode for full page data 2018-08-05 21:57:20 +05:30
Arun Prakash Jana
62923397b3
More meta tags to look for page description 2018-08-05 21:52:42 +05:30
Arun Prakash Jana
cc6151a775
Handle add and update description from editor 2018-08-05 21:00:01 +05:30
Arun Prakash Jana
5ed1e96368
refreshdb - update desc only is non-empty 2018-08-05 19:13:38 +05:30
Arun Prakash Jana
e0265a5341
Clean newlines in tags and titles 2018-08-05 18:16:03 +05:30
Arun Prakash Jana
5801b8c7e1
Use fetched description and tags from web 2018-08-05 16:37:16 +05:30
Arun Prakash Jana
4b4e5ffe37
Show error once
Show error string only once when deleting a non-existent record by index.

E.g.:

    buku -d non_existent_id

Fix indentation issue.
2018-08-05 09:24:22 +05:30
Arun Prakash Jana
c5b39b8491
A more robust delim_wrap() 2018-08-05 09:12:05 +05:30
Arun Prakash Jana
b463055f92
Fetch title, description and keywords from page 2018-08-05 08:29:19 +05:30
Arun Prakash Jana
5ea4cff4ec
Make bs4 a common import 2018-08-01 19:31:08 +05:30
Arun Prakash Jana
745b6190e4
Check index validity 2018-08-01 19:26:35 +05:30
Arun Prakash Jana
2ad2cbb02b
Merge pull request #298 from rachmadaniHaryono/feature/title
Feature/title
2018-08-01 18:47:08 +05:30
rachmadaniHaryono
b567dd2a64 chg: test: get_page_title func 2018-08-01 20:08:30 +08:00
rachmadaniHaryono
53e1eb2118 Revert "Revert "Revert "Remove redundant message, fix check for 0 records"""
This reverts commit edf5773830.
2018-08-01 19:59:50 +08:00
rachmadaniHaryono
92c6e5c7c7 chg: dev: use bs4 as backup parser 2018-08-01 19:59:33 +08:00
rachmadaniHaryono
1a0b5bd328 new: test: 2 url for testing 2018-08-01 19:57:34 +08:00
rachmadaniHaryono
73c79beca5 chg: dev: use utf8 as default decoder 2018-08-01 19:57:34 +08:00
rachmadaniHaryono
496238262f fix: test: fetch title 2018-08-01 19:57:34 +08:00
rachmadaniHaryono
8180711a33 chg: test: add url for test title fetch 2018-08-01 19:57:34 +08:00
Arun Prakash Jana
79746c1f83
Merge pull request #299 from dkiyatkin/chardet-for-title
Remove double whitespaces from title
2018-08-01 17:26:05 +05:30
Dmitriy Kiyatkin
4983209dfd remove double whitespaces from title 2018-08-01 10:55:12 +00:00