buku/README.md

320 lines
14 KiB
Markdown
Raw Normal View History

2016-04-22 16:11:16 -05:00
<h1 align="center">Buku</h1>
2015-11-10 01:15:35 -06:00
2016-04-23 00:46:27 -05:00
<p align="center">
<a href="https://aur.archlinux.org/packages/buku"><img src="https://img.shields.io/aur/version/buku.svg" alt="AUR" /></a>
<a href="http://braumeister.org/formula/buku"><img src="https://img.shields.io/homebrew/v/buku.svg" alt="Homebrew" /></a>
<a href="https://github.com/jarun/Buku/releases/latest"><img src="https://img.shields.io/github/release/jarun/buku.svg" alt="Latest release" /></a>
2016-04-26 03:36:14 -05:00
<a href="https://github.com/jarun/buku/blob/master/LICENSE"><img src="https://img.shields.io/badge/license-GPLv3-yellow.svg?maxAge=2592000" alt="License" /></a>
2016-04-23 00:46:27 -05:00
</p>
2016-04-22 16:11:16 -05:00
<p align="center">
2016-04-23 09:52:43 -05:00
<a href="https://asciinema.org/a/6x3nu7ez9t0flk1knhiabwduv"><img src="https://asciinema.org/a/6x3nu7ez9t0flk1knhiabwduv.png" alt="Asciicast" width="600"/></a>
2016-04-22 16:11:16 -05:00
</p>
2015-11-10 01:15:35 -06:00
2016-04-20 23:59:57 -05:00
`buku` is a powerful cmdline bookmark management utility written in Python3 and SQLite3. When I started writing it, I couldn't find a flexible cmdline solution with a portable database. Hence, `Buku` (after my son's nickname).
2016-02-28 05:08:04 -06:00
2016-04-21 10:29:32 -05:00
You can add bookmarks to `buku` with tags and page title fetched from the web, search, update and remove bookmarks. You can open the URLs from search results directly in the browser. Encryption is supported, optionally with custom number of hash passes for key generation.
2016-02-28 05:08:04 -06:00
2016-04-08 07:50:25 -05:00
`buku` can also handle piped input, which lets you combine it with `xsel` (on Linux) and use a shortcut to add selected or copied text as bookmark without touching the terminal.
2016-03-26 12:21:40 -05:00
Ref: [buku & xsel: add selected or copied URL as bookmark](http://tuxdiary.com/2016/03/26/buku-xsel/)
2016-02-28 05:08:04 -06:00
2016-04-17 05:07:22 -05:00
Find `buku` useful? If you would like to donate, visit the
2016-04-26 03:36:14 -05:00
[![Donate Button](https://img.shields.io/badge/paypal-donate-orange.svg?maxAge=2592000)](https://www.paypal.com/cgi-bin/webscr?cmd=_s-xclick&hosted_button_id=RMLTQ76JSXJ4Q) page.
2016-02-28 05:08:04 -06:00
2016-04-26 03:19:16 -05:00
Copyright (C) 2015 [Arun Prakash Jana](mailto:engineerarun@gmail.com).
2015-11-08 16:04:49 -06:00
# Features
2016-04-19 13:57:58 -05:00
2015-11-08 16:04:49 -06:00
- Add, update or remove a bookmark
2016-04-28 10:59:17 -05:00
- Tag bookmarks
- Manual password protection using AES256 encryption
2016-04-21 10:47:33 -05:00
- Fetch page title from the web (default) or add a custom page title manually
2015-11-08 16:04:49 -06:00
- Use (partial) tags or keywords to search bookmarks
2015-11-11 06:29:38 -06:00
- Any or all search keyword match options
2016-04-28 10:59:17 -05:00
- Unique URLs to avoid duplicates
2015-11-08 16:04:49 -06:00
- Open search results in browser
2016-04-28 10:59:17 -05:00
- Open bookmark in browser using index
- Handle piped input (combine with xsel and add bookmarks directly from browser)
- Supports HTTP compression
2016-04-17 11:07:26 -05:00
- Optional Json formatted output
2016-03-19 11:11:59 -05:00
- Modify or delete tags in DB
- Show all unique tags sorted alphabetically
2015-11-09 23:23:35 -06:00
- Show single bookmark by ID or all bookmarks in a go
2015-11-13 05:25:42 -06:00
- Refresh all bookmarks online
2016-04-28 10:59:17 -05:00
- Auto DB compaction on bookmark removal
2016-03-20 00:53:59 -05:00
- Delete all bookmarks from DB
- Show all bookmarks with empty titles or no tags (for bookkeeping)
2016-04-28 10:59:17 -05:00
- Supports Unicode characters in URL
- UTF-8 request and response, page character set detection
2015-11-10 06:49:09 -06:00
- Secure parameterized SQLite3 queries to access database
2016-04-10 08:01:11 -05:00
- Handle multiple HTTP redirections (reports redirected URL, loops, IP blocking)
2015-11-08 16:04:49 -06:00
- Coloured output for clarity
2015-11-13 05:25:42 -06:00
- Easily create compatible batch add or update scripts
2015-11-11 06:29:38 -06:00
- Unformatted selective output (for creating batch update scripts)
2016-04-28 10:59:17 -05:00
- Manpage with examples for quick reference
2015-11-08 16:04:49 -06:00
- Fast and clean (no ads or clutter)
- Minimal dependencies
- Open source and free
2016-04-19 13:57:58 -05:00
# Table of Contents
- [Installation](#installation)
- [Dependencies](#dependencies)
- [Installing from this repository](#installing-from-this-repository)
- [Running as a standalone utility](#running-as-a-standalone-utility)
- [Installing with a package manager](#installing-with-a-package-manager)
- [Usage](#usage)
- [Cmdline options](#cmdline-options)
- [Operational notes](#operational-notes)
- [Examples](#examples)
- [Bookkeeping](#bookkeeping)
- [Contributions](#contributions)
- [Developers](#developers)
2015-11-08 16:04:49 -06:00
# Installation
2016-02-28 08:11:27 -06:00
## Dependencies
`buku` requires Python 3.x to work.
2015-11-08 16:04:49 -06:00
2016-02-28 08:11:27 -06:00
For optional encryption support, install PyCrypto module. Run:
$ sudo pip3 install pycrypto
or on Ubuntu:
$ sudo apt-get install python3-crypto
2016-03-24 03:46:07 -05:00
## Installing from this repository
2016-02-28 08:11:27 -06:00
If you have git installed, run:
$ git clone https://github.com/jarun/buku/
or download the latest [stable release](https://github.com/jarun/Buku/releases/latest) or [development version](https://github.com/jarun/buku/archive/master.zip).
Install to default location:
2016-04-10 07:41:00 -05:00
$ sudo make install
2016-02-28 08:11:27 -06:00
or, a custom location (PREFIX):
$ PREFIX=/path/to/prefix make install
2016-04-10 07:41:00 -05:00
To remove, run:
2015-11-08 16:04:49 -06:00
2016-02-28 08:11:27 -06:00
$ sudo make uninstall
or, if you have installed to a custom location (PREFIX):
2015-11-08 16:29:17 -06:00
2016-02-28 08:11:27 -06:00
$ PREFIX=/path/to/prefix make uninstall
You may need to use `sudo` with `PREFIX` depending on your permissions on destination directory.
2016-02-28 08:11:27 -06:00
## Running as a standalone utility
`buku` is a standalone utility. From the containing directory, run:
$ ./buku
## Installing with a package manager
`buku` is also available on
2016-04-22 00:17:00 -05:00
- [AUR](https://aur.archlinux.org/packages/buku/) for Arch Linux
- Void Linux repos ( `$ sudo xbps-install -S buku` )
- [Homebrew](http://braumeister.org/formula/buku) for OS X, or its Linux fork, [Linuxbrew](https://github.com/Linuxbrew/linuxbrew/blob/master/Library/Formula/buku.rb)
2016-02-09 00:12:08 -06:00
2015-11-08 16:29:17 -06:00
# Usage
2016-02-28 05:08:04 -06:00
2016-03-25 13:47:51 -05:00
## Cmdline options
2016-02-28 08:11:27 -06:00
2016-04-29 13:09:39 -05:00
**NOTE:** If you are using `buku` v1.9 or below please refer to the installed manpage or program help. The development version has significant changes.
usage: buku [-a URL [tags ...]] [-u [N [URL tags ...]]]
[-t [...]] [-d [N]] [-h]
[-s keyword [...]] [-S keyword [...]]
[-k [N]] [-l [N]] [-p [N]] [-f N]
[-r oldtag [newtag ...]] [-j] [-o N] [-z]
A private cmdline bookmark manager. Your mini web!
2016-02-28 08:11:27 -06:00
2016-04-29 13:09:39 -05:00
general options:
-a, --add URL [tags ...]
bookmark URL with comma separated tags
-u, --update [N [URL tags ...]]
update fields of bookmark at DB index N
refresh all titles, if no arguments
if URL omitted and -t is unused, update
title of bookmark at index N from web
-t, --title [...] manually set title, works with -a, -u
do not set title, if no arguments
-d, --delete [N] delete bookmark at DB index N
delete all bookmarks, if no arguments
-h, --help show this information
search options:
-s, --sany keyword [...]
search bookmarks for ANY matching keyword
-S, --sall keyword [...]
search bookmarks with ALL keywords
special keywords -
"tags" : list all tags alphabetically
"blank": list entries with empty title/tag
encryption options:
-l, --lock [N] encrypt DB file with N (> 0, default 8)
hash iterations to generate key
-k, --unlock [N] decrypt DB file with N (> 0, default 8)
hash iterations to generate key
power toys:
-p, --print [N] show details of bookmark at DB index N
show all bookmarks, if no arguments
-f, --format N modify -p output
N=1: show only URL, N=2: show URL and tag
-r, --replace oldtag [newtag ...]
replace oldtag with newtag in all bookmarks
delete oldtag, if no newtag
-j, --jason Json formatted output, works with -p, -s
-o, --open open bookmark at DB index N in web browser
-z, --debug show debug information and additional logs
prompt keys:
1-N open the Nth search result in web browser
2016-04-19 10:46:19 -05:00
Enter exit buku
2016-02-28 05:08:04 -06:00
2016-02-28 08:11:27 -06:00
## Operational notes
2016-03-25 13:47:51 -05:00
2016-04-24 09:37:51 -05:00
- The SQLite3 database file is stored in:
- **$XDG_DATA_HOME/buku/bookmarks.db**, if XDG_DATA_HOME is defined (first preference) or
- **$HOME/.local/share/buku/bookmarks.db**, if HOME is defined (second preference) or
2016-04-24 14:28:22 -05:00
- the **current directory**, e.g. on Windows.
2016-04-24 09:37:51 -05:00
- Before version 1.9, `buku`stored its database in **$HOME/.cache/buku/bookmarks.db**. If the file exists, buku automatically moves it to new location.
- It's advisable to copy URLs directly from the browser address bar, i.e., along with the leading `http://` or `https://` token. `buku` looks up title data (found within <title></title> tags of HTML) from the web ONLY for fully-formed HTTP(S) URLs.
2016-04-27 12:07:19 -05:00
- If the URL contains characters like `;`, `&` or brackets they may be interpreted specially by the shell. To avoid it, add the URL within single or double (`'`/`"`) quotes.
- URLs are unique in DB. The same URL cannot be added twice. You can update tags and re-fetch title data.
2015-11-10 01:15:35 -06:00
- Search works in mysterious ways:
2016-04-19 14:08:39 -05:00
- Case-insensitive.
- Substrings match (`match` matches `rematched`) for URL, title and tags.
- `-s` : match any of the keywords in URL, title or tags.
- `-S` : match all the keywords in URL, title or tags.
- You can search bookmarks by tag (refer examples).
- Search results are indexed serially. This index is different from actual database index of a bookmark record which is shown within `[]` after the URL.
2016-04-20 10:41:07 -05:00
- When a record is deleted, the last record is moved to the index.
- Encryption is optional and manual. AES256 algorithm is used. If you choose to use encryption, the database file should be unlocked (`-k`) before using buku and locked (`-l`) afterwards. Between these 2 operations, the database file lies unencrypted on the disk, and NOT in memory. Also, note that the database file is <i>unencrypted on creation</i>.
2016-02-28 05:08:04 -06:00
2015-11-08 16:32:12 -06:00
# Examples
2016-04-21 10:29:32 -05:00
1. **Add** a bookmark with **tags** `linux news` and `open source`, **fetch page title** from the web:
$ buku -a http://tuxdiary.com linux news, open source
Title: [TuxDiary | Linux, open source and a pinch of leisure.]
Added at index 15012014
2. **Add** a bookmark with tags `linux news` and `open source` & **custom title** `Linux magazine`:
2016-02-28 08:32:10 -06:00
$ buku -a http://tuxdiary.com linux news, open source -t 'Linux magazine'
2016-02-28 08:32:10 -06:00
Added at index 15012014
Note that URL must precede tags.
3. **Add** a bookmark **without a title** (works for update too):
2016-02-28 08:32:10 -06:00
$ buku -a http://tuxdiary.com linux news, open source -t
2016-04-21 22:12:17 -05:00
4. **Update** existing bookmark at index 15012014 with new URL and tags, fetch title from the web:
2016-02-28 08:32:10 -06:00
2016-04-21 22:12:17 -05:00
$ buku -u 15012014 http://tuxdiary.com/ linux news, open source, magazine
2016-02-28 08:32:10 -06:00
Title: [TuxDiary | Linux, open source and a pinch of leisure.]
2016-03-19 12:44:27 -05:00
Updated index 15012014
Tags are updated too. Original tags are removed.
2016-04-21 10:37:11 -05:00
5. **Update** or refresh **full DB** with page titles from the web:
2016-02-28 08:32:10 -06:00
$ buku -u
This operation does not modify the indexes, URLs or tags. Only title is refreshed if fetched title is non-empty.
2016-04-21 10:29:32 -05:00
6. **Delete** bookmark at index 15012014:
2016-02-28 08:32:10 -06:00
$ buku -d 15012014
2016-03-20 00:53:59 -05:00
Index 15012020 moved to 15012014
The last index is moved to the deleted index to keep the DB compact.
2016-04-21 10:29:32 -05:00
7. **Delete all** bookmarks:
2016-02-28 08:32:10 -06:00
$ buku -d
2016-04-21 10:29:32 -05:00
8. List **all unique tags** alphabetically:
2016-03-18 13:15:44 -05:00
$ buku -S tags
9. **Replace tag** 'old tag' with 'new tag':
2016-02-28 08:32:10 -06:00
$ buku -r 'old tag' new tag
10. **Delete tag** 'old tag' from DB:
2016-03-19 11:11:59 -05:00
$ buku -r 'old tag'
11. **Show details** of bookmark at index 15012014:
2016-02-28 08:32:10 -06:00
$ buku -p 15012014
12. **Show all** bookmarks with real index from database:
2016-02-28 08:32:10 -06:00
$ buku -p
13. **Open URL** at index 15012014 in browser:
2016-02-28 08:32:10 -06:00
$ buku -o 15012014
14. **Search** bookmarks for **ANY** of the keywords `*kernel*` and `*debugging*` in URL, title or tags:
2016-02-28 08:32:10 -06:00
$ buku -s kernel debugging
15. **Search** bookmarks with **ALL** the keywords `*kernel*` and `*debugging*` in URL, title or tags:
2016-02-28 08:32:10 -06:00
$ buku -S kernel debugging
16. **Search** bookmarks with **tag** *general kernel concepts*:
2016-04-19 12:30:06 -05:00
2016-04-19 23:03:02 -05:00
$ buku -S ',general kernel concepts,'
Note the commas (,) before and after the tag. Comma is the tag delimiter in DB.
17. Encrypt/decrypt DB with **custom number of iterations** (15) to generate key:
2016-02-28 08:32:10 -06:00
$ buku -l 15
$ buku -k 15
2015-12-22 12:18:55 -06:00
The same number of iterations must be used for one lock & unlock instance.
18. More **help**:
2016-02-28 08:32:10 -06:00
$ buku
$ man buku
2016-03-29 07:43:43 -05:00
## Bookkeeping
2016-03-29 07:47:35 -05:00
1. To list bookmarks with **no title or tags**:
2016-03-29 07:43:43 -05:00
$ buku -e
2016-03-29 07:47:35 -05:00
Use the `-u` option to add title or tags to those entries, if you want to.
2016-03-29 07:43:43 -05:00
2. `buku` doesn't have any **import feature** of its own. To import URLs in **bulk**, create a script with URLs and tags like the following (check TIP below):
2016-02-28 08:32:10 -06:00
#!/bin/bash
2016-04-21 10:29:32 -05:00
buku -a https://wireless.wiki.kernel.org/ networking, device drivers
buku -a https://courses.engr.illinois.edu/ece390/books/artofasm/ArtofAsm.html assembly
buku -a http://www.tittbit.in/
buku -a http://www.mikroe.com/chapters/view/65/ electronics
buku -a "http://msdn.microsoft.com/en-us/library/bb470206(v=vs.85).aspx" file systems
buku -a http://www.ibm.com/developerworks/linux/library/l-linuxboot/index.html boot process
Make the script executable and run to batch add bookmarks.
2016-03-29 07:43:43 -05:00
3. To **update selected URLs** (refresh) along with your tags, first get the unformatted selective output with URL and tags:
2016-02-28 08:32:10 -06:00
2016-04-20 10:09:18 -05:00
$ buku -p 0 -x 2 | tee myurls
2016-04-21 10:29:32 -05:00
Remove the lines you don't need. Add `buku -u ` in front of all the other lines (check TIP below). Should look like:
2016-02-28 08:32:10 -06:00
#!/bin/bash
2016-04-21 10:29:32 -05:00
buku -u 50 https://wireless.wiki.kernel.org/ networking, device drivers
buku -u 51 https://courses.engr.illinois.edu/ece390/books/artofasm/ArtofAsm.html assembly
buku -u 52 http://www.tittbit.in/
buku -u 53 http://www.mikroe.com/chapters/view/65/ electronics
buku -u 54 "http://msdn.microsoft.com/en-us/library/bb470206(v=vs.85).aspx" file systems
buku -u 55 http://www.ibm.com/developerworks/linux/library/l-linuxboot/index.html boot process
Run the script:
2016-02-28 08:32:10 -06:00
$ chmod +x myurls
$ ./myurls
2016-02-28 05:08:04 -06:00
2016-04-06 00:00:19 -05:00
####TIP
2016-04-06 00:04:14 -05:00
Add the same text at the beginning of multiple lines:
2016-04-10 07:41:00 -05:00
**vim**
2015-11-11 02:31:04 -06:00
- Press `Ctrl-v` to select the first column of text in the lines you want to change (visual mode).
- Press `Shift-i` and type the text you want to insert.
- Hit `Esc`, wait 1 second and the inserted text will appear on every line.
2016-02-28 05:08:04 -06:00
2016-04-06 00:04:14 -05:00
**sed**
2016-02-28 08:11:27 -06:00
2016-04-21 10:29:32 -05:00
$ sed -i 's/^/buku -u /' filename
2015-11-08 16:04:49 -06:00
2015-11-10 00:34:37 -06:00
# Contributions
2016-04-29 13:27:56 -05:00
Pull requests are welcome. Please visit [issue #14](https://github.com/jarun/Buku/issues/14) for a list of TODOs.
2015-11-10 00:34:37 -06:00
2016-02-28 05:08:04 -06:00
# Developers
2016-02-01 08:46:26 -06:00
[Arun Prakash Jana](mailto:engineerarun@gmail.com)
2016-02-28 05:08:04 -06:00
Special thanks to the community for valuable suggestions and ideas.