pages tagged documentation

Examples of using Evernote

Wed, 11 Mar 2020 18:41:54 +0000

Resync all data

Open Evernote.app on macOS.
Press Shift-Option/Alt and click the synchronization wheel icon next to the search input field (as of Evernote macOS version 7.14 and 2020-3).

Refresh database indices

Press Option/Alt and click menu item 'Option > Troubleshooting'
Click 'Recreate Full Text Search Index' and 'Recreate Spotlight Search Index'.

Installing and configuring mutt

Tue, 04 Feb 2020 19:44:45 +0000

Intro to Mutt

mutt is a text-based mail client for Unix operating systems.

Installing `mutt`

brew install mutt

Installing `getmail`

brew install getmail

Installing and configuring Docker

Sun, 02 Jul 2017 01:09:02 +0000

macOS

Homebrew

brew cask install docker
brew cask install docker-toolbox

Create a virtual machine

bash$ docker-machine create default

Start the virtual machine

Start the virtual machine default:

bash$ docker-machine start
bash$ docker-machine env
export DOCKER_TLS_VERIFY="1"
export DOCKER_HOST="tcp://192.168.99.100:2376"
export DOCKER_CERT_PATH="/Users/meng/.docker/machine/machines/default"
export DOCKER_MACHINE_NAME="default"
# Run this command to configure your shell:
# eval $(docker-machine env)
bash$ eval "$(docker-machine env default)"

Verify that the docker machine is working

bash$ docker run hello-world
Unable to find image 'hello-world:latest' locally
latest: Pulling from library/hello-world
b04784fba78d: Pull complete
Digest: sha256:f3b3b28a45160805bb16542c9531888519430e9e6d6ffc09d72261b0d26ff74f
Status: Downloaded newer image for hello-world:latest

Hello from Docker!
This message shows that your installation appears to be working correctly.

To generate this message, Docker took the following steps:
 1. The Docker client contacted the Docker daemon.
 2. The Docker daemon pulled the "hello-world" image from the Docker Hub.
 3. The Docker daemon created a new container from that image which runs the
    executable that produces the output you are currently reading.
 4. The Docker daemon streamed that output to the Docker client, which sent it
    to your terminal.

To try something more ambitious, you can run an Ubuntu container with:
 $ docker run -it ubuntu bash

Share images, automate workflows, and more with a free Docker ID:
 https://cloud.docker.com/

For more examples and ideas, visit:
 https://docs.docker.com/engine/userguide/

Run and test the 'tensorflow/tensorflow' Docker image

bash$ docker run -it tensorflow/tensorflow:1.1.0 bash
Unable to find image 'tensorflow/tensorflow:1.1.0' locally
1.1.0: Pulling from tensorflow/tensorflow
c62795f78da9: Pull complete
d4fceeeb758e: Pull complete
5c9125a401ae: Pull complete
0062f774e994: Pull complete
6b33fd031fac: Pull complete
353b34ef0a98: Pull complete
4f6aefc14b68: Pull complete
ce066374c6ca: Pull complete
c0755a91ab3a: Pull complete
f03279b52d25: Pull complete
d1c27c29b7e3: Pull complete
23807c5f4b3e: Pull complete
Digest: sha256:27bd43f1cf71c45eb48cb6e067b7cef47b168ac11c685d55a3495d27f0d59543
Status: Downloaded newer image for tensorflow/tensorflow:1.1.0
root@d000fef7e8dc:/notebooks#
root@d000fef7e8dc:/notebooks# python
Python 2.7.12 (default, Nov 19 2016, 06:48:10)
[GCC 5.4.0 20160609] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> 
>>> import tensorflow as tf
>>> hello = tf.constant('Hello, TensorFlow!')
>>> sess = tf.Session() # It will print some warnings here.
2017-06-29 06:08:55.848559: W tensorflow/core/platform/cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use SSE4.1 instructions, but these are available on your machine and could speed up CPU computations.
2017-06-29 06:08:55.848626: W tensorflow/core/platform/cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use SSE4.2 instructions, but these are available on your machine and could speed up CPU computations.
2017-06-29 06:08:55.848663: W tensorflow/core/platform/cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use AVX instructions, but these are available on your machine and could speed up CPU computations.
>>> print(sess.run(hello))
Hello, TensorFlow!
>>>

List all virtual machines

$ docker-machine ls                                                
NAME      ACTIVE   DRIVER       STATE     URL   SWARM   DOCKER    ERRORS
default   -        virtualbox   Stopped                 Unknown

Delete a virtual machine

$ docker-machine rm default
About to remove default
WARNING: This action will delete both local reference and remote instance.
Are you sure? (y/n): y
Successfully removed default

References

https://stackoverflow.com/questions/21871479/docker-cant-connect-to-docker-daemon

Installing and configuring TensorFlow

Sat, 01 Jul 2017 21:23:24 +0000

Install TensorFlow using 'tensorflow/tensorflow' Docker image

Start the Docker virtual machine

Create a virtual machine if not already

bash$ docker-machine create default

Start the virtual machine default:

bash$ docker-machine start
Starting "default"...
(default) Check network to re-create if needed...
(default) Waiting for an IP...
Machine "default" was started.
Waiting for SSH to be available...
Detecting the provisioner...
Started machines may have new IP addresses. You may need to re-run the `docker-machine env` command.
>>> elapsed time 35s
bash$ docker-machine env
export DOCKER_TLS_VERIFY="1"
export DOCKER_HOST="tcp://192.168.99.100:2376"
export DOCKER_CERT_PATH="/Users/meng/.docker/machine/machines/default"
export DOCKER_MACHINE_NAME="default"
# Run this command to configure your shell:
# eval $(docker-machine env)
bash$ eval "$(docker-machine env default)"

Start 'tensorflow/tensorflow' Docker image

$ export MY_WORKSPACE_DIR='/Users/meng/workspace'
$ docker run -it \
--net=host \
--publish 6006:6006 \
--volume ${MY_WORKSPACE_DIR}/tensorflow_test:/tensorflow_test \
--workdir /tensorflow_test \
tensorflow/tensorflow:1.1.0 bash
root@30d79c2e5fc3:/tensorflow_test# pwd
/tensorflow_test

Start TensorBoard

root@30d79c2e5fc3:/tensorflow_test# tensorboard --logdir training_summaries &
[1] 12
root@30d79c2e5fc3:/tensorflow_test# Starting TensorBoard 47 at http://0.0.0.0:6006
(Press CTRL+C to quit)

root@30d79c2e5fc3:/tensorflow_test#

Open TensorBoard at

http://192.168.99.100:6006

in a Web browser, where the IP is the same as DOCKER_HOST in the output of docker-machine env.

Download training data

# curl -O http://download.tensorflow.org/example_images/flower_photos.tgz
# tar xzf flower_photos.tgz
# find flower_photos -type f | wc -l
3671
# cp -R flower_photos flower_photos_subset
# rm flower_photos_subset/*/[2-9]*
# find flower_photos_subset/ -type f | wc -l
1202

Download training script

# curl -O https://raw.githubusercontent.com/tensorflow/tensorflow/r1.1/tensorflow/examples/image_retraining/retrain.py

Training

# python retrain.py \
      --bottleneck_dir=bottlenecks \
      --how_many_training_steps=500 \
      --model_dir=inception \
      --summaries_dir=training_summaries/basic \
      --output_graph=retrained_graph.pb \
      --output_labels=retrained_labels.txt \
      --image_dir=flower_photos_subset

Python script to classify new images of flowers

Create a new file label_image.py:

import os, sys

import tensorflow as tf

os.environ['TF_CPP_MIN_LOG_LEVEL'] = '2'

# change this as you see fit
image_path = sys.argv[1]

# Read in the image_data
image_data = tf.gfile.FastGFile(image_path, 'rb').read()

# Loads label file, strips off carriage return
label_lines = [line.rstrip() for line 
                   in tf.gfile.GFile("retrained_labels.txt")]

# Unpersists graph from file
with tf.gfile.FastGFile("retrained_graph.pb", 'rb') as f:
    graph_def = tf.GraphDef()
    graph_def.ParseFromString(f.read())
    tf.import_graph_def(graph_def, name='')

with tf.Session() as sess:
    # Feed the image_data as input to the graph and get first prediction
    softmax_tensor = sess.graph.get_tensor_by_name('final_result:0')

    predictions = sess.run(softmax_tensor, \
             {'DecodeJpeg/contents:0': image_data})

    # Sort to show labels of first prediction in order of confidence
    top_k = predictions[0].argsort()[-len(predictions[0]):][::-1]

    for node_id in top_k:
        human_string = label_lines[node_id]
        score = predictions[0][node_id]
        print('%s (score = %.5f)' % (human_string, score))

Classify a new image:

# python label_image.py flower_photos/daisy/99306615_739eb94b9e_m.jpg
daisy (score = 0.47996)
dandelion (score = 0.24667)
sunflowers (score = 0.24508)
tulips (score = 0.02018)
roses (score = 0.00811)

Exit the Docker image and stop the Docker virtual machine

Ctrl+D to exit Docker image and then run

$ docker-machine stop

References

https://codelabs.developers.google.com/codelabs/tensorflow-for-poets

Examples

Tue, 16 May 2017 23:59:39 +0000

New

RSS Atom

Examples of using `gpg-agent`
Posted Tue Jan 12 21:03:09 2021

Examples of using wget
Posted Sun May 3 05:47:34 2020

Examples of using Evernote
Posted Wed Mar 11 18:41:54 2020

Examples of using `tree`
Posted Tue Jan 21 20:00:14 2020

Examples of using afinfo
Posted Thu Dec 27 19:29:57 2018

Examples of using pandoc
Posted Tue Jul 25 19:35:27 2017

examples of using 7z
Posted Tue May 16 23:59:39 2017

Examples of using Imagemagick
Posted Tue May 16 23:59:39 2017

Examples of using ack
Posted Tue May 16 23:59:39 2017

Examples of using awk
Posted Tue May 16 23:59:39 2017

Examples of using Bash
Posted Tue May 16 23:59:39 2017

Examples of using command-line
Posted Tue May 16 23:59:39 2017

Examples of using curl
Posted Tue May 16 23:59:39 2017

Examples of using CVS
Posted Tue May 16 23:59:39 2017

examples of using du
Posted Tue May 16 23:59:39 2017

Examples of using Eclipse
Posted Tue May 16 23:59:39 2017

Examples of using Emacs
Posted Tue May 16 23:59:39 2017

Examples of using ffmpeg
Posted Tue May 16 23:59:39 2017

Examples of using find
Posted Tue May 16 23:59:39 2017

Examples of using Gmail
Posted Tue May 16 23:59:39 2017

Examples of using Eclipse

Tue, 16 May 2017 23:59:39 +0000

Uninstalling plug-in

Preferences → Install/Update → Uninstall or update software that is already installed → select some plug-ins → click Uninstall

Move a project's directory

Suppose you have a project 'project1' which is at path /home/XXX/workspace/project1/ and you want to move it to /home/XXX/workspace/group/project1/.

In order to avoid destroying the metadata of the project such as working sets and .project file, use the refactor function in the menu rather than deleting and recreating the project.

Create the directory /home/XXX/workspace/group/.
Use menu Windows > Views > Other > Navigator.
Right click on the project of interest in the Navigator view.
Choose refactor > move, and select the new path /home/XXX/workspace/group/, and click OK.

Change a CVS repository to use 'ext' connection method

By default a CVS repostiory created in Eclipse uses a non-standard connection method 'extssh'. To change an existing project to use 'ext' connection method,

Window > Open Perspective > CVS Repository Exploring > add a CVS repository with same setup as the 'extssh' repository but this time specify 'ext' as connection method.
Preferences > Team > CVS > Ext Connection Method > check 'Use another connection method type to connect', choose 'connection type' as 'extssh'.
Open Window > View > Navigator, in the Navigator view, right click on the interested project, go to menu Properties > CVS > Change Sharing > choose the CVS repository with 'ext' connection method.

Using the same physical directory as projects in different workspaces

Git clone (or CVS check out) a version controlled project to a centralized location on one's computer.
In each Eclipse workspace that you need the repository or project, use the menu "File > Import... General: Existing Projects in Workspace" to import the repository, but point it to the directory prepared in the last step. Make sure the "copy projects into workspace" checkbox is unchecked.

Notes

References

External links

Examples of using myrepos

Tue, 16 May 2017 23:59:39 +0000

Set user name and email to multiple Git repositories

Set up your myrepos and Git repositories according to https://myrepos.branchable.com/.

Add the following in ~/.mrconfig:

[DEFAULT]
## Teach mr how to config user name and email with `mr configusername` and `mr configuseremail`
configusername = git config user.name "Meng Lu"
configuseremail = git config user.email lumeng.dev@gmail.com

Navigate to a path that contains all the Git repositories you would like to set or update user name and email, and run

mr configusername
mr configuseremail

myrepos will print the paths of the Git repositories whose user name and email are updated.

References

myrepos: https://myrepos.branchable.com/.
Git documentation on configuring user: https://git-scm.com/book/en/v2/Getting-Started-First-Time-Git-Setup

Examples of using rsync

Tue, 16 May 2017 23:59:39 +0000

Publishing static content of a web site

Publish web site composed of static files and directories in directory ~/subdir/ on local machine to web site directory ~/dir/subdir on remote server

$ rsync -thrivpbl ~/mysite/ foouser@host.domain.com:~/dir/msite

$ rsync -zhavib ~/mysite/ foouser@host.domain.com:~/dir/mysite

-a equals -rlptgoD
- -r recursive
- -l preserve links
- -p preserve permissions
- -t preserve time stamp
- If copying on the same computer:
  - -g preserve group
  - -o preserve owner
  - -D or --devices preserve device files
-h report human readable numbers
-i report itemized list of the changes to each file, including attribute changes.
-v verbose
-b backup
-z compress file data during transfer

Verbose output (`-v`)

Some common indicators:

>f+++++++++: recieving (>) a regular file (f) which is newly created (+).
<f.st......: sending (<) a regular file (f) whose size (s) and time stamp (t) are different.
>f.st......: recieving (>) a regular file (f) whose size (s) and time stamp (t) are different.
.d..t......: not updating (initial .) a directory (d) whose time stamp (t) is different.

References: http://stackoverflow.com/questions/4493525/rsync-what-means-the-f-on-rsync-logs

Safely copying large file

$ sudo rsync -vahzi --progress /Volumes/large_file.mp4 /Volumes/new_file.mp4

Safely copying a large directory

$ sudo rsync -vahzi --progress /Volumes/large_dir/ /Volumes/new_dir

Installing up-to-date rsync via Homebrew on macOS

The version of rsync coming with macOS operating system is an older version (2.* as of OS X 10.10.2). To install the more up-to-date version,

brew doctor
brew upgrade
brew tap homebrew/dupes
brew install rsync

Make sure the path Homebrew installs softwares to, /usr/local/bin appears before other paths in /private/etc/paths so it's searched first. Restart the terminal.

Examples of using tee

Tue, 16 May 2017 23:59:39 +0000

Print command output including errors to multiple files and not screen

echo "$(date)" 2>&1 | tee -a file1 file2 >/dev/null

Installing and configuring Apache HTTP Server on macOS

Tue, 16 May 2017 23:59:39 +0000

previous version of Apache configuration files

Apache configuration file

$ cd /etc/apache2/users
$ touch "${USERNAME}.conf"
$ sudo chmod 644 "${USERNAME}.conf"

The configuration file "${USERNAME}.conf":

<Directory "/Users/XXX/Sites/">
  AllowOverride All
  Options Indexes MultiViews FollowSymLinks
  Require all granted
</Directory>

`/etc/apache2/httpd.conf`

LoadModule authz_host_module libexec/apache2/mod_authz_host.so
LoadModule authz_core_module libexec/apache2/mod_authz_core.so
LoadModule userdir_module libexec/apache2/mod_userdir.so
LoadModule vhost_alias_module libexec/apache2/mod_vhost_alias.so
Include /private/etc/apache2/extra/httpd-userdir.conf
Include /private/etc/apache2/extra/httpd-vhosts.conf

`/etc/apache2/extra/httpd-userdir.conf`

Include /private/etc/apache2/users/*.conf

Restarting Apache server

$ sudo apachectl restart

References

John Foderaro, How to Set up Apache in macOS Sierra 10.12, 2016.
How does ServerName and ServerAlias work?
Common Apache Misconfigurations

pages tagged documentation

Examples of using Evernote

Resync all data

Refresh database indices

Installing and configuring mutt

Intro to Mutt

Installing mutt

Installing getmail

Installing and configuring Docker

macOS

Homebrew

Create a virtual machine

Start the virtual machine

Verify that the docker machine is working

Run and test the 'tensorflow/tensorflow' Docker image

List all virtual machines

Delete a virtual machine

References

Installing and configuring TensorFlow

Install TensorFlow using 'tensorflow/tensorflow' Docker image

Start the Docker virtual machine

Start 'tensorflow/tensorflow' Docker image

Start TensorBoard

Download training data

Download training script

Training

Python script to classify new images of flowers

Exit the Docker image and stop the Docker virtual machine

References

Examples

New

Examples of using Eclipse

Uninstalling plug-in

Move a project's directory

Change a CVS repository to use 'ext' connection method

Using the same physical directory as projects in different workspaces

Notes

See also

References

External links

Examples of using myrepos

Set user name and email to multiple Git repositories

References

Examples of using rsync

Publishing static content of a web site

Verbose output (-v)

Safely copying large file

Safely copying a large directory

Installing up-to-date rsync via Homebrew on macOS

Examples of using tee

Print command output including errors to multiple files and not screen

Installing and configuring Apache HTTP Server on macOS

previous version of Apache configuration files

Apache configuration file

/etc/apache2/httpd.conf

/etc/apache2/extra/httpd-userdir.conf

Restarting Apache server

References

Installing `mutt`

Installing `getmail`

Verbose output (`-v`)

`/etc/apache2/httpd.conf`

`/etc/apache2/extra/httpd-userdir.conf`