Category Archives: Network Technology

The error “GLIBC_2.xx not found” is usually seen when someone installs tensorflow on a relatively outdated machine. Solution Install Conda. Details 1. download MiniConda: https://conda.io/miniconda.html 2. install it:  chmod +x Miniconda3-latest-Linux-x86_64.sh ./Miniconda3-latest-Linux-x86_64.sh 3. create a new environment: conda create -n myenv python=3.6 4.  activate it source activate myenv 5. install tensorflow using conda (within the environment myenv) …

Continue reading “GLIBC_2.xx not found while installing tensorflow”

We’ve introduced one way to proxy internet: https://czxttkl.com/?p=1265 Now we introduce another way to create proxy, which uses shadowsocks + SwitchyOmega (a chrome extension). Ubuntu: in a terminal:  sudo apt-get install shadowsocks-qt5 sudo add-apt-repository ppa:hzwhuang/ss-qt5 sudo apt-get update sudo apt-get install shadowsocks-qt5 open the installed shadowsocks and config a new connection:  install chrome extension SwitchyOmega: https://www.dropbox.com/s/i5xmrh4wv1fivg7/SwitchyOmega_Chromium.crx?dl=0 config …

Continue reading “shadowsocks + SwitchyOmega”

1.  remove cuda 7.x version (x depends on what you installed.) rm /usr/local/cuda-7.x 2. make sure PATH and LD_LIBRARY_PATH no longer contain “/usr/local/cuda-7.x”. Possible places to look at are /etc/environment, ~/.profile, /etc/bash.bashrc, /etc/profile, ~/.bash_rc If you really don’t know where cuda path is added to PATH or LD_LIBRARY_PATH, try to check here: https://unix.stackexchange.com/questions/813/how-to-determine-where-an-environment-variable-came-from 3. cuda 8.0 …

Continue reading “Upgrade Cuda from 7.x to 8.0 on Ubuntu”

Just to back up my keymap setting because I think they are super convenient to my usage style. https://www.dropbox.com/s/m14ozngs59jcd18/pycharm_keymap_settings.jar?dl=0

# for connection and file transfer ssh -i ~/Dropbox/research/aws_noisemodel_keypair.pem ubuntu@ec2-54-164-130-227.compute-1.amazonaws.com rsync –progress –delete -rave “ssh -i /home/czxttkl/Dropbox/research/aws_noisemodel_keypair.pem” /home/czxttkl/workspace/mymachinelearning/Python/LoLSynergyCounter ubuntu@ec2-54-164-130-227.compute-1.amazonaws.com:~/ sudo apt-get install python-pip python-dev pip install tensorflow-gpu   download and transfer cuda toolkit, then install  sudo dpkg -i cuda-repo-ubuntu1604-8-0-local_8.0.44-1_amd64.deb sudo apt-get update sudo apt-get install cuda   download and transfer cudnn, then install: tar xvzf cudnn-<your-version>.tgz sudo …

Continue reading “Install Tensorflow 0.12 with GPU support on AWS p2 instance”

In order to achieve a filter rule with OR operation, you must specify conditions connected by the keyword “OR” (must be in upper cases). For example:

Use `rsync` with `-n` (dry run) so that it lists diff files but will not execute syncing.  rsync -n -avcr –delete local_folder/ username@domain:remote_folder/  

1.Use a specified port (e.g., 12345) for SSH SOCKS server: ssh -D 12345 user@host.domain 2. Go to the setting menu in Firefox, then Advanced->Network->Connection->Settings 3.Check the “Manual proxy configuration”, fill in SOCKS host (127.0.0.1) and port (your specified port, 12345 in our example) 4. Also, type in “about:config” in the address bar in Firefox, change …

Continue reading “Use SSH tunnel and Firefox for proxy”

Original paper: http://static.googleusercontent.com/media/research.google.com/en//archive/gfs-sosp2003.pdf Cons and pros on Quora: https://www.quora.com/Reviews-of-Google-File-System Paper discussion: http://pages.cs.wisc.edu/~swift/classes/cs736-fa08/blog/2008/11/the_google_file_system.html A blog discussion: http://kaushiki-gfs.blogspot.com/ A ppt discussion: http://www.slideshare.net/tutchiio/gfs-google-file-system A QA series: http://pages.cs.wisc.edu/~thanhdo/qual-notes/fs/fs4-gfs.txt GFS wiki: http://google-file-system.wikispaces.asu.edu/ 2.3  GFS uses one-master-mutiple-chunkservers mode. Client will query the master about the metadata of files, which reside in the master’s memory hence query is fast. The real data operation takes place at chunkservers. …

Continue reading “Review: The Google File System”