flask

$ sudo easy_install flask
$ sudo easy_install flask-wtf                     //for wtf
$ sudo easy_install sqlalchemy-migrate    //for db
sqlalchemy-migrate==0.7.2 is not compatible with SQLAlchemy 0.8.x. install SQLAlchemy 0.7.10 instead with pip install SQLAlchemy==0.7.10 or easy_install QLAlchemy==0.7.10

Memo for Big Data

Python
Crawler
Scrapy
http://scrapy.org/

Data Analysis

pandas

http://pandas.pydata.org/

https://pda.readthedocs.org/en/latest/chp5.html

Machine Learning

scikit-learn

http://scikit-learn.org/stable/

Graphs Analysis

NetworkX

http://networkx.github.io/

Data Base

Mongo

http://www.mongodb.org/

Distributed Computing Framework

disco

http://discoproject.org/

DPark

https://github.com/douban/dpark/

Spark

http://spark-project.org/docs/latest/python-programming-guide.html

happy

https://code.google.com/p/happy/

A Guide to Python Frameworks for Hadoop

http://blog.cloudera.com/blog/2013/01/a-guide-to-python-frameworks-for-hadoop/

Visualization

matplotlib

http://matplotlib.org/

R

RHIPE

http://www.datadr.org/

other articles
http://datacommunitydc.org/blog/2013/03/getting-started-with-python-for-data-scientists/

http://www.r-bloggers.com/stepping-up-to-big-data-with-r-and-python-a-mind-map-of-all-the-packages-you-will-ever-need/

The problem with NVIDIA GeGorce GT 640m in UBUNTU12.04

When i execute Openrave in Aspire V3-471G notebook, there is error message about "Can't set up a valid OpenGL canvas, something is seriously wrong with the system!"
The cause of this problem  is that Nvidia Optimus function is not support in Ubuntu.
So i have to install Bumblebee-UI in ubuntu.

sudo add-apt-repository ppa:ubuntu-x-swat/x-updates
sudo apt-get update

sudo apt-get install bumblebee bumblebee-nvidia linux-headers-generic

pyinstaller

convert your py file to exe file
user who can execute your program without python
Install:
just unzip to your file folder

Usage:
python pyinstaller.py /path/to/yourscript.py
or
python /path/to/pyinstaller.py yourscript.py

Weka FP Growth dataset

Weka FPGrowth needs Binary attributes, arff form likes this:


@relation FPGrowth dataset

@attribute a {1,0}
@attribute b {1,0}
@attribute c {1,0}

@data
0,0,0
0,0,1
0,1,0
0,1,1
1,0,0
1,0,1
1,1,0
1,1,1

SBCL

Steel Bank Common Lisp ( http://www.sbcl.org/ )

ubuntu:

Install SBCL

    ~$ sudo apt-get install sbcl

installed to

    /usr/bin

    /usr/lib

    /usr/share/doc

Running SBCL

    ~$ sbcl

    * (quit)     ;quit sbcl

ASDF: Another System Definition Facility ( http://common-lisp.net/project/asdf/ )

Install 

    ~$ sudo apt-get install cl-asdf

install to

    /usr/lib/asdf

    /usr/share/doc/cl-asdf

LISP中文教學

http://wiki.ubuntu.org.cn/index.php?title=Common_LISP_Hints&variant=zh-tw

http://acl.readthedocs.org/en/latest/zhTW/index.html

Common Lisp the Language, 2nd Edition

http://www.cs.cmu.edu/Groups/AI/html/cltl/cltl2.html

SHOP2

Simple Hierarchical Ordered Planner (http://www.cs.umd.edu/projects/shop/)

~$ sbcl
* (require :asdf)
* (push "/home/user/experiment/shop2/" asdf:*central-registry*)    ;push shop2 folder path to asdf
* (asdf:oos 'asdf:load-op "shop2")    ;load shop2 in asdf
* (load "~/experiment/basic")    ;load shop2 domain, problem & plan which you define