Deep Learning Plays Attari

Deep Mind, a subsidary of Google published an extended version of their 2013 paper in Nature along with source codes. Nature Paper. Code. The big picture: a deep network that has loss function as a function that maximizes its score. The input is the pixels of the screen (state) and output is action+score

Building a PC Tower for Deep Learning

It's been a while that I have not looked into building a PC piece by piece and I had to refresh my rusty knowledge. First you'd want to take a look at these: Which GPU(s) to Get for Deep Learning, which suggests for GTX 980 and GTX Titan and Which GPU to use for deep learning? that sugegsts GTX 780TI as a top mid-range. There is also this, which is a good quick guide on building a PC. So, here it boils down to two main goals: take the biggest memory on a cuda-enabled GPU which means NVIDIA. AMD on the other hand offers OpenCL library but I would say you won't find any deep learning library using OpenCL. So stick to NVIDIA, and any recent NVIDIA will do.

Such a system will be single threaded deep learning algorithm, so CPU does not play any roles here. The faster matrix computations the farther you'll get.

NVIDIA offers several categories of GPUs (Geforce, Tesla, Quadro).

Getting the Power of GPU for Deep Learning

install EPD
install bleeding edge theano

On my macbook pro it says my graphics card is Intel HD Graphics 4000 1024 MB. I was very disappointed that Apple just left an intel graphics card on a $2000 laptop. They could definitely do better. So I gave up on CUDA. Recently I found that two graphics cards on board!

Visualizing Optimization Algorithms

Here we look at a visualization of optimization algorithms:
- SGD (Stochastic Gradient Descent)
- Momentum
- NAG  (Numerical Algorithms Group)
- Adagrad (Adaptive Gradient Algorithm)
- Adadelta
- RMSProp (Divide the gradient by a running average of its recent magnitude)

What we are missing is the L-BFGS (Limited-memory BFGS)...

Deep Learning: Theano vs Torch vs Caffe vs deeplearning4j?

I am using deeplearning for hyperspectral data and I had to decide between available frameworks.

  Theano vs Torch vs Caffe vs deeplearning4j

Create Authentication for REST API

Authentication for REST API like done in amazon, facebook, dropbox they most probably conform to HMAC pattern. See here, here, here, and here.

alternatively

Semantic Web in Action - Structured Data

So Google has been building a knowledge graph of things. To better facilitate your website to be included in Google knowledge graph and enhance its SEO you have to embed semantic web (SW) vocabulary to your website.

NoSQL vs Lucene as Database

Today I was looking at the products of SindiceTech specifically SIREn which is schemaless search engine for JSON. They seem to be using it for their knowledge graph representation. Now the question boils down to why even bother with Lucene? MongoDB is already out there with scalability and fast nested schemaless indexing and search, even if you want to consider using it for a knowledge graph or semantic web context. Here is a good comparison of Lucene vs MongoDB as schemaless data stores and search engine. At the end of the day, if lucene done right it can do anything MongoDB can.

Matlab libsvm Mac Yosemite

After upgrading to Mac Yosemite things don't work as expected and Matlab doesn't run any more. So here is the fix:

Get Started with MEAN stack for Dummies

It's always tricky to get on track with new technologies. Here is how to get your first helloworld MEAN app up and running in a breeze!

Fucking SCP

Fucking scp didn't work because I printed out some statistics on the machine and its name bla bla and it took me some time to realize that scp depends on any returns from the server EVEVN ECHO prints!!!

So I had to disable all my status welcome messages and machine status printouts to console. Fucking dummy

Fix for Arabic Typing in Microsoft Word in Mac

How to fix sepratated/segragated arabic alphabet in microsoft word in mac:

Quit word.

download http://www.ghyoom.net/flv/Normal.dotm

copy and replace it with existing file located in

~/Library/Application Support/Microsoft/Office/User Templates

Source https://www.youtube.com/watch?v=hwUY31d7Wr4