How to Pass Turing Test?

Recently a chatbot fooled human judges in thinking it is a 13 year old boy for whom English is the second language. Here is the basic details of the structure of this system: it uses a hierarchy of patterns specified in XML structure for state estimation, and a set of rules that activate based on state, with knowledge that is stored in the database. Watch the original conference Chatbots 3.0 conference held in 2010:

Curse of Dimentionality

Classifiers that tend to model non-linear decision boundaries very accurately (e.g. neural networks, KNN classifiers, decision trees) do not generalize well and are prone to overfitting. Therefore, the dimensionality should be kept relatively low when these classifiers are used. If a classifier is used that generalizes easily (e.g. naive Bayesian, linear classifier), then the number of used features can be higher since the classifier itself is less expressive.

which features should be used?

Java Code Generation

cglib is a powerful, high performance and quality Code Generation Library, It is used to extend JAVA classes and implements interfaces at runtime. See samples and API documentation to learn more about features. Hibernate, Spring, iBatis all use cglib!!!

Open source projects use cglib and used by cglib:

Hoggetowne Hack

-->

One DSR team participated at the 6-hour Hoggetowne Hack 2014, Gainesville (an Open Data movement hackathon). We raced with an idea on city safety and delivered a workable prototype as an Android app which was brought upon to the panel of judges and nailed 2nd place and delivered check of $750 back home! This was a good data challenge with roughly 133 data sets available:Gainesville's Open Data Portal (a Government 2.0 initiative). There was 13 teams presenting their work with people from various local startups such as Grooveshark, roomsync, 352media, Gainesville HackerHouse, swampmobile, and many others.

Press Coverage:
First page of Computer Science Department at University of Florida   http://cise.ufl.edu/news/NA00173/
http://www.wcjb.com
http://www.gainesville.com
http://www.alligator.org

Photos:
http://www.gainesville.com/apps/pbcs.dll/gallery?Dato=20140222&Kategori=MULTIMEDIA0301&Lopenr=222009995&Ref=PH&pl=1

Java Threads

Java Synchronized

public class MyClass {
  
    public synchronized void log1(String msg1, String msg2){
       log.writeln(msg1);
       log.writeln(msg2);
    }

  
    public void log2(String msg1, String msg2){
       synchronized(this){
          log.writeln(msg1);
          log.writeln(msg2);
       }
    }
  } 

Java Finally!

public class Hello {

 public static void hello() {
  try {
   System.out.println("hi");
   return;
  } catch (RuntimeException e) {

                        //------------
  } finally {
   System.out.println("finally");

  }
  System.out.println("after try catch");
 }

        public static void main(String[] args){
                hello();

                System.out.println("after hello in parent");
 
        }
}

Create a Random Image in Java Pixel by Pixel

Hey check it out how to create a random image in Java pixel by pixel:

        int width = 500;
        int height = 500;

Vim and Weirdos!

I always thought vim is for nerds and weirdos. I have been using vim for three years now but I always looked at it as a chore, something that if I don't have to use it I won't! Who would use vim as long as there are sexy IDEs out there?

Until I little by little got familiar with some of its feartures. Like speak vim: di" will Delete Inside Quotation marks, or there are other verb/ nouns there. Today I tried vim plugins for the first time: I started with AutoComplPop, this

Twitter Analytics Infrastructure: Parquet, Storm - Analytics @ WebScale

I was watching a talk by Dmitriy Ryaboy who is the engineering manager on Twitter's analytics infrastructure team. The talk was about Twitter Analytics Infrastructure like Parquet, Storm,... at the Analytics @ WebScale conference and making sure they provide the right and optimized tools /infrastructure for different teams there to use .

===
So let's get dirty:
Logs are available in HDFS and stored in Apache Thrift

Workflow Management Azkaban & Oozie

Here I went to a meetup that talked about workflow management tools namely Azkaban and Oozie.
So imagine you have a long process of jobs in different programming languages, libraries etc. and you are handling each time e.g. manually run them or check their exit status, or write a shell script with ifs/elses to proceed to the rest of the jobs.  That is UGLY!

So Azkaban will take care o this for you in a nice GUI interface and tell you which ones succeeded or failed, and email you if they failed or succeeded. Now I like that!

Apparently it is not able to take care of creating directories or etc based on the workflow job so for those stuff you still need to have your own bash script.

Node.js and Benchmarking it on Mac

I'm looking through node.js which is a webserver with javascript code. So one of the cool features is that all of its commands are non-blocking! the server just keeps running. There is no mutex or multi-thread locks or deadlocks etc.

If you test it with ab command which is apache benchmark for webservers. ab already ships in Mac

Hadoop Meetup

Today I went to a Hadoop Meetup event where people shared their fair piece of wrestling with Hadoop. The discussion were mostly around search, scalability, fault tolerance, workflow and responsiveness. There were a ton of challenges that from outside you might think that they are not big of a deal but when you get to do them it takes a good man's efforts to solve. The main host was the Grooveshark music streaming company with over 60 employees in two offices one here in Gaiensville, FL and another in New York. The next meeting we would be talking about Hadoop workflow, Oozie by Yahoo, Azkaban by Linkedin, etc.