From 659a09c32d9110f66b618c33b3be84b35d925dad Mon Sep 17 00:00:00 2001 From: Richard Townsend Date: Sat, 26 Jul 2014 05:42:23 -0700 Subject: [PATCH] Created Trees (markdown) --- Trees.md | 10 ++++++++++ 1 file changed, 10 insertions(+) create mode 100644 Trees.md diff --git a/Trees.md b/Trees.md new file mode 100644 index 0000000..ae8be77 --- /dev/null +++ b/Trees.md @@ -0,0 +1,10 @@ +**See also: [`examples/trees/trees.go`](https://github.com/sjwhitworth/golearn/blob/master/examples/trees/trees.go).** + +##ID3 +ID3 is a decision tree induction algorithm which splits on the Attribute which gives the greatest Information Gain (entropy gradient). It performs well on categorical data. Numeric datasets will need to be discretised before using ID3 (see [Filtering](Filtering)). + +##Random Trees +Random Trees are structurally identical to those generated by ID3, but the split Attribute is chosen randomly. Golearn's implementation allows you to choose up to *k* nodes for consideration at each split. + +##Random forests +Random forests are a bagged ensemble technique which combines multiple Random Trees and outputs a classification via a majority vote. \ No newline at end of file