David Singleton - Flurries of Latent Creativity » 2007 » May

Archive for May, 2007

awk for data processing

Monday, May 21st, 2007

How often do you fire up Excel just to do some simple data analysis?

Mean
awk ‘{s=s+$1;n++} END {print s/n;}’
(of course you might like to say alias mean=”awk ‘{s=s+\$1;n++;} END {print s/n;}’”)

Median
sort -n | awk ‘BEGIN {n=0} {d[n]=$1;n++;} END {CONVFMT=”%.f”;print d[n/2];}’
Histogram!sort -n | awk ‘BEGIN {CONVFMT=”%.f”;} {g=”" ($1/10);print g*10;}’ | uniq -c | awk ‘BEGIN {m=0;} {if ($1>m) m=$1; d[$2]=$1;} END {CONVFMT=”%.f”;for (a in d) {n=(d[a]*(80/m));b=”";for (i=0;i

Posted in Uncategorized | Comments Off