Click to learn more about author Steve Miller. I did a short consulting gig last year with a company that was building an analytic app driven largely from a web-based data repository. The data were stored as a collection of SAS data sets which “customers” would subset by uploading SAS data step and proc SQL […]
Politics, Luck, Bayes Theorem, and Base Rates
Click to learn more about author Steve Miller. My wife gave me a stern warning before we headed out to a suburban neighbor’s Super Bowl party early this year: avoid “spirited” political discussion or else. Actually, I’d already self-forewarned, the memory of being in the center of a blue vs red imbroglio several years ago […]
JupyterCon and Data Science Analysis 2017
Click to learn more about author Steve Miller. The inaugural JupyterCon is now in the books. A larger-than-expected turnout of 700 data scientists, business analysts, researchers, educators, developers, core Project contributors, and tool creators descended on NYC August 22-25 for in-depth training, insightful keynotes, networking events, and practical talks exploring the Project Jupyter platform. Jupyter […]
Pragmatic Polyglot Data Analysis
Click to learn more about author Steve Miller. Yesterday was a pretty fast-paced day for me in New York. In the morning I took a walk from my midtown hotel to the Koch Queensboro Bridge (Simon and Garfunkel fans will know it as the 59th St Bridge) where I ducked speedy bicyclists crossing over and […]
Exploratory Analytics? Predictive Analytics? Or Both?
Click to learn more about author Steve Miller. A few weeks ago, I participated in a conference call with an Inquidia customer to discuss their new initiative in predictive analytics. We’ve already been helping them build a web-based analytic app for about 9 months. The partnership has been quite successful, and with analytics, once the […]
Data Science Birds of a Feather
Click to learn more about author Steve Miller. I had lunch with Diego Klabjan the other day. Diego’s a professor of Industrial Engineering and Management Sciences at Northwestern University and progenitor/director of the now five year old Master of Science in Analytics (MSIA) program at the school. MSIA was recently rated one of the top […]
Stock Market Performance: A look at Russell indexes in R
Click to learn more about author Steve Miller. I just completed the annual “maintenance” on my little stock market indexes returns “app”. I’ve supported a variant of the script for seven years, changing it pretty significantly year to year. The 2016 version was half python and half R, but this year I opted for R […]
Data Exploration in R – Part I
With the analytics work I’ve been involved with over the last 15 years, I estimate that 70% of the effort has been devoted to data access/integration/wrangling/curation, about 20% focused on data exploration, and the remaining 10% fitting algorithms/models. SQL and the open source platforms R and Python have been primary computation platforms, and now provide […]
Forecasting for prophet in R
Click to learn more about author Steve Miller. I ran across an R forecasting package recently, prophet, I hadn’t seen before. This isn’t surprising given the flood of new libraries now emerging in the R ecosystem. Developed by two Facebook Data Scientists, what struck me most about prophet was the alignment of its sweet spot […]
Homicide and Violent Crime in Chicago – a First Look at the Data with R
Click to learn more about author Steve Miller. A recent article in Atlantic highlights what had been emerging locally for over a year: Chicago suffered a disturbingly sharp spike in homicides in 2016, after a smaller but still noticeable surge in 2015. This at a time when other large cities like New York and Los Angeles […]