Data Science in Real Life

Have you ever had the perfect data science experience? The data pull went perfectly. There were no merging errors or missing data. Hypotheses were clearly defined prior to analyses. Randomization was performed for the treatment of interest. The analytic plan was outlined prior to analysis and followed exactly. The conclusions were clear and actionable decisions were obvious. Has that every happened to you? Of course not. Data analysis in real life is messy. How does one manage a team facing real data analyses? In this one-week course, we contrast the ideal with what happens in real life. By contrasting the ideal, you will learn key concepts that will help you manage real life analyses.

This is a focused course designed to rapidly get you up to speed on doing data science in real life. Our goal was to make this as convenient as possible for you without sacrificing any essential content. We've left the technical information aside so that you can focus on managing your team and moving it forward.

After completing this course you will know how to:

• Describe the “perfect” data science experience
• Identify strengths and weaknesses in experimental designs
• Describe possible pitfalls when pulling / assembling data and learn solutions for managing data pulls.
• Challenge statistical modeling assumptions and drive feedback to data analysts
• Describe common pitfalls in communicating data analyses
• Get a glimpse into a day in the life of a data analysis manager.

The course will be taught at a conceptual level for active managers of data scientists and statisticians. Some key concepts being discussed include:

• Experimental design, randomization, A/B testing
• Causal inference, counterfactuals,
• Strategies for managing data quality.
• Bias and confounding
• Contrasting machine learning versus classical statistical inference