Learning Session – Data Workflow Tools + Tricks

Learn from experienced transportation data scientists about how they approach data workflows. Three experts in the field will share how their workflows help them extract knowledge from data and model output, the tools they rely on, and lessons they’ve learned from working with data.

The craft of data analysis: A travel survey example* - Presentation
Suzanne Childress (she/her) – Data Scientist, Puget Sound Regional Council

Links from presentation:

• Development Blog psrc.github.io/
• Git Repositories github.com/psrc/
• Travel Survey Program www.psrc.org/household-travel-survey-program
• Travel Survey Data Explorer dataexplorer.psrc.org/household-travel-survey/
• Travel Study Stories https://github.com/psrc/travel-study-stories
• Travel Survey Aanalysis Code https://github.com/psrc/travel_survey_analysis - Example Data Cleaning Script

Mentioned in chat:

• R-Shiny https://shiny.rstudio.com/

Building a Digital Twin for Traffic at Regional Scale - Presentation
Anne Berres (they/them) – Research Scientist, Computational Urban Science Group at Oak Ridge National Laboratory

Links from presentation:

• Learning Git Resource - gitimmersion.com
• Fixing Git Resource - ohshitgit.com
• Markdown (rather than JSON) -based Jupyter Notebooks - github.com/mwouts/jupytext

Mentioned in chat:

• JuPyteR Notbooks https://jupyter.org/ for Julia, Python and R
• Git Branching
• Issue Tracking and Kanban boards in GitLab and GitHub
• Pandas data analysis package for Python - https://pandas.pydata.org/
• Sunburst Diagrams in D3 and Highcharts
• Mermaid Charts defined in Markdown

Getting from Model Output to Understanding the Results - Presentation
Billy Charlton (he/him) – Technical University of Berlin

Links from presentation:

• Matsim Code github.com/matsim-vsp
• Aftersim Project aftersim.github.io
• Aftersim Code github.com/aftersim
• Covidsim Project covid-sim.info

Mentioned in chat:

• Github Flavored Markdown
• MatSim-Episim
• Matsim Tutorials

General Discussion Links

• Database Version Control https://mybatis.org/mybatis-3/
• reveal.js
• Git convensions for tracking geospatial data http://geogig.org/
• Out of the box plots with
  • Seaborn
  • Vega
  • ggplot

Organized by Leah Flake, RSG Inc