Some thoughts about the use of cloud services and web APIs in social science research
In the recent weeks I’ve collaborated on the online book APIs for social scientists and added two chapters: a chapter … Read More →continue reading.
Author: Markus Konrad
Continuous Integration testing with GitHub Actions using tox and hypothesis
I recently published a major update for the Python tmtoolkit package for text mining and topic modeling. Since it is … Read More →continue reading.
Batch transfer GitLab projects with the GitLab API
This is a bit off-topic to be filed under DevOps / workflow automation but I still wanted to share it: … Read More →continue reading.
Spatially weighted averages in R with sf
Spatial joins allow to augment one spatial dataset with information from another spatial dataset by linking overlapping features. In this … Read More →continue reading.
Clustered standard errors with R
In many scenarios, data are structured in groups or clusters, e.g. pupils within classes (within schools), survey respondents within countries … Read More →continue reading.
Interactive visualization of geospatial data with R Shiny
As a supplement to a recently published study by Marcel Helbig and Katja Salomo (available only in German) about socioeconomic … Read More →continue reading.
Simplifying geospatial features in R with sf and rmapshaper
When working with geospatial data, memory consumption and computation time can become quite a problem, since these datasets are often … Read More →continue reading.
Robust web scraping or web API based data collection
There are thousands of articles on the web about web scraping and accessing web APIs. Most of them show you … Read More →continue reading.
Spiegel Online news topics and COVID-19 – a topic modeling approach
I created a project to showcase topic modeling with the tmtoolkit Python package: I use a corpus of articles from the … Read More →continue reading.
Using Google Places data to analyze changes in mobility during the COVID-19 pandemic
During the COVID-19 pandemic, it’s apparent that location data gathered by private IT companies and telcos is a primary source … Read More →continue reading.
Developing a complex R Shiny app – the good, the bad and the ugly
Together with Clara Bicalho (UC Berkeley) and Sisi Huang (WZB), I recently developed a web application that acts as a … Read More →continue reading.
Property based testing for scientific code in Python
Automated software testing starts with the often annoying and time-consuming process of writing tests. But no matter how annoying it … Read More →continue reading.
A Twitter network of members of the 19th German Bundestag – part II
This is the second part about my project that deals with the Twitter network of members of the Bundestag. After … Read More →continue reading.
A Twitter network of members of the 19th German Bundestag – part I
For the R tutorial that I gave at the WZB in the previous semester, I gave an introduction on how … Read More →continue reading.
Zooming in on maps with sf and ggplot2
When working with geo-spatial data in R, I usually use the sf package for manipulating spatial data as Simple Features … Read More →continue reading.
Lab report: Development of school sites in eastern Germany
I wanted to share a small lab report on a project about the development of school sites in eastern Germany … Read More →continue reading.
Checkboxes and crosses: data mining PDFs with the help of image processing
From time to time, I work with “open data” published by public authorities. Often, these data do not deserve the … Read More →continue reading.
Tools and packages for geospatial processing with Python
In the social sciences, geospatial data appears quite often. You may have social indicators for different places on earth at … Read More →continue reading.
Three ways of visualizing a graph on a map
When visualizing a network with nodes that refer to a geographic place, it is often useful to put these nodes … Read More →continue reading.
Slides on practical Topic Modeling: Preparation, evaluation, visualization
I gave a presentation on Topic Modeling from a practical perspective*, using data about the proceedings of plenary sessions of … Read More →continue reading.
