8 Tutorial: Data Collection with bardeen.ai

Bardeen is a powerful tool that allows you to create and run automations on various web services. You can scrape data with R, but teaching you would take about three-four full sessions. Therefore, I’ll show you an easy alternative way to automate the collection of data from social media networks like Twitter. By creating an automation with the right actions and configurations, you can collect the data you need with Bardeen without manual effort and any programming knowledge. However, Bardeen will cost money if you need many Playbooks, so learning how to scrape data with R is a good idea in the long run. If you want to learn Web Scraping by yourself, I recommend you this chapter from a book by Hadley Wickham.

In this short tutorial, we will walk through the steps to collect data from social media networks, specifically Twitter, using Bardeen.

8.1 Sign up

Before you start, you need to have an account on Bardeen. Go to Bardeen’s website and sign up or log in if you already have an account.

8.2 Choose a Playbook

Once you are logged in, you will be taken to the dashboard:

This is how your dashboard will look like:

You can search for a fitting automation in the What do you want to do? search bar. For this tutorial, we’ll search for “copy tweets”.

Searching Playbooks in Bardeen:

You’ll see automations (so called Playbooks) that collect tweets for keywords or user profiles. We’ll choose user profiles for this tutorial. Click on the playbook and it will be added to your dashboard.

8.3 Run the Playbook

From your dashboard, you can now run your new playbook by filling out the required fields (see pictures). At the end of the form, you can then run your automation by clicking on the Run button. Download the resulting .csv file and enjoy your data. :)

Run your Playbook - Part 1:

Run your Playbook - Part 2: