Open Data Blend Docs
Search…
Open Data Blend Datasets
Open Data Blend Analytics
Subscription Management
Loading Data Files in R
Supported Formats
R can load the following data files formats:
- Compressed CSV (
.csv.gz) - Parquet (
.parquet)
​
Download the Data Files
Download and save the data files to a suitable location. In the examples that follow, the data has been saved to
C:\data. Although you could load data files directly from the data file URLs, this is not recommended because you may quickly hit usage limits or incur additional costs. We always recommend saving data files locally first using the Open Data Blend Dataset UI or the Open Data Blend Dataset API.
​
Loading Compressed (Gzip) CSV Data Files
You can use the below steps as a guide on how you can load compressed (Gzip) data files in R.
Reading the entire compressed (Gzip) CSV data file directly into a data frame.
1
df_date <- read.csv("C:\\data\\date\\date.csv.gz")
Copied!
​
Loading Parquet Data Files
You can use the below steps as a guide on how you can load Parquet data files in R.
Install the
arrow package.1
install.packages("arrow")
Copied!
​
Import the
arrow library.1
library(arrow)
Copied!
​
Read the Parquet data file into a data frame.
1
df_date <- read_parquet("C:\\data\\date\\date.parquet")
2
df_anonymised_mot_test_result_info <- read_parquet("C:\\data\\anonymised_mot_test_result_info\\anonymised_mot_test_result_info.parquet")
Copied!
​
Read a subset of the columns from the Parquet data file into a data frame.
1
df_mot_results_2017 <- read_parquet("C:\\data\\anonymised_mot_test_result\\anonymised_mot_test_result_2017.parquet", col_select = c("drv_anonymised_mot_test_date_key", "drv_anonymised_mot_test_result_info_key"))
Copied!
When working with larger data files, it is a good practice to only read the required columns because it will reduce the read times, memory footprint, and processing times.
​
Using R for Data Analysis
Guidance on how to analyse data in R is beyond the scope of this documentation.
You may find the following helpful:
Open Data Blend Datasets - Previous
Loading Data Files in Python
Next - Open Data Blend Datasets
Loading Data Files in Other Tools
Last modified 8mo ago