Open Data Blend Docs
Search…
Open Data Blend Datasets
Open Data Blend Analytics
Open Data Blend Insights
Subscription Management
Loading Data Files in R
Supported Formats
R can load the following data files formats:
- Compressed CSV (
.csv.gz) - Parquet (
.parquet)
​
Download the Data Files
Download and save the data files to a suitable location. In the examples that follow, the data has been saved to
C:\data. Although you could load data files directly from the data file URLs, this is not recommended because you may quickly hit usage limits or incur additional costs. We always recommend saving the files locally or to cloud storage first using the Open Data Blend Dataset UI, Open Data Blend Dataset API, or Open Data Blend for Python.
​
Loading Compressed (Gzip) CSV Data Files
You can use the below steps as a guide on how you can load compressed (Gzip) data files in R.
Reading the entire compressed (Gzip) CSV data file directly into a data frame.
1
df_date <- read.csv("C:\\data\\date\\date.csv.gz")
Copied!
​
Loading Parquet Data Files
You can use the below steps as a guide on how you can load Parquet data files in R.
Install the
arrow package.1
install.packages("arrow")
Copied!
​
Import the
arrow library.1
library(arrow)
Copied!
​
Read the Parquet data file into a data frame.
1
df_date <- read_parquet("C:\\data\\date\\date.parquet")
2
df_anonymised_mot_test_result_info <- read_parquet("C:\\data\\anonymised_mot_test_result_info\\anonymised_mot_test_result_info.parquet")
Copied!
​
Read a subset of the columns from the Parquet data file into a data frame.
1
df_mot_results_2017 <- read_parquet("C:\\data\\anonymised_mot_test_result\\anonymised_mot_test_result_2017.parquet", col_select = c("drv_anonymised_mot_test_date_key", "drv_anonymised_mot_test_result_info_key"))
Copied!
When working with larger data files, it is a good practice to only read the required columns because it will reduce the read times, memory footprint, and processing times.
​
Using R for Data Analysis
Guidance on how to analyse data in R is beyond the scope of this documentation.
You may find the following helpful: