Loading Data Files in R
R can load the following data files formats:
- Compressed CSV (
.csv.gz) - Parquet (
.parquet)
Download and save the data files to a suitable location. In the examples that follow, the data has been saved to
C:\data. Although you could load data files directly from the data file URLs, this is not recommended because you may quickly hit usage limits or incur additional costs. We always recommend saving the files locally or to cloud storage first using the Open Data Blend Dataset UI, Open Data Blend Dataset API, or Open Data Blend for Python.
You can use the below steps as a guide on how you can load compressed (Gzip) data files in R.
Reading the entire compressed (Gzip) CSV data file directly into a data frame.
df_date <- read.csv("C:\\data\\date\\date.csv.gz")
You can use the below steps as a guide on how you can load Parquet data files in R.
Install the
arrow package.install.packages("arrow")
Import the
arrow library.library(arrow)
Read the Parquet data file into a data frame.
df_date <- read_parquet("C:\\data\\date\\date.parquet")
df_anonymised_mot_test_result_info <- read_parquet("C:\\data\\anonymised_mot_test_result_info\\anonymised_mot_test_result_info.parquet")
Read a subset of the columns from the Parquet data file into a data frame.
df_mot_results_2017 <- read_parquet("C:\\data\\anonymised_mot_test_result\\anonymised_mot_test_result_2017.parquet", col_select = c("drv_anonymised_mot_test_date_key", "drv_anonymised_mot_test_result_info_key"))
When working with larger data files, it is a good practice to only read the required columns because it will reduce the read times, memory footprint, and processing times.
Guidance on how to analyse data in R is beyond the scope of this documentation.
You may find the following helpful: