Your Best Next Business Solution
Big Data In R
24/3/2010
Big Data In R
R Works on RAM
Causing Scalability issues
Maximum length of an object is 2^31-1
Some packages developed to help overcome this
problem
Source: http://cran.r-project.org/web/packages/RODBC/RODBC.pdf
Big Data In R
RODBC Package
biglm Package
ff Package
bigmemory package
snow package
Source: http://cran.r-project.org/web/packages/RODBC/RODBC.pdf
RODBC Package
Connecting to external DB from R to retrieve and handle data stored
in the DB
RODBC package support connection to SQL-based database (DBMS)
such as: Oracle, SQL Server, SQLite, MySQL and more
Require an ODBC driver which usually comes with the DBMS
Windows offer an ODBC driver to flat files and Excel
Supports client-server architecture
Source: http://cran.r-project.org/web/packages/RODBC/RODBC.pdf
RODBC Package
# Defining DSN:
> odbcDriverConnect()