All prerequisites, links to material and slides for this course can be found on github.
Or can be downloaded as a zip archive from here.
Once the zip file in unarchived. All presentations as HTML slides and pages, their R code and HTML practical sheets will be available in the directories underneath.
R is a scripting language and environment for statistical computing.
Developed by Robert Gentleman and Ross Ihaka.
Inheriting much from S (Bell labs).
R comes with excellent “out-of-the-box” statistical and plotting capabilities.
R provides access to 1000s of packages (CRAN/MRAN/R-forge) which extend the basic functionality of R while maintaining high quality documentation.
In particular, Robert Gentleman developed the Bioconductor project where 100’s of packages are directly related to computational biology and analysis of associated high-throughput experiments.
R package downloads from Bioconductor
Freely available from R-project website.
RStudio provides an integrated development environment (IDE) which is freely available from RStudio site
We will be using RStudio and R already installed on your machines.
Four main panels - Scripting panel - R interface - Environment and history - Files, directories and help
Let’s load RStudio and take a look
At its most basic, R can be used as a simple calculator.
## [1] 4
## [1] 4
## [1] 4
The sqrt(25) demonstrates the use of functions in R. A function performs a complex operation on it’s arguments and returns the result.
In R, arguments are provided to a function within the parenthesis – ( ) – that follows the function name. So sqrt(ARGUMENT) will provide the square root of the value of ARGUMENT.
Other examples of functions include min(), sum(), max().
Note multiple arguments are separated by a comma.
## [1] 2
## [1] 12
## [1] 6
R has many useful functions “built in” and ready to use as soon as R is loaded.
An incomplete, illustrative list can be seen here
In addition to R standard functions, additional functionality can be loaded into R using libraries. These include specialised tools for areas such as sequence alignment, read counting etc.
If you need to see how a function works try ? in front of the function name.
Lets run ?sqrt in RStudio and look at the help.
Arguments have names and order
With functions such as min() and sqrt(), the arguments to be provided are obvious and the order of these arguments doesnt matter.
## [1] 4
## [1] 4
Many functions however have an order to their arguments. Try and look at the arguments for the dir() function using ?dir.
?dir
Setting names for arguments
Often we know the names of arguments but not necessarily their order. In cases where we want to be sure we specify the right argument, we provide names for the arguments used.
This also means we don’t have to copy out all the defaults for arguments preceeding it.
As with other programming languages and even graphical calculators, R makes use of variables.
A variable stores a value as a letter or word.
In R, we make use of the assignment operator <-
Now x holds the value of 10
## [1] 10
In R the most basic variable or data type is a vector. A vector is an ordered collection of values. The x and y variables we have previously assigned are examples of a vector of length 1.
## [1] 20
## [1] 1
To create a multiple value vector we use the function c() to combine the supplied arguments into one vector.
## [1] 1 2 3 4 5 6 7 8 9 10
## [1] 10
Vectors of continuous stretches of values can be created using a colon (:) as a shortcut.
## [1] 6 7 8 9 10
Other useful function to create stretchs of numeric vectors are seq() and rep(). The seq() function creates a sequence of numeric values from a specified start and end value, incrementing by a user defined amount. The rep() function repeats a variable a user-defined number of times.
## [1] 1 3 5
## [1] 1 5 10 1 5 10 1 5 10
Square brackets [] identify the position within a vector (the index). These indices can be used to extract relevant values from vectors.
## [1] 2 4 6 8 10 12 14 16 18 20
## [1] 2
## [1] 16
Indices can be used to extract values from multiple positions within a vector.
## [1] 2 12
Negative indices can be used to extract all positions except that specified.
## [1] 2 4 6 8 12 14 16 18 20
We can use indices to modify a specific position in a vector.
## [1] 2 4 6 8 10 12 14 16 18 20
## [1] 2 4 6 8 1000 12 14 16 18 20
Indices can be specified using other vectors.
## [1] 6 7 8 9 10
## [1] 2 4 6 8 1000 0 0 0 0 0
Square brackets [] for indexing.
## [1] 1
Parentheses () for function argments.
## [1] 2
Vectors in R can be used in arithmetic operations as seen with variables earlier. When a standard arithmetic operation is applied to vector, the operation is applied to each position in a vector.
## [1] 1 2 3 4 5 6 7 8 9 10
## [1] 2 4 6 8 10 12 14 16 18 20
Multiple vectors can be used within arithmetic operations.
## [1] 3 6 9 12 15 18 21 24 27 30
When applying an arithmetic operation between two vectors of unequal length, the shorter will be recycled.
## [1] 1 2 3 4 5 6 7 8 9 10
## [1] 2 4 4 6 6 8 8 10 10 12
## Warning in x + c(1, 2, 3): longer object length is not a multiple of shorter
## object length
## [1] 2 4 6 5 7 9 8 10 12 11
When R gives you an unexpected response DON’T PANIC.
You will run into errors coding.
Most of the time the messages are very clear. And if they are not, a quick google will often clear it up:
Warning in x + c(1, 2, 3) :
longer object length is not a multiple of shorter object length
There are several kinds of messages.
Message - Just a text message - This can denote progress or options used.
Warning - Just a text message starting with “Warning” - Often denotes if you have done something atypical. You should review the message unless you did it on purpose.
Error - The code will stop and a text message starting with “Error” - Something broke the code. Review the message.
So far we have only looked at numeric vectors or variables.
In R we can also create character vectors again using c() function. These vectors can be indexed just the same.
## [1] "CommonWealth"
Character vectors can be used to assign names to other vectors.
## ICTEM CommonWealth Wolfson
## 1 2 3
These named vectors maybe indexed by a position’s “name”.
## ICTEM Wolfson
## 1 3
Index names missing from vectors will return special value “NA”.
## <NA>
## NA
In R, like many languages, when a value in a variable is missing, the value is assigned a NA value.
Similarly, when a calculation can not be perfomed, R will input a NaN value.
NA values allow for R to handle missing data correctly as they require different handling than standard numeric or character values. We will illustrate an example handling NA values later.
The unique() function can be used to retrieve all unique values from a vector.
## [1] "Gene1" "Gene2" "Gene3" "Gene4" "Gene5"
Logical vectors are a class of vector made up of TRUE or FALSE boolean values (single letter T/F can also be used).
## [1] TRUE FALSE TRUE FALSE TRUE FALSE TRUE FALSE TRUE FALSE
Logical vectors can be used like an index to specify postions in a vector. TRUE values will return the corresponding position in the vector being indexed.
## [1] 1 3 5 7 9
A common task in R is to subset one vector by the values in another vector.
The %in% operator in the context A %in% B creates a logical vector of whether values in A matches any values in of B.
This can be then used to subset the values within one character vector by a those in a second.
geneList <- c("Gene1","Gene2","Gene3","Gene4","Gene5","Gene1","Gene3")
secondGeneList <- c("Gene5","Gene3")
logical_index <- geneList %in% secondGeneList
logical_index
## [1] FALSE FALSE TRUE FALSE TRUE FALSE TRUE
## [1] "Gene3" "Gene5" "Gene3"
Another more flexible way of making a logical vector for indexing is by using the grepl function. This uses regular expressions so you can do more advanced pattern matching.
We simply provide the pattern we are looking for and the vector we are looking in.
mixedList <- c("protein1","Gene1","Protein2","Gene3","Gene4","Protein4","Gene5","Gene1","Protein5")
logical_index <- grepl("Prot", mixedList)
logical_index
## [1] FALSE FALSE TRUE FALSE FALSE TRUE FALSE FALSE TRUE
## [1] "Protein2" "Protein4" "Protein5"
We can also control case sensitivity with the ignore.case=T.
## [1] TRUE FALSE TRUE FALSE FALSE TRUE FALSE FALSE TRUE
## [1] "protein1" "Protein2" "Protein4" "Protein5"
There is also a related grep() function which returns the numeric index in which a pattern was matched.
## [1] 3 6 9
Vectors may also be directly evaluated to produce logical vectors. This can be very useful when using a logical to index.
Common examples are:
## [1] FALSE FALSE FALSE FALSE FALSE TRUE TRUE TRUE TRUE TRUE
## [1] 6 7 8 9 10
Logical vectors can be used in combination in order to index vectors. To combine logical vectors we can use some common R operators.
## [1] TRUE TRUE TRUE TRUE FALSE FALSE FALSE FALSE FALSE FALSE
## [1] FALSE FALSE FALSE FALSE TRUE TRUE FALSE FALSE FALSE FALSE
## [1] TRUE TRUE TRUE TRUE TRUE TRUE TRUE TRUE TRUE TRUE
Such combinations can allow for complex selection of a vector’s values.
## [1] 1 2 3 4 5 6 7 8 9 10
## [1] 5 6
## [1] 7 8 9 10
Exercise on vectors can be found here
Answers can be found here here
In programs such as Excel we are used to tables.
All progamming languages have a concept of a table. In R, the most basic table type is a matrix.
A matrix can be created using the matrix() function with the arguments of nrow and ncol specifying the number of rows and columns respectively.
## [,1] [,2]
## [1,] 1 6
## [2,] 2 7
## [3,] 3 8
## [4,] 4 9
## [5,] 5 10
## [,1] [,2] [,3] [,4] [,5]
## [1,] 1 3 5 7 9
## [2,] 2 4 6 8 10
By default when creating a matrix using the matrix function, the values fill the matrix by columns. To fill a matrix by rows the byrow argument must be set to TRUE.
## [,1] [,2] [,3] [,4] [,5]
## [1,] 1 3 5 7 9
## [2,] 2 4 6 8 10
## [,1] [,2] [,3] [,4] [,5]
## [1,] 1 2 3 4 5
## [2,] 6 7 8 9 10
To find dimensions of a matrix, the dim() function will provide dimensions as the row then column number while nrow() and ncol() will return just row number and column number respectively.
## [1] 5 2
## [1] 5
## [1] 2
A matrix can be created from multiple vectors or other matrices.
cbind() can be used to attach data to a matrix as columns.
## x y
## [1,] 1 11
## [2,] 2 12
## [3,] 3 13
## [4,] 4 14
## [5,] 5 15
rbind() functions to bind to a matrix as rows.
## x y
## 1 11
## 2 12
## 3 13
## 4 14
## 5 15
## z 21 22
When creating a matrix using cbind() or matrix() from incompatible vectors then the shorter vector is recycled.
## Warning in matrix(1:5, ncol = 2, nrow = 3): data length [5] is not a
## sub-multiple or multiple of the number of rows [3]
## [,1] [,2]
## [1,] 1 4
## [2,] 2 5
## [3,] 3 1
For rbind() function, the longer vector is clipped.
## Warning in rbind(...): number of columns of result is not a multiple of vector
## length (arg 2)
## [,1] [,2]
## [1,] 1 4
## [2,] 2 5
## [3,] 3 1
## [4,] 1 2
As we have seen with vectors, matrices can be named. For matrices the naming is done by columns and rows using colnames() and rownames() functions.
namedMatrix <- matrix(1:10,ncol=5,nrow=2)
colnames(namedMatrix) <- paste("Column",1:5,sep="_")
rownames(namedMatrix) <- paste("Row",1:2,sep="_")
namedMatrix
## Column_1 Column_2 Column_3 Column_4 Column_5
## Row_1 1 3 5 7 9
## Row_2 2 4 6 8 10
Information on matrix names can also be retreived using the same functions.
## [1] "Column_1" "Column_2" "Column_3" "Column_4" "Column_5"
## [1] "Row_1" "Row_2"
Selecting and replacing portions of a matrix can be done by indexing using square brackets [] much like for vectors.
When indexing matrices, two values may be provided within the square brackets separated by a comma to retrieve information on a matrix position.
The first value(s) corresponds to row(s) and the second to column(s).
## [,1] [,2]
## [1,] 1 6
## [2,] 2 7
## [3,] 3 8
## [4,] 4 9
## [5,] 5 10
Value of first column, second row
## [1] 2
Similarly, whole rows or columns can be extracted. Single rows and columns will return a vector.
Values of second column (row index is empty!)
## [1] 6 7 8 9 10
Values of third row (column index is empty!)
## [1] 3 8
When multiple columns or row indices are specified, a matrix is returned.
Values of second and third row (column index is empty!)
## [,1] [,2]
## [1,] 2 7
## [2,] 3 8
As with vectors, names can be used for indexing when present
colnames(narrowMatrix) <- paste("Column",1:2,sep="_")
rownames(narrowMatrix) <- paste("Row",1:5,sep="_")
narrowMatrix[,"Column_1"]
## Row_1 Row_2 Row_3 Row_4 Row_5
## 1 2 3 4 5
## Column_1 Column_2
## 1 6
## [1] 1
As with vectors, matrices can be subset by logical vectors
## Column_1 Column_2
## Row_1 1 6
## Row_2 2 7
## Row_3 3 8
## Row_4 4 9
## Row_5 5 10
## Row_1 Row_2 Row_3 Row_4 Row_5
## 1 2 3 4 5
## Row_1 Row_2 Row_3 Row_4 Row_5
## TRUE TRUE TRUE TRUE FALSE
## Column_1 Column_2
## Row_1 1 6
## Row_2 2 7
## Row_3 3 8
## Row_4 4 9
As with vectors, matrices can have arithmetic operations applied to cells, rows, columns or the whole matrix
## Column_1 Column_2
## Row_1 1 6
## Row_2 2 7
## Row_3 3 8
## Row_4 4 9
## Row_5 5 10
## [1] 3
## Column_1 Column_2
## 3 8
As with vectors, matrices can have their elements replaced
## Column_1 Column_2
## Row_1 1 6
## Row_2 2 7
## Row_3 3 8
## Row_4 4 9
## Row_5 5 10
## Column_1 Column_2
## Row_1 10 1
## Row_2 2 1
## Row_3 3 1
## Row_4 4 1
## Row_5 5 1
Matrices must be all one type (i.e. numeric or character).
Here replacing one value with character will turn numeric matrix to character matrix.
## Row_1 Row_2 Row_3 Row_4 Row_5
## 2 2 2 2 2
## Column_1 Column_2
## Row_1 "Not_A_Number" "1"
## Row_2 "2" "1"
## Row_3 "3" "1"
## Row_4 "4" "1"
## Row_5 "5" "1"
## Error in narrowMatrix[, 2] * 2: non-numeric argument to binary operator
Exercise on matrices can be found here
Answers can be found here here
A special case of a vector is a factor.
Factors are used to store data which may be grouped in categories (categorical data). Specifying data as categorical allows R to properly handle the data and make use of functions specific to categorical data.
To create a factor from a vector we use the factor() function. Note that the factor now has an additional component called “levels” which identifies all categories within the vector.
vectorExample <- c("male","female","female","female")
factorExample <- factor(vectorExample)
factorExample
## [1] male female female female
## Levels: female male
## [1] "female" "male"
An example of the use of levels can be seen from applying the summary() function to the vector and factor examples
## Length Class Mode
## 4 character character
## female male
## 3 1
In our factor example, the levels have been displayed in an alphabetical order. To adjust the display order of levels in a factor, we can supply the desired display order to levels argument in the factor() function call.
## [1] male female female female
## Levels: male female
## male female
## 1 3
In some cases there is no natural order to the categories such that one category is greater than the other (nominal data).
factorExample <- factor(vectorExample, levels=c("male","female"))
factorExample[1] < factorExample[2]
## Warning in Ops.factor(factorExample[1], factorExample[2]): '<' not meaningful
## for factors
## [1] NA
In other cases there will be a natural ordering to the categories (ordinal data). A factor can be specified to be ordered using the ordered argument in combination with specified levels argument.
factorExample <- factor(c("small","big","big","small"),
ordered=TRUE,levels=c("small","big"))
factorExample
## [1] small big big small
## Levels: small < big
## [1] TRUE
Unlike vectors, replacing elements within a factor isn’t so easy. While replacing one element with an established level is possible, replacing with a novel element will result in a warning.
## [1] big big big small
## Levels: big small
## Warning in `[<-.factor`(`*tmp*`, 1, value = "huge"): invalid factor level, NA
## generated
## [1] <NA> big big small
## Levels: big small
We saw that with matrices you can only have one type of data. We tried to create a matrix with a character element and the entire matrix became a character.
In practice, we would want to have a table which is a mixture of types (e.g a table with sample names (character), sample type (factor) and survival time (numeric))
In R, we make use of the data frame object which allows us to store tables with columns of different data types. To create a data frame we can simply use the data.frame() function.
patientName <- c("patient1","patient2","patient3","patient4")
patientType <- factor(rep(c("male","female"),2))
survivalTime <- c(1,30,2,20)
dfExample <- data.frame(Name=patientName, Type=patientType, Survival_Time=survivalTime)
dfExample
## Name Type Survival_Time
## 1 patient1 male 1
## 2 patient2 female 30
## 3 patient3 male 2
## 4 patient4 female 20
Data frames may be indexed just as matrices.
## Name Type Survival_Time
## 1 patient1 male 1
## 2 patient2 female 30
## 3 patient3 male 2
## 4 patient4 female 20
## Name Type Survival_Time
## 2 patient2 female 30
## 4 patient4 female 20
Unlike matrices, it is possible to index a column by using the $ symbol.
dfExample <- data.frame(Name=patientName,Type=patientType,Survival_Time=survivalTime)
dfExample$Survival_Time
## [1] 1 30 2 20
## Name Type Survival_Time
## 1 patient1 male 1
## 3 patient3 male 2
Using the $ allows for R to autocomplete your selection and so can speed up coding.
## [1] 1 30 2 20
But this will not work..
The $ operator also allows for the creation of new columns for a data frame on the fly.
## Name Type Survival_Time
## 1 patient1 male 1
## 2 patient2 female 30
## 3 patient3 male 2
## 4 patient4 female 20
## Name Type Survival_Time newColumn
## 1 patient1 male 1 newData
## 2 patient2 female 30 newData
## 3 patient3 male 2 newData
## 4 patient4 female 20 newData
Replacement can occur in the same way we have seen for less complex data types: use the assignment operator <-
## Name Type Survival_Time newColumn
## 1 patient1 male 0 newData
## 2 patient2 female 30 newData
## 3 patient3 male 0 newData
## 4 patient4 female 20 newData
When we work with factors, for a replacement to be succesful it has to be a possible level.
## Warning in `[<-.factor`(`*tmp*`, iseq, value = "other"): invalid factor level,
## NA generated
## Name Type Survival_Time newColumn
## 1 patient1 <NA> 0 newData
## 2 patient2 female 30 newData
## 3 patient3 male 0 newData
## 4 patient4 female 20 newData
It is possible to update factors in data frames just as with standard factors.
dfExample <- data.frame(Name=patientName,Type=patientType,
Survival_Time=survivalTime)
levels(dfExample[,"Type"]) <- c(levels(dfExample[,"Type"]) ,
"other")
dfExample[1,"Type"] <- "other"
dfExample
## Name Type Survival_Time
## 1 patient1 other 1
## 2 patient2 female 30
## 3 patient3 male 2
## 4 patient4 female 20
If you are running an older version of R (anything from before 4.0), then by default all columns with characters will be considered to be factors.
This is controlled when you make the data frame, by the stringsAsFactors argument. Up until recently the default parameter for this was TRUE. It now defaults to FALSE
dfExample <- data.frame(Name=patientName,
Type=patientType,
Survival_Time=survivalTime,
stringsAsFactors = T)
dfExample[dfExample[,"Survival_Time"] < 10,"Name"] <- "patientX"
## Warning in `[<-.factor`(`*tmp*`, iseq, value = c("patientX", "patientX")):
## invalid factor level, NA generated
## Name Type Survival_Time
## 1 <NA> male 1
## 2 patient2 female 30
## 3 <NA> male 2
## 4 patient4 female 20
dfExample <- data.frame(Name=patientName,
Type=patientType,
Survival_Time=survivalTime,
stringsAsFactors = F)
dfExample[dfExample[,"Survival_Time"] < 10,"Name"] <- "patientX"
dfExample
## Name Type Survival_Time
## 1 patientX male 1
## 2 patient2 female 30
## 3 patientX male 2
## 4 patient4 female 20
A useful function in R is order()
For numeric vectors, order() by default returns the indices of a vector in that vector’s increasing order. This behavior can be altered by using the “decreasing” argument passed to order.
## [1] 20 100 45 31
## [1] 1 4 3 2
## [1] 2 3 4 1
Once you have a vector of ordered indices, you can then use this to index your object.
## [1] 20 31 45 100
## [1] 100 45 31 20
When a vector contains NA values, these NA values will, by default, be placed last in ordering indices. This can be controlled by na.last argument.
## [1] 3 2 1 NA
## [1] NA 3 2 1
Since the order argument returns an index of intended order for a vector, we can use the order() function to order data frames by certain columns.
## Name Type Survival_Time
## 1 patientX male 1
## 2 patient2 female 30
## 3 patientX male 2
## 4 patient4 female 20
## Name Type Survival_Time
## 2 patient2 female 30
## 4 patient4 female 20
## 3 patientX male 2
## 1 patientX male 1
We can also use order to arrange multiple columns in a data frame by providing multiple vectors to order() function. Ordering will be performed in order of arguments.
## Name Type Survival_Time
## 3 patientX male 2
## 1 patientX male 1
## 2 patient2 female 30
## 4 patient4 female 20
A common operation is to join two data frames by a column of common values.
## Name Type Survival_Time
## 1 patient1 male 1
## 2 patient2 female 30
## 3 patient3 male 2
## 4 patient4 female 20
## Name height
## 1 patient1 6.1
## 2 patient2 5.1
## 3 patient3 5.5
To do this we can use the merge() function with the data frames as the first two arguments. We can then specify the columns to merge by with the by argument. To keep only data pertaining to values common to both data frames the all argument is set to FALSE.
## Name Type Survival_Time height
## 1 patient1 male 1 6.1
## 2 patient2 female 30 5.1
## 3 patient3 male 2 5.5
Exercise on data frames can be found here
Answers can be found here here
Lists are the final data type we will look at.
In R, lists provide a general container which may hold any data types of unequal lengths as part of its elements.
To create a list we can simply use the list() function with arguments specifying the data we wish to include in the list.
## [[1]]
## [1] 1 2 3 4
##
## [[2]]
## [,1] [,2] [,3] [,4] [,5]
## [1,] 1 3 5 7 9
## [2,] 2 4 6 8 10
##
## [[3]]
## colOne colTwo
## 1 1 One
## 2 2 Two
## 3 4 Three
## 4 5 Four
Just as with vectors, list elements can be assigned names.
## $First
## [1] 1 2 3 4
##
## $Second
## [,1] [,2] [,3] [,4] [,5]
## [1,] 1 3 5 7 9
## [2,] 2 4 6 8 10
##
## $Third
## colOne colTwo
## 1 1 One
## 2 2 Two
## 3 4 Three
## 4 5 Four
List, as with other data types in R can be indexed. In contrast to other types, using [] on a list will subset the list to another list of selected indices. To retrieve an element from a list in R , two square brackets [[]] must be used.
## [[1]]
## [1] 1 2 3 4
## [1] 1 2 3 4
As with data.frames, the $ sign may be used to extract named elements from a list
## [1] 1 2 3 4
Again, similar to vectors, lists can be joined together in R using the c() function
myNamedList <- list(First=firstElement,Second=secondElement,
Third=thirdElement)
myNamedList <- c(myNamedList,list(fourth=c(4,4)))
myNamedList[c(1,4)]
## $First
## [1] 1 2 3 4
##
## $fourth
## [1] 4 4
Note that on last slide we are joining two lists. If we joined a vector to a list, all elements of the vector would become list elements.
## [[1]]
## colOne colTwo
## 1 1 One
## 2 2 Two
## 3 4 Three
## 4 5 Four
##
## [[2]]
## [1] 4
##
## [[3]]
## [1] 4
Sometimes you will wish to “flatten” out a list. When a list contains compatable objects, i.e. list of all one type, the unlist() function can be used. Note the maintenance of names with their additional sufficies.
## $First
## [1] 1 2 3
##
## $Second
## [1] 2 6 7
##
## $Third
## [1] 1 4 7
## First1 First2 First3 Second1 Second2 Second3 Third1
## 1 2 3 2 6 7 1
A common step is to turn a list of standard results into matrix. This can be done in a few steps in R, using functions you are now familair with.
myNamedList <- list(First=c(1,2,3),Second=c(2,6,7),Third=c(1,4,7))
flatList <- unlist(myNamedList)
listAsMat <- matrix(flatList,
nrow=length(myNamedList),
ncol=3,
byrow=T,
dimnames=list(names(myNamedList)))
listAsMat
## [,1] [,2] [,3]
## First 1 2 3
## Second 2 6 7
## Third 1 4 7
Exercise on matrices can be found here
Answers can be found here here
We can use the class() function to tell us the class of our variable or object.
## [1] "matrix" "array"
## [1] "data.frame"
Sometime you may want to cast an object into a new class There are a group of functions to coerce your data object to a new format, as._desiredClass_().
## Column_1 Column_2 Column_3 Column_4 Column_5
## Row_1 1 3 5 7 9
## Row_2 2 4 6 8 10
## [1] "1" "2" "3" "4" "5" "6" "7" "8" "9" "10"
## [1] 1 2 3 4 5 6 7 8 9 10
## Column_1 Column_2 Column_3 Column_4 Column_5
## Row_1 1 3 5 7 9
## Row_2 2 4 6 8 10
## [[1]]
## [1] 1
##
## [[2]]
## [1] 2
##
## [[3]]
## [1] 3
##
## [[4]]
## [1] 4
##
## [[5]]
## [1] 5
##
## [[6]]
## [1] 6
##
## [[7]]
## [1] 7
##
## [[8]]
## [1] 8
##
## [[9]]
## [1] 9
##
## [[10]]
## [1] 10
All these common data classes we have covered so far are examples of R objects.
As shown we can assess the type of object using the class() function.
## [1] "data.frame"
We have also seen that functions act differently with the different data types.
## Column_1 Column_2 Column_3 Column_4 Column_5
## Min. :1.00 Min. :3.00 Min. :5.00 Min. :7.00 Min. : 9.00
## 1st Qu.:1.25 1st Qu.:3.25 1st Qu.:5.25 1st Qu.:7.25 1st Qu.: 9.25
## Median :1.50 Median :3.50 Median :5.50 Median :7.50 Median : 9.50
## Mean :1.50 Mean :3.50 Mean :5.50 Mean :7.50 Mean : 9.50
## 3rd Qu.:1.75 3rd Qu.:3.75 3rd Qu.:5.75 3rd Qu.:7.75 3rd Qu.: 9.75
## Max. :2.00 Max. :4.00 Max. :6.00 Max. :8.00 Max. :10.00
## Name Type Survival_Time
## Length:4 female:2 Min. : 1.00
## Class :character male :2 1st Qu.: 1.75
## Mode :character Median :11.00
## Mean :13.25
## 3rd Qu.:22.50
## Max. :30.00
In fact simple interactions, such as indexing, with the different data types can be very different.
## Row_1 Row_2
## 1 2
## [1] male female male female
## Levels: female male
To learn about how to work with the different data types we can use the help functions built into R
As we progress through using R in our day to day analysis we will want to take advantage of more complex objects available in either Base R or in one of the many extension packages.
By using pre-established objects we gain access to the routines and functions built for that object’s special use cases.
An example of a more complex object type is that which helps us manage Dates or Times.
## [1] "2024-12-13 16:12:02 UTC"
As you can see this object shows the local date and time in a human readable way.
The object however is not one of our standard data types but is a new data type called POSIXct
## [1] "POSIXct" "POSIXt"
We can see from the help that we can use logical operators with our POSIXct object.
## [1] TRUE
We can also use the arithmetic operations with our time objects.
## [1] "2024-12-13 16:12:02 UTC"
## [1] "2024-12-13 16:10:02 UTC"
## Time difference of 0.1036727 secs
Most objects will have a default display defined by a print method
We can control the printing method by using the format() method for date time POSIXct objects.
We can also change the timezone by specifying a tz parameter
## [1] "16 O'Clock PM Friday on December 13th"
## [1] "16 O'Clock PM Friday on December 13th"
Most of the time we can convert more complex object back to our basic object types we are more familar with.
## [1] "2024-12-13 16:12:02.436314"
## [1] 0.1036727
In future courses we will come across object which help us handle data such as from BAM files, FastQ files and single cell experiments.
How to interact with these objects will be defined in their help pages.
By using these specialized objects we will be able to focus on understanding and analyzing the data contained within the object instead of how to format and interact with such complex data.
Most of the time, you will not be generating data in R but will be importing data from external files. Before we can read in data, you need to know from which vantage point your R console is looking. This view point is the Working Directory.
You can check your working directory using the getwd() function.
## [1] "/__w/Intro_To_R_1Day/Intro_To_R_1Day/extdata"
[1] "/Users/mattpaul"
Your current working directory is typically your HOME directory. When we do work on a project we typically want to keep everything in on place i.e. input files, output files, scripts etc. It is also good to set our working directory there.
We will do this in our downloaded course material, so everyone is in the same place.
Session -> Set Working Directory -> Choose Directory
or in the console.
When you give a path to R it can either be relative or absolute.
To use our map analogy:
Relative path are like directions i.e. take a left, go straight then take a right etc. The context of where you start is essential.
Absolute paths are like an address. They give the final location in absence of any other external information.
Both have their benefits.
The command we used before was using an absolute path. Typically they start with “/” to get to the top level of your computers file structure.
Given that we started at: /Users/mattpaul, we could have also used the path below. This uses the knowledge of our start position to specify where we are going.
Now we have set our location we can start thinking about reading in data. A standard format for data is a table:
Gene_Name | Sample_1.hi | Sample_2.hi | Sample_3.hi |
---|---|---|---|
Gene_a | 5.653071 | 4.599934 | 5.294269 |
Gene_b | 3.195872 | 2.192019 | 4.235566 |
Gene_c | 4.365700 | 5.322295 | 2.816665 |
Gene_d | 5.121716 | 3.434147 | 4.011101 |
Gene_e | 8.152737 | 10.284693 | 9.379077 |
Gene_f | 9.372566 | 11.643586 | 10.756045 |
Gene_g | 10.309446 | 9.257566 | 9.049854 |
Gene_h | 9.509722 | 10.180397 | 11.370864 |
Tables from text files can be read with read.table() function. We are providing a relative path to our file as the first argument.
## Gene_Name Sample_1.hi Sample_2.hi
## 1 Gene_a 4.570237 3.230467
## 2 Gene_b 3.561733 3.632285
## 3 Gene_c 3.797274 2.874462
## 4 Gene_d 3.398242 4.415202
Here we have provided two additional arguments. - sep argument specifies how columns are separated in our text file. (“,” for .csv, “ for .tsv) - header argument specifies whether columns have headers.
read.table() allows for significant control over reading files through its many arguments. Have a look at options by using ?read.table
The row.names argument can be used to specify a column to use as row names for the resulting data frame. Here we use the first column as row names.
## Sample_1.hi Sample_2.hi Sample_3.hi
## Gene_a 4.570237 3.230467 3.351827
## Gene_b 3.561733 3.632285 3.587523
## Gene_c 3.797274 2.874462 4.016916
## Gene_d 3.398242 4.415202 4.893561
As mentioned, data which is read into R through read.table() will be of data frame class.
Similar to when we create data frames, we can control whether the data is read in as a factor or not with the stringsAsFactors argument. The default of this has also changed in R 4.0, from TRUE to FALSE.
Other very useful functions for read table include: - skip - To set number of lines to skip when reading. - comment.char - To set the start identifier for lines not to be read.
The read.table function can also read data from http.
URL <- "https://raw.githubusercontent.com/RockefellerUniversity/Intro_To_R_1Day/refs/heads/master/readThisTable.csv"
Table <- read.table(URL,sep=",",header=T)
Table[1:2,1:3]
## Gene_Name Sample_1.hi Sample_2.hi
## 1 Gene_a 4.570237 3.230467
## 2 Gene_b 3.561733 3.632285
And the clipboard (this is Windows version).
read.table() function will by default read every row and column of a file.
The scan() function allows for the selection of particular columns to be read into R and so can save memory when files are large.
x <- scan("data/readThisTable.csv",sep=",",
what = as.list(c("character",rep("numeric", 6))),skip=1)
x[1:3]
## [[1]]
## [1] "Gene_a" "Gene_b" "Gene_c" "Gene_d" "Gene_e" "Gene_f" "Gene_g" "Gene_h"
##
## [[2]]
## [1] "4.57023720364456" "3.56173302139372" "3.79727358461183" "3.39824234540912"
## [5] "10.1287867100999" "8.4743967992122" "10.0100200884644" "9.39999241674877"
##
## [[3]]
## [1] "3.23046698308814" "3.63228532632679" "2.87446166873403" "4.41520211046494"
## [5] "10.2240711640563" "8.61262799641256" "10.3123540206195" "10.3328437472096"
Once we have our data analysed in R, we will want to export it to a file.
The most common method is to use the write.table() function
Since our data has column names but no row names, I will provide the arguments col.names and row.names to write.table()
It is always important to know what your data is. Especially when you are reading it in for the first time. We have used indexing to get a taste of the data frames so far. But there are two functions to quickly check your data. head() and tail() return the first or last 6 lines by default.
## Gene_Name Sample_1.hi Sample_2.hi Sample_3.hi Sample_4.low Sample_5.low
## 1 Gene_a 4.570237 3.230467 3.351827 3.930877 4.098247
## 2 Gene_b 3.561733 3.632285 3.587523 4.185287 1.380976
## 3 Gene_c 3.797274 2.874462 4.016916 4.175772 1.988263
## 4 Gene_d 3.398242 4.415202 4.893561 8.432342 9.609151
## 5 Gene_e 10.128787 10.224071 8.945813 2.936174 3.892924
## 6 Gene_f 8.474397 8.612628 7.170830 3.299351 2.575870
## Sample_1.low
## 1 4.4187260
## 2 5.9369901
## 3 3.7809172
## 4 9.0198647
## 5 0.9192079
## 6 2.5427773
## Gene_Name Sample_1.hi Sample_2.hi Sample_3.hi Sample_4.low Sample_5.low
## 3 Gene_c 3.797274 2.874462 4.016916 4.175772 1.988263
## 4 Gene_d 3.398242 4.415202 4.893561 8.432342 9.609151
## 5 Gene_e 10.128787 10.224071 8.945813 2.936174 3.892924
## 6 Gene_f 8.474397 8.612628 7.170830 3.299351 2.575870
## 7 Gene_g 10.010020 10.312354 11.603290 9.930704 7.748795
## 8 Gene_h 9.399992 10.332844 9.378217 10.065200 10.788619
## Sample_1.low
## 3 3.7809172
## 4 9.0198647
## 5 0.9192079
## 6 2.5427773
## 7 9.7988238
## 8 10.2453258
## Gene_Name Sample_1.hi Sample_2.hi Sample_3.hi Sample_4.low Sample_5.low
## 1 Gene_a 4.570237 3.230467 3.351827 3.930877 4.098247
## 2 Gene_b 3.561733 3.632285 3.587523 4.185287 1.380976
## 3 Gene_c 3.797274 2.874462 4.016916 4.175772 1.988263
## Sample_1.low
## 1 4.418726
## 2 5.936990
## 3 3.780917
We may want to import from formats other than plain text.
We can make use of an R package (the rio package) which allows us to import and export data to mulitple formats.
Formats include:
To make use of the rio package functionality we will need to install this package to our version of R.
We can do this by using the install.packages() function with the package we wish to install.
install.packages(PACKAGENAME)
Once we have installed a package, we will need to load it to make the functions available to us.
We can load a library by using the library() function with package we wish to install
library(PACKAGENAME)
The main two functions in the rio package are the import and export functions.
We can use the import() function to read in our csv file. We simple specify our file as an argument to the import() function.
import(Filename)
## Gene_Name Sample_1.hi Sample_2.hi Sample_3.hi Sample_4.low Sample_5.low
## 1 Gene_a 4.570237 3.230467 3.351827 3.930877 4.098247
## 2 Gene_b 3.561733 3.632285 3.587523 4.185287 1.380976
## Sample_1.low
## 1 4.418726
## 2 5.936990
By default we will only retrieve the first sheet.
We can specify the sheet by name or number using the which argument.
Table <- import("data/readThisXLS.xls",
which=2)
Table <- import("data/readThisXLS.xls",
which="Metadata")
Table[1:2,]
## Patient Condition Treatment
## 1 Sample_1.hi A X
## 2 Sample_2.hi A NoTreatment
If we want to import all sheets, we can use the import_list.
This returns a list containing our two spreadsheets. The list has two elements named after the corresponding XLS sheet.
## [1] "ExpressionScores" "Metadata"
Since this is a list of data.frames, we can access our sheets using standard list accessors, $ and [[]].
## Gene_Name Sample_1.hi Sample_2.hi Sample_3.hi Sample_4.low Sample_5.low
## 1 Gene_a 4.570237 3.230467 3.351827 3.930877 4.098247
## 2 Gene_b 3.561733 3.632285 3.587523 4.185287 1.380976
## Sample_1.low
## 1 4.418726
## 2 5.936990
## Patient Condition Treatment
## 1 Sample_1.hi A X
## 2 Sample_2.hi A NoTreatment
We can export our data back to file using the export() function and specifying the name of the output file to the file argument. The export() function will guess the format required from the extension.
We can export a list of data.frames to Excel’s xlsx format using the export() function. The names of list elements will be used to name sheets in xlsx file.
If you have an R object that is not rectangular, i.e. a list or a specialist R object, you can still save it.
Lets remake our list.
firstElement <- c(1,2,3,4)
secondElement <- matrix(1:10,nrow=2,ncol=5)
thirdElement <- data.frame(colOne=c(1,2,4,5),colTwo=c("One","Two","Three","Four"))
myList <- list(firstElement,secondElement,thirdElement)
myList
## [[1]]
## [1] 1 2 3 4
##
## [[2]]
## [,1] [,2] [,3] [,4] [,5]
## [1,] 1 3 5 7 9
## [2,] 2 4 6 8 10
##
## [[3]]
## colOne colTwo
## 1 1 One
## 2 2 Two
## 3 4 Three
## 4 5 Four
We can use the saveRDS() and readRDS() functions to save and read in our R object. They are saved as a *.rds object.
## [[1]]
## [1] 1 2 3 4
##
## [[2]]
## [,1] [,2] [,3] [,4] [,5]
## [1,] 1 3 5 7 9
## [2,] 2 4 6 8 10
##
## [[3]]
## colOne colTwo
## 1 1 One
## 2 2 Two
## 3 4 Three
## 4 5 Four
There is also a save() function. This can be used to save multiple data objects into a single RData file. We have to ensure that we name the argument for file output (file=).
We simply use load() to read it back in. We cannot assign this to a new variable as there are multiple objects. Instead load remembers the objects original name i.e. Table or myList.
Exercise on reading and writing data can be found here
Answers can be found here