Importing raw files

How to use

readEEM accepts path argument specifies the path to files or folders.

library(EEM)

# importing files
data <-readEEM("sample1.txt") # read in a file
data <-readEEM(c("sample1.txt", "sample2.txt")) # read in two files

# importing folders
data <-readEEM("/data") # read in all files in data folder
data <-readEEM(c("/data", "/data2")) # read in all files in two folders
data <-readEEM("C:\\data") # full path. Note that the slash is doubled.
data <- readEEM("C:/data") # read in all files in data folder. Aside from double slashes,
                           # a reverted slash can also be used. 

If the working folder which contains raw data files has already been set, readEEM(".") or readEEM(getwd()) can be used to access them directly.

How it works

readEEM first checks the extensions of a file or all files in the folder. The acceptable extensions are *.csv, *.txt, *.xls, *.xlsx, and *.dat. It will not read in the files whose extensions are not in the list. It will then check the formats of each files (see next section on company-specific formats). The files whose format is not supported by readEEM will not be read in.

The method that readEEM uses to check the file format is to look out for a certain keyword which is located just above the raw data. The formats of different companies are very similar except for the number of filler lines at the top. readEEM will look for a keyword which signals the end of the filler lines and the start of raw data.

JASCO

Reference machine: FP-8500
The raw files are of “*.jwb” extension. They have to be converted into text-based files (*.csv, *.txt) using the machine software first. The keyword before the data starts is “XYDATA”. Columns are excitation wavelength and rows are emission wavelength.

Hitachi Hi-tech

Reference machine: F-7000
The keyword before the data starts is “Data Points” or “ﾃﾞｰﾀﾘｽﾄ”.Columns are excitation wavelength and rows are emission wavelength.

Shimadzu

Reference machine: RF-6000
The keyword before the data starts is “Rawdata” or “CorrectionData”. Columns and rows are exchangable as excitation and emission wavelength. We assume that rows are excitation wavelength and columns are emission wavelength unless the word “励起波長/蛍光波長” is present. The exception has only been added for the Japanese keyword since we only have the sample data in Japanese.

Horiba Aqualog

Unlike most formats, Aqualog file does not have filler starting lines. The first row states excitation wavelength and the first column states emission wavelength.

Others

For other formats, please send a word so we can work on it.

*.txt or *.csv files

datamatrix <- read.csv("datamatrix.csv", row.names = 1) # for csv
datamatrix <- read.csv("datamatrix.txt", row.names = 1) # for txt
datamatrix[1:5,1:5] # check the first 5 rows and columns

Note that row.names was used to specify that the row names exist and they are in column number 1.

excel file

library(readxl)
datamatrix <- read_excel("datamatrix.csv")
datamatrix[1:5,1:5] # check the first 5 rows and columns

For read_excel, row names cannot be specified so the first column is filled with row names instead. To edit that the following trick can be used.

rownames(datamatrix) <- datamatrix[,1] # assign the first column to the matrix row names
datamatrix <- datamatrix[,-1] # delete the first column
datamatrix[1:5,1:5] # check the first 5 rows and columns