opm an R package to analyse OmniLog Phenotype MicroArray data

Transkript

1 An introduction to opm opm an R package to analyse OmniLog Phenotype MicroArray data Dr. Johannes Sikorski, Dr. Lea Vaas, Dr. Markus Göker Leibniz-Institut DSMZ-Deutsche Sammlung von Mikroorganismen und Zellkulturen GmbH

2 You have numerous OmniLog Phenotype MicroArray data of closely related organisms or cell lines of numerous well-defined mutants obtained under diverse physiological test conditions and you want to explore them full-fledged and quantitatively into diverse directions of analysis frameworks.

3 opm: Tools for analysing OmniLog(R) Phenotype Microarray data enables you: to organize your PM data, curve parameters and metadata to subset and query your data graphical display of raw kinetics or aggregated curve parameters exploit the full statistics implemented in R export to third-party software using YAML

4 Software requirements R is a free software environment for statistical computing and graphics. RStudio is a free and open source integrated development environment (IDE) for R. add-on package opm: Tools for analysing OmniLog(R) Phenotype Microarray data

5 R Code of this presentation The R code of this presentation is available on request from Dr. Johannes Sikorski Dr. Lea Vaas Dr. Markus Göker johannes.sikorski@dsmz.de l.vaas@cbs.knaw.nl markus.goeker@dsmz.de Feel free to contact us in case of any questions regarding usage of opm.

6 opm enables you: to organize your PM data, curve parameters and metadata to subset and query your data graphical display of raw kinetics or aggregated curve parameters exploit the full statistics implemented in R export to third-party software using YAML

7 OPM organizes your PM data in OPMS objects: Example: a set of 9 PM plates of the same plate type intensity Hour Hour lysin per well: raw kinetic data An OPMS object stores: raw kinetic data aggregated curve parameters metadata Plate 1 Plate 2 Plate 3 Plate 4 Plate 5 Plate 6 Plate 7 Plate 8 Plate 9 Plate 1 Plate 2 Plate 3 Plate 4 Plate 5 Plate 6 Plate 7 Plate 8 Plate 9 Plate 1 Plate 2 Plate 3 Plate 4 Plate 5 Plate 6 Plate 7 Plate 8 Plate 9 The size of the OPMS object is only limited by the amount of RAM memory lysin mu lambda A AUC mu CI95 low lambda CI95 low A CI95 low AUC CI95 low mu CI95 high lambda CI95 high A CI95 high AUC CI95 high metadata Plate 3 Taxonomy Bacillus subtilis. habitat soil sampling place GPS coord. sampling date sampling season summer habitat [ C] 27. sporulation yes. PCR (gene xyz) positive.... as much and what you wish... per well: aggregated curve parameters, confidenceintervals from bootstrapping per plate: any metadata of interest to the user Lag = lambda, Slope = mu, Max = A, Area Under the Curve = AUC

8

9

10

11 read_opm() Leibniz-Institut DSMZ-Deutsche Sammlung von Mikroorganismen und Zellkulturen GmbH

12 Load Demo files that come with the opm package read_opm(names, convert = c("try", "no", "yes", "sep", "grp"), gen.iii = FALSE, include = list(),..., demo = FALSE) # Use the built-in function opm_files() to retrieve the paths where the example files in your R installation are located: (files <- opm_files("testdata")) # read in the files, which are zipped # using the include argument to select specific plates of interest # by this, three files are loaded into the object "example.opm" example.opm <- read_opm(files, include = "*Example_?.csv.xz")

13 Load Demo files that come with the opm package read_opm(names, convert = c("try", "no", "yes", "sep", "grp"), gen.iii = FALSE, include = list(),..., demo = FALSE) # read in all CSV raw data files in your working directory PM1 <- read_opm(".") # read in all CSV raw data files in your working directory and convert the plate type to GenIII plates GenIII <- read_opm(".", gen.iii = TRUE)

14 Load Demo files that come with the opm package # let us check some information on the files in this OPMS object plates(example.opm) summary(example.opm) show(example.opm) dim(example.opm) hours(example.opm) length(example.opm) max(example.opm) plate_type(example.opm) seq(example.opm) setup_time(example.opm) measurements(example.opm) wells(example.opm) wells(example.opm, full = TRUE)

22 Load Demo files that come with the opm package # let us check some information on the files in this OPMS object plates(example.opm) summary(example.opm) show(example.opm) dim(example.opm) hours(example.opm) length(example.opm) max(example.opm) plate_type(example.opm) seq(example.opm) setup_time(example.opm) measurements(example.opm) returns the raw kinetic data wells(example.opm) wells(example.opm, full = TRUE)

25

26 do_aggr() aggregate only A and AUC using a fast algorithm x <- do_aggr(example.opm, program = "opm-fast") aggregate all 4 parameters using a spline fit algorithm (grofit package) x <- do_aggr(example.opm) include 100x bootstrap replicates x <- do_aggr(example.opm, program = "opm-fast", boot = 100) x <- do_aggr(example.opm, boot = 100) Note: time consuming

27 check aggregated data aggregated(example.opm) A01 A02 A03 A04 A07 mu lambda A AUC mu CI95 low lambda CI95 low A CI95 low AUC CI95 low mu CI95 high lambda CI95 high A CI95 high AUC CI95 high

28

29 OPM organizes your PM data in OPMS objects: Example: a set of 9 PM plates of the same plate type intensity Hour Hour lysin per well: raw kinetic data An OPMS object stores: raw kinetic data aggregated curve parameters metadata Plate 1 Plate 2 Plate 3 Plate 4 Plate 5 Plate 6 Plate 7 Plate 8 Plate 9 Plate 1 Plate 2 Plate 3 Plate 4 Plate 5 Plate 6 Plate 7 Plate 8 Plate 9 Plate 1 Plate 2 Plate 3 Plate 4 Plate 5 Plate 6 Plate 7 Plate 8 Plate 9 You need to provide the metadata separately lysin mu lambda A AUC mu CI95 low lambda CI95 low A CI95 low AUC CI95 low mu CI95 high lambda CI95 high A CI95 high AUC CI95 high metadata Plate 3 Taxonomy Bacillus subtilis. habitat soil sampling place GPS coord. sampling date sampling season summer habitat [ C] 27. sporulation yes. PCR (gene xyz) positive.... as much and what you wish... per well: aggregated curve parameters, confidenceintervals from bootstrapping per plate: any metadata of interest to the user Lag = lambda, Slope = mu, Max = A, Area Under the Curve = AUC

30 You need to provide the metadata separately One Problem Arises: Imagine, you have numerous plates with numerous metadata to each plate. How can we make sure that the metadata are matched CORRECTLY to the specific raw kinetic data? Solution: We need an identifier that perfectly matches metadata to raw kinetic data. We use as identifier the Setup Time and Position of the plate in the reader. Good news: opm allows to export these informations as a start for the metadata file using the function: collect_template()

31 collect_template() data frame add further metadata columns metadata <- collect_template(files, include = "*Example_?.csv.xz") Unique identifier to merge metadata and raw kinetic data

32 collect_template() data frame CSV file (or *.txt, *.dat) add further metadata columns add further metadata columns in a spreadsheed application collect_template(files, include = "*Example_?.csv.xz", outfile = "template.csv") note the FORMAT: columns are tab separated, fields protected by quotation marks

33 collect_template() data frame add further metadata columns CSV file (or *.txt, *.dat) add further metadata columns save tab separated and use quotation marks as field protector load file into R environment using to_metadata()

34 collect_template() data frame add further metadata columns CSV file (or *.txt, *.dat) add further metadata columns save tab separated and use quotation marks as field protector load file into R environment using metadata.example <- to_metadata("template.csv") metadata.example <- to_metadata("template.csv", strip.white = FALSE) metadata.example <- to_metadata("template.csv", sep = ",")

35 collect_template() data frame add further metadata columns CSV file (or *.txt, *.dat) add further metadata columns further added metadata columns Note: mock metadata for demonstration purpose

36 include_metadata() data frame with metadata metadata OPMS object with kinetic raw data example.opm example.opm.metadata <- include_metadata(example.opm, md = metadata)

37

38

39 draw kinetic data xy_plot(example.opm)

40 xy_plot(example.opm) Leibniz-Institut DSMZ-Deutsche Sammlung von Mikroorganismen und Zellkulturen GmbH

41 xy_plot(example.opm, col = c("blue", "red", "green"), lwd = 2)

42 xy_plot(example.opm, col = c("blue", "red", "green"), lwd = 2, legend.fmt = list(space = "right"))

43 xy_plot(example.opm, col = c("blue", "red", "green"), lwd = 2, legend.fmt = list(space = "right"), include = c("species", "strain"))

44 xy_plot(example.opm, col = c("blue", "red", "green"), lwd = 2, legend.fmt = list(space = "right"), include = c("species", "strain")) Modify panel strip, strip text, and legend by using arguments from lattice

45 xy_plot(example.opm[,, ]) What about drawing only parts? It is possible to plot (1) specific plates, (2) time points, or (3) wells by indexing OPMS objects using square brackets. xy_plot(example.opm[plates, time points, wells])

46 xy_plot(example.opm[,, ])

47 xy_plot(example.opm[ 3,, ])

48 xy_plot(example.opm[ 3, 1:100, ])

49 xy_plot(example.opm[ 3, 1:100, c("a01", "A02", "E05", "G08", "H10")])

50 xy_plot(example.opm[ 3, 1:100, c("a01", "A02", "E05", "G08", "H10")])

51 Heatmaps compare plates on the basis of aggregated curve parameters

52 The generation of heatmaps includes two steps: (1) Extract the curve parameter values using extract() (2) Create the heatmap using heat_map()

53 First step: AUC <- extract(example.opm, dataframe = TRUE, as.labels = list("country", "Species", "strain", "town"), subset = "AUC") metadata of interest parameter and values from aggregating the curve parameters

54 Second step: heat_map(auc, as.labels = c("species", "town"), as.groups = "town", cexrow = 1.2, use.fun = "gplots", main = "nice heatmap", col = topo.colors(120))

55 heat_map(auc, as.labels = c("species", "town"), as.groups = "town", cexrow = 1.2, use.fun = "gplots", main = "nice heatmap", col = topo.colors(120))

56 Confidence interval plot Do curves differ significantly in aggregated curve parameters? We make use of the 95% confidence intervals calculated from 100 bootstrap replicates.

57 xy_plot(example.opm) In which aggregated curve parameters do these curves differ significantly?

58 xy_plot(example.opm[,,"d10"], include = list("species","town"), neg.ctrl = FALSE)

59 ci_plot(example.opm[,, c("d10")], as.labels = list("species","town"), subset = "A")

60 ci_plot(example.opm[,, c("d10")], as.labels = list("species","town"), subset = "AUC")

61 ci_plot(example.opm[,, c("d10")], as.labels = list("species","town"), subset = "lambda")

62 xy_plot(example.opm) Do these curves differ in their lag phase? Try yourself

63

64 radial_plot(example.opm[,, 5:17], sep = " ", as.labels = c("species", "town"), draw.legend = FALSE, subset = "AUC")

65

66 xy_plot(example.opm[plates, time points, wells]) data(vaas_et_al) -114 GenIII plates (run 96 hours) - numerous replicates of - each two strains of Escherichia coli and Pseudomonas aeruginosa, - including aggregated bootstrapped curve parameters and metadata

67 data(vaas_et_al)

68

69