Wikisource:WikiProject Open Access/Programmatic import from PubMed Central/Environmental Shotgun Sequencing Its Potential and Challenges for Studying the Hidden World of Microbes

Environmental Shotgun Sequencing: Its Potential and Challenges for Studying the Hidden World of Microbes by Jonathan A Eisen
PLoS Biology , vol. 5, iss. p.


Environmental shotgun sequencing promises to reveal novel and fundamental insights into the hidden world of microbes, but the complexity of analysis required to realize this potential poses unique interdisciplinary challenges.Since their discovery in the 1670s by Anton van Leeuwenhoek, an incredible amount has been learned about microorganisms and their importance to human health, agriculture, industry, ecosystem functioning, global biogeochemical cycles, and the origin and evolution of life. Nevertheless, it is what is not known that is most astonishing. For example, though there are certainly at least 10 million species of bacteria, only a few thousand have been formally described[1]. This contrasts with the more than 350,000 described species of beetles [2]. This is one of many examples indicative of the general difficulties encountered in studying organisms that we cannot readily see or collect in large samples for future analyses. It is thus not surprising that most major advances in microbiology can be traced to methodological advances rather than scientific discoveries per se.Examples of these key revolutionary methods (Table 1) include the use of microscopes to view microbial cells, the growth of single types of organisms in the lab in isolation from other types (culturing), the comparison of ribosomal RNA (rRNA) genes to construct the first tree of life that included microbes[3], the use of the polymerase chain reaction (PCR) [4] to clone rRNA genes from organisms without culturing them [5], and the use of high-throughput “shotgun” methods to sequence the genomes of cultured species [6]. We are now in the midst of another such revolution—this one driven by the use of genome sequencing methods to study microbes directly in their natural habitats, an approach known as metagenomics, environmental genomics, or community genomics [7].In this essay I focus on one particularly promising area of metagenomics—the use of shotgun genome methods to sequence random fragments of DNA from microbes in an environmental sample. The randomness and breadth of this environmental shotgun sequencing (ESS)—first used only a few years ago[8],[9] and now being used to assay every microbial system imaginable from the human gut [10] to waste water sludge [11]—has the potential to reveal novel and fundamental insights into the hidden world of microbes and their impact on our world. However, the complexity of analysis required to realize this potential poses unique interdisciplinary challenges, challenges that make the approach both fascinating and frustrating in equal measure.

Who Is Out There? Typing and Counting Microbes in the EnvironmentEdit

One of the most important and conceptually straightforward steps in studying any ecosystem involves cataloging the types of organisms and the numbers of each type. For a long time, such typing and counting was an almost insurmountable problem in microbiology. This is largely because physical appearance does not provide a valid taxonomic picture in microbes. Appearance evolves so rapidly that two closely related taxa may look wildly different and two distantly related taxa may look the same. This vexing problem was partially overcome in the 1980s through the use of rRNA-PCR (Table 1). This method allows microorganisms in a sample to be phylogenetically typed and counted based on the sequence of their rRNA genes, genes that are present in all cell-based organisms. In essence, a database of rRNA sequences[12],[13] from known organisms functions like a bird field guide, and finding a rRNA-PCR product is akin to seeing a bird through binoculars. Rather than counting species, this approach focuses on “phylotypes,” which are defined as organisms whose rRNA sequences are very similar to each other (a cutoff of >97% or >99% identical is frequently used). The ability to use phylotyping to determine who was out there in any microbial sample has revolutionized environmental microbiology [14], led to many discoveries [e.g., [15], and convinced many people (myself included) to become microbiologists.

The selective targeting of a single gene makes rRNA-PCR an efficient method for deep community sampling[16]. However, this efficiency comes with limitations, most of which are complemented or circumvented by the randomness and breadth of ESS. For example, examination of the random samples of rRNA sequences obtained through ESS has already led to the discovery of new taxa—taxa that were completely missed by PCR because of its inability to sample all taxa equally well (e.g., [17]). In addition, ESS provides the first robust sampling of genes other than rRNA, and many of these genes can be more useful for some aspects of typing and counting. Some universal protein coding genes are better than rRNA both for distinguishing closely related strains (because of third position variation in codons) and for estimating numbers of individuals (because they vary less in copy number between species than do rRNA genes) [8]. Perhaps most significantly, ESS is providing groundbreaking insights into the diversity of viruses [18],[19], which lack rRNA genes and thus were left out of the previous revolution.

Certainly, many challenges remain before we can fully realize the potential of ESS for the typing and counting of species, including making automated yet accurate phylogenetic trees of every gene, determining which genes are most useful for which taxa, combining data from different genes even when we do not know if they come from the same organisms, building up databases of genes other than rRNA, and making up for the lack of depth of sampling. If these challenges are met, ESS has the potential to rewrite much of what we thought we knew about the phylogenetic diversity of microbial life.

What Are They Doing? Top Down and Bottom Up Approaches to Understanding Functions in CommunitiesEdit

A community is, of course, more than a list of types of organisms. One approach to understanding the properties and functioning of a microbial community is to start with studies of the different types of organisms and build up from these individuals to the community. Ideally, to do this one would culture each of the phylotypes and study its properties in the lab. Unfortunately, many, if not most, key microbes have not yet been cultured[20]. Thus, for many years, the only alternative was to make predictions about the biology of particular phylotypes based on what was known about related organisms. Unfortunately, this too does not work well for microbes since very closely related organisms frequently have major biological differences. For example, Escherichia coli K12 and E. coli O157:H7 are strains of the same species (and considered to be the same phylotype), with genomes containing only about 4,000 genes, yet each possesses hundreds of functionally important genes not seen in the other strain[21]. Such differences are routine in microbes, and thus one cannot make any useful inferences about what particular phylotypes are doing (e.g., type of metabolism, growth properties, role in nutrient cycling, or pathogenicity) based on the activities of their relatives.

These difficulties—the inability to culture most microbes and the functional disparities between close relatives—led to one of the first kinds of metagenomic analyses, wherein predictions of function were made from analysis of the sequence of large DNA fragments from representatives of known phylotypes. This approach has provided some stunning insights, such as the discovery of a novel form of phototrophy in the oceans[22]. However, this large insert approach has the same limitation as predicting properties from characterized relatives—a single cell cannot possibly represent the biological functions of all members of a phylotype.

ESS provides an alternative, more global way of assessing biological functions in microbial communities. As when using the large insert approach, functions can be predicted from sequences. However, in this case the predicted functions represent a random sampling of those encoded in the genomes of all the organisms present. This approach has unquestionably been wildly successful in terms of gene discovery. For example, analysis of ESS data has revealed novel forms of every type of gene family examined, as well as a great number of completely novel families (e.g.,[23]). However, there is a major caveat when using ESS data to make community-level inferences. Ecosystems are more than just a bag of genes—they are made up of compartments (e.g., cells, chromosomes, and species), and these compartments matter. The key challenge in analyzing ESS data is to sort the DNA fragments (which are usually less than 1,000 base pairs long relative to genome sizes of millions or billions of bases) into bins that correspond to compartments in the system being studied.

A recent study by myself and colleagues illustrates the importance of compartments when interpreting ESS data. When we analyzed ESS data from symbionts living inside the gut of the glassy-winged sharpshooter (an insect that has a nutrient-limited diet), we were able to bin the data to two distinct symbionts[24]. We then could infer from those data that one of the symbionts synthesizes amino acids for the host while the other synthesizes the needed vitamins and cofactors. Modeling and understanding of this ecosystem are greatly enhanced by the demonstration of this complementary division of labor, in comparison to simply knowing that amino acids, vitamins, and cofactors are made by “symbionts.”

How does one go about binning ESS data? A variety of approaches have been developed, some of which are described in Table 2. In considering the different binning methods and their limitations, the first question one needs to ask is, what are we trying to bin? Is it fragments from the same chromosome from a single cell, which would be useful for studying chromosome structure? If so, then perhaps genome assembly methods are the best. What if instead, as in the sharpshooter example, we are trying to have each bin include every fragment that came from a particular species, knowledge which may be useful for predicting community metabolic potential? If the level of genetic polymorphism among individual cells from the same species is high, then genome assembly methods may not work well (the polymorphisms will break up assemblies). A better approach might be to look for species-specific “word” frequencies in the DNA, such as ones created by patterns in codon usage. The challenge is, how do we tune the methods to find the right target level of resolution? If we are too stringent, most bins will include only a few fragments. But if we are too relaxed, we will create artificial constructs that may prove biologically misleading, such as grouping together sequences from different species. To make matters more complex, most likely the stringency needed will vary for different taxa present in the sample.

Another critical issue is the diversity of the system under study. Generally, binning works better when there are few different phylotypes present, all of which are distantly related and form discrete populations. This is why binning works well for the sharpshooter system and other relatively isolated, low diversity environments. Binning increases in difficulty exponentially as the number of species increases: the populations and species start to merge together, and the populations get more and more polymorphic and variable in relative abundance (such as in the paper about the Global Ocean Sampling expedition in this issue[25]). Further complicating binning is the phenomenon of lateral gene transfer, where genes are exchanged between distantly related lineages at rates that are high enough that random sampling of a genome will frequently include genes with multiple histories.

Despite these challenges, I believe we can develop effective binning methods for complex communities. First, we can combine different approaches together, such as using one method to sort in a relaxed manner and then using another to subdivide the bins provided by the first method. Second, we can incorporate new approaches such as population genetics into the analysis[26]. In addition, the lessons learned here can be applied to other aspects of metagenomics (e.g., the counting and typing discussed above) and provide insights into the nature of microbial genomes and the structure of microbial populations and communities.

Comparative MetagenomicsEdit

So far, I have discussed issues relating mostly to intrasample analysis of ESS data. However, the area with perhaps the most promise involves the comparative analysis of different samples. This work parallels the comparative analysis of genomes of cultured species. Initial studies of that type compared distantly related taxa with enormous biological differences. What has been learned from these studies pertains mostly to core housekeeping functions, such as translation and DNA metabolism, and to other very ancient processes[27],[28]. It was not until comparisons were made between closely related organisms that we began to understand events that occurred on shorter time scales, such as selection, gene transfer, and mutation processes [29]. Similarly, the initial comparisons of ESS data involved comparisons of wildly different environments [30], yielding insights into the general structure of communities. But as more comparisons are made between similar communities [31],[32], such as those sampled during vertical and horizontal ocean transects [25],[33], we will begin to learn about shorter time scale processes such as migration, speciation, extinction, responses to disturbance, and succession. It is from a combination of both approaches—comparing both similar and very divergent communities—that we will be able to understand the fundamental rules of microbial ecology and how they relate to ecological principles seen in macro-organisms.


In promoting some of the exciting opportunities with ESS, I do not want to give the impression that it is flawless. It is helpful in this respect to compare ESS to the Internet. As with the Internet, ESS is a global portal for looking at what occurs in a previously hidden world. Making sense of it requires one to sort through massive, random, fragmented collections of bits of information. Such searches need to be done with caution because any time you analyze such a large amount of data patterns can be found. In addition, as with the Internet, there is certainly some hype associated with ESS that gives relatively trivial findings more attention than they deserve. Overall, though, I believe the hype is deserved. As long as we treat ESS as a strong complement to existing methods, and we build the tools and databases necessary for people to use the information, it will live up to its revolutionary potential.I thank Simon Levin, Joshua Weitz, Jonathan Dushoff, Maria-Inés Benito, Doug Rusch, Aaron Halpern, and Shibu Yooseph for helpful discussions, and Melinda Simmons, Merry Youle, and three anonymous reviewers for helpful comments on the manuscript. The writing of this paper was supported by National Science Foundation Assembling the Tree of Life Grant 0228651 to Jonathan A. Eisen and by the Defense Advanced Research Projects Agency under grants HR0011-05-1-0057 and FA9550-06-1-0478.Abbreviations;ESS: environmental shotgun sequencing;PCR: polymerase chain reaction;rRNA: ribosomal RNA

Figures and TablesEdit


Table 1Edit

"Some Major Methods for Studying Individual Microbes Found in the Environment"

Table 2Edit

"Methods of Binning"
Series Editor: Simon Levin, Princeton University, United States of AmericaThis article is part of the Oceanic Metagenomics collection in PLoS Biology. The full collection is available online at A. Eisen is at the University of California Davis Genome Center, with joint appointments in the Section of Evolution and Ecology and the Department of Medical Microbiology and Immunology, Davis, California, United States of America. Web site:


  1. Gould, SJ, 244 
  2. Evans, AV & Bellamy, CL, 208 
  3. Woese, C & Fox, G, “Phylogenetic structure of the prokaryotic domain: The primary kingdoms”, Proc Natl Acad Sci U S A 74: 5088–5090, pmid:270744 
  4. Mullis, K & Faloona, F, “Specific synthesis of DNA in vitro via a polymerase-catalyzed chain reaction”, Methods Enzymol 155: 335–350, pmid:3431465 
  5. 5–7 Cite error: Invalid <ref> tag; name "pbio-0050082-b005" defined multiple times with different content
  6. Fleischmann, RD; Adams, MD; White, O; Clayton, RA & Kirkness, EF, “Whole-genome random sequencing and assembly of Haemophilus influenzae Rd”, Science 269: 496–512, pmid:7542800 
  7. Handelsman, J, “Metagenomics: Application of genomics to uncultured microorganisms”, Microbiol Mol Biol Rev 68: 669–685, pmid:15590779 
  8. 8.0 8.1 Venter, JC; Remington, K; Heidelberg, JF; Halpern, AL & Rusch, D, “Environmental genome shotgun sequencing of the Sargasso Sea”, Science 304: 66–74, pmid:15001713 
  9. Tyson, GW; Chapman, J; Hugenholtz, P; Allen, EE & Ram, RJ, “Community structure and metabolism through reconstruction of microbial genomes from the environment”, Nature 428: 37–43, pmid:14961025 
  10. Gill, SR; Pop, M; Deboy, RT; Eckburg, PB & Turnbaugh, PJ, “Metagenomic analysis of the human distal gut microbiome”, Science 312: 1355–1359, pmid:16741115 
  11. Garcia Martin, H; Ivanova, N; Kunin, V; Warnecke, F & Barry, KW, “Metagenomic analysis of two enhanced biological phosphorus removal (EBPR) sludge communities”, Nat Biotechnol 24: 1263–1269, pmid:16998472 
  12. Olsen, GJ; Larsen, N & Woese, CR, “The ribosomal RNA database project”, Nucleic Acids Res 19: 2017–2021, pmid:2041798 
  13. Cole, JR; Chai, B; Farris, RJ; Wang, Q & Kulam-Syed-Mohideen, AS, “The ribosomal database project (RDP-II): Introducing myRDP space and quality controlled public data”, Nucleic Acids Res 35: D169–D172, pmid:17090583 
  14. Pace, NR, “A molecular view of microbial diversity and the biosphere”, Science 276: 734–740, pmid:9115194 
  15. Hugenholtz, P; Pitulle, C; Hershberger, KL & Pace, NR, “Novel division level bacterial diversity in a Yellowstone hot spring”, J Bacteriol 180: 366–376, pmid:9440526 
  16. Sogin, ML; Morrison, HG; Huber, JA; Welch, DM & Huse, SM, “Microbial diversity in the deep sea and the underexplored “rare biosphere””, Proc Natl Acad Sci U S A 103: 12115–12120, pmid:16880384 
  17. Baker, BJ; Tyson, GW; Webb, RI; Flanagan, J & Hugenholtz, P, “Lineages of acidophilic archaea revealed by community genomic analysis”, Science 314: 1933–1935, pmid:17185602 
  18. Angly, FE; Felts, B; Breitbart, M; Salamon, P & Edwards, RA, “The marine viromes of four oceanic regions”, PLoS Biol 4: e368, [[pmid:17090214 doi:[10.1371/journal.pbio.0040368 10.1371/journal.pbio.0040368]]] 
  19. Edwards, RA & Rohwer, F, “Viral metagenomics”, Nat Rev Microbiol 3: 504–510, pmid:15886693 
  20. Leadbetter, JR, “Cultivation of recalcitrant microbes: Cells are alive, well and revealing their secrets in the 21st century laboratory”, Curr Opin Microbiol 6: 274–281, pmid:12831904 
  21. Perna, NT; Plunkett, G; Burland, V; Mau, B & Glasner, JD, “Genome sequence of enterohaemorrhagic Escherichia coli O157:H7”, Nature 409: 529–533, pmid:11206551 
  22. Beja, O; Aravind, L; Koonin, EV; Suzuki, MT & Hadd, A, “Bacterial rhodopsin: Evidence for a new type of phototrophy in the sea”, Science 289: 1902–1906, pmid:10988064 
  23. Yooseph, S; Sutton, G; Rusch, DB; Halpern, AL & Williamson, SJ, “The Sorcerer II Global Ocean Sampling expedition: Expanding the universe of protein families”, PLoS Biol 5: e16, [[pmid:17355171 DOI: [10.1371/journal.pbio.0050016 10.1371/journal.pbio.0050016]]] 
  24. Wu, D; Daugherty, SC; Van Aken, SE; Pai, GH & Watkins, KL, “Metabolic complementarity and genomics of the dual bacterial symbiosis of sharpshooters”, PLoS Biol 4: e188, [[pmid:16729848 doi:[10.1371/journal.pbio.0040188 10.1371/journal.pbio.0040188]]] 
  25. 25.0 25.1 Rusch, DB; Halpern, AL; Sutton, G; Heidelberg, KB & Williamson, S, “The Sorcerer II Gobal Ocean Sampling expedition: Northwest Atlantic through Eastern Tropical Pacific”, PLoS Biol 5: e77, [[pmid:17355176 doi:[10.1371/journal.pbio.0050077 10.1371/journal.pbio.0050077]]] 
  26. Johnson, PL & Slatkin, M, “Inference of population genetic parameters in metagenomics: A clean look at messy data”, Genome Res 16: 1320–1327, pmid:16954540 
  27. Koonin, EV & Mushegian, AR, “Complete genome sequences of cellular life forms: Glimpses of theoretical evolutionary genomics”, Curr Opin Genet Dev 6: 757–762, pmid:8994848 
  28. Mushegian, AR & Koonin, EV, “A minimal gene set for cellular life derived by comparison of complete bacterial genomes”, Proc Natl Acad Sci U S A 93: 10268–10273, pmid:8816789 
  29. Eisen, JA, “Gastrogenomics”, Nature 409: 463–466, pmid:11206526 
  30. Tringe, SG; von Mering, C; Kobayashi, A; Salamov, AA & Chen, K, “Comparative metagenomics of microbial communities”, Science 308: 554–557, pmid:15845853 
  31. Edwards, RA; Rodriguez-Brito, B; Wegley, L; Haynes, M & Breitbart, M, “Using pyrosequencing to shed light on deep mine microbial ecology”, BMC Genomics 7: 57, pmid:16549033 
  32. Rodriguez-Brito, B; Rohwer, F & Edwards, RA, “An application of statistics to comparative metagenomics”, BMC Bioinformatics 7: 162, pmid:16549025 
  33. 35–37 Cite error: Invalid <ref> tag; name "pbio-0050082-b035" defined multiple times with different content