Earth Microbiome Vuegen Demo Notebook

The Earth Microbiome Project (EMP) is a systematic attempt to characterize global microbial taxonomic and functional diversity for the benefit of the planet and humankind. It aimed to sample the Earth’s microbial communities at an unprecedented scale in order to advance our understanding of the organizing biogeographic principles that govern microbial community structure. The EMP dataset is generated from samples that individual researchers have compiled and contributed to the EMP. The result is both a reference database giving global context to DNA sequence data and a framework for incorporating data from future studies, fostering increasingly complete characterization of Earth’s microbial diversity.

You can find more information about the Earth Microbiome Project at https://earthmicrobiome.org/ and in the original article.

Exploratory Data Analysis

This section contains the exploratory data analysis of the Earth Microbiome Project (EMP) dataset.

Sample Exploration

Metadata Random Subset

ⓘ#SampleID BarcodeSequence LinkerPrimerSequence Description host_subject_id study_id title principal_investigator doi ebi_accession target_gene target_subfragment pcr_primers illumina_technology extraction_center run_center run_date read_length_bp sequences_split_libraries observations_closed_ref_greengenes observations_closed_ref_silva observations_open_ref_greengenes observations_deblur_90bp observations_deblur_100bp observations_deblur_150bp emp_release1 qc_filtered subset_10k subset_5k subset_2k sample_taxid sample_scientific_name host_taxid host_common_name_provided host_common_name host_scientific_name host_superkingdom host_kingdom host_phylum host_class host_order host_family host_genus host_species collection_timestamp country latitude_deg longitude_deg depth_m altitude_m elevation_m env_biome env_feature env_material envo_biome_0 envo_biome_1 envo_biome_2 envo_biome_3 envo_biome_4 envo_biome_5 empo_0 empo_1 empo_2 empo_3 adiv_observed_otus adiv_chao1 adiv_shannon adiv_faith_pd temperature_deg_c ph salinity_psu oxygen_mg_per_l phosphate_umol_per_l ammonium_umol_per_l nitrate_umol_per_l sulfate_umol_per_l
1056.Mel.urs.ino.SanDi.1CGATAGGCCTTAGTGCCAGCMGCCGCGGTAA fecal sample from Sri Lankan sloth bear1056:Mel.urs.ino.SanDi.11056Convergence of gut microbiomes in myrmecophagous mammalsFrederic Delsuc10.1111/mec.12501ERP00378216S rRNAV4FWD:GTGCCAGCMGCCGCGGTAA; REV:GGACTACHVGGGTWTCTAATMiSeqCCME-BoulderCCME10/9/121511904317318.017597.018497.013608.013265.010851.0TrueTrueTrueTrueTrue749906gut metagenome9636.0Sri Lankan sloth bearsloth bearMelursus ursinussk__Eukaryotak__Metazoap__Chordatac__Mammaliao__Carnivoraf__Ursidaeg__Melursuss__Melursus_ursinus2012-08-03GAZ:United States of America32.780000-117.0700000.0000.072.0000terrestrial biomeanimal-associated habitatfecesbiometerrestrial biomeNaNNaNNaNNaNEMP sampleHost-associatedAnimalAnimal distal gut173.0208.7750004.01351722.370232NaNNaNNaNNaNNaNNaNNaNNaN
1036.P.N.14.2.s.4.1.sequencesGGTTCCATTAGGGTGCCAGCMGCCGCGGTAAsoil metagenome P_N_14_2XXQIITAXX1036Microbial communities of the deep unfrozen: Do microbes in taliks increase permafrost carbon vulnerability?Jenni Hultman10.1038/ismej.2011.163*ERP01658816S rRNAV4FWD:GTGCCAGCMGCCGCGGTAA; REV:GGACTACHVGGGTWTCTAATHiSeqANL-ChicagoCCME2/15/12100201124165896.0171547.0198921.0107368.077423.00.0TrueTrueTrueFalseFalse410658soil metagenomeNaNNaNNaNNaNNaNNaNNaNNaNNaNNaNNaNNaN2009-04-01GAZ:United States of America64.490000-157.7500000.7000.0593.0000tundra biomepermafrostsoilbiometerrestrial biometundra biomeNaNNaNNaNEMP sampleFree-livingNon-salineSoil (non-saline)481.0706.8571436.93289456.337594NaN6.20NaNNaNNaNNaNNaNNaN
1034.CHI7CTGAAGGGCGAAGTGCCAGCMGCCGCGGTAAsoil metagenome, ABCHI71034Distinct microbial communities associated with buried soils in the Siberian tundraAntje Gittel10.1038/ismej.2013.219ERP01673516S rRNAV4FWD:GTGCCAGCMGCCGCGGTAA; REV:GGACTACHVGGGTWTCTAATHiSeqANL-ChicagoCCME8/28/121009416874417.077196.092153.046391.046128.00.0TrueTrueFalseFalseFalse410658soil metagenomeNaNNaNNaNNaNNaNNaNNaNNaNNaNNaNNaNNaN2011-08-10GAZ:Russia68.747920161.601180NaN0.0315.0000tundra biometundrasoilbiometerrestrial biometundra biomeNaNNaNNaNEMP sampleFree-livingNon-salineSoil (non-saline)1087.01704.9469038.40361290.602021NaN5.46NaNNaNNaNNaNNaNNaN
(97 more rows not shown)

Animal Samples Map

Plant Samples Map

Saline Samples Map

Physicochemical properties of the EMP samples

Pairwise scatter plots of available physicochemical metadat are shown for temperature, salinity, oxygen, and pH, and for phosphate, nitrate, and ammonium

Metagenomics

Alpha Diversity

This subsection contains the alpha diversity analysis of the EMP dataset.

Alpha Diversity Host Associated Samples

Alpha Diversity Free Living Samples

Average Copy Number

Average Copy Number Emp Ontology Level2

Average Copy Number Emp Ontology Level3

Nestedness

Nestedness Random Subset

ⓘUnnamed: 0 SAMPLE_RANK OBSERVATION_RANK SAMPLE_ID OBSERVATION_ID empo_3 METADATA_NUMERIC_CODE
15917157784808.AK.19.15a.s.4.1.sequencesk__Bacteria;p__BacteroidetesSoil (non-saline)9
6395187170807.S.S.11.bk__Archaea;p__EuryarchaeotaSediment (non-saline)11
446177983722.M11Tong.6.s.7.1.sequencek__Bacteria;p__ActinobacteriaAnimal secretion12
(97 more rows not shown)

All Samples

Plant Samples

Animal Samples

Non Saline Samples

Shanon entropy analysis

This subsection contains the Shannon entropy analysis of the EMP dataset.

Specificity of sequences and higher taxonomic groups for environment

  1. Environment distribution in all genera and 400 randomly chosen tag sequence. b) and c) Shannon entropy within each taxonomic group.

Network Analysis

Phyla Association Networks

Phyla Counts Subset

ⓘUnnamed: 0 807.E.S.11.b 1883.2008.269.Crump.Artic.LTREB.main.lane2.NoIndex 1627.ZCCK1 1711.KAM6.3 1034.ZKD2 722.TRRsed3.4.s.4.1.sequence 1883.2007.214.Crump.Artic.LTREB.main.lane2.NoIndex 1222.B4.5.8.06 1288.NSB30jul08E.McMahon.Pool.3.and.1percentPhiX.110310.HWUSI.EAS552R.0357.s.3.1.sequence 1242.ME07Aug08EB2R2 1453.47548SDZ2.C8.Cang.stom 1642.MS00567 1198.ANT02.S1M2 1034.ZKE4 1580.1CA.sed.D1 550.L1S264.s.1.sequence 1001.SKM9 1747.DZF.6202012.RJ.glass.window 809.PLRP15.mat 861.H10.mar09 1773.Columb.passer8.lgi 933.Phylospora.comosa.1.5 1774.53Fecal23.10.09 678.T.RFLP.Sample.636 1883.2011.54.Crump.Artic.LTREB.main.lane3.NoIndex 1642.MS00602 910.PocTA2 1039.L.Vermelha.SC.2.3 1748.5.15.12.FI.11.V 807.C.F.11.b 2382.SH004.C1.RH.2.609.leav.9.12.lane8.NoIndex.L008.sequences 807.S.F.11.b 1773.Columb.passer5.ugi 1642.MS00635 1713.McG.L3B1020 804.LS11.70a 2080.S39D435 722.M31Fcsw.3.s.3.1.sequence 933.T.1.1.S.E.4 1064.W.CV123 1627.LBC1 1883.2011.498.Crump.Artic.LTREB.main.lane4.NoIndex 662.M23 2382.SH004.C1.RH.1.605.gp.9.12.lane8.NoIndex.L008.sequences 861.C15.dec08 1883.2008.151.Crump.Artic.LTREB.main.lane2.NoIndex 2382.RU006.C181.RH.4.794.leav.9.12.lane8.NoIndex.L008.sequences 1642.MS00454 722.M31Plmr.7.s.8.1.sequence 1883.2011.494.Crump.Artic.LTREB.main.lane4.NoIndex
Bacteroidetes0.0376490.0512750.1239260.0161450.0278980.0272520.0488860.0251860.0295770.0567650.1044880.0265420.0526960.0000000.0948010.1133350.0499840.0426860.0696160.0388760.0087830.0585730.0283500.0231840.0485630.0236360.0025830.0182110.0209230.0258310.0000000.0380370.0055540.0278330.0012270.0353890.0037460.1952210.0529540.0000650.0100100.0225380.0382950.0000000.0353890.0350020.0000000.0269940.0451400.046238
WS30.0128690.0000000.0000000.0545040.0000000.0302800.0166540.0000000.0000000.0007570.0000000.0189250.0000000.0000000.0105980.0000000.0000000.0000000.0060560.0651020.0000000.0000000.0000000.0522330.0045420.0340650.0000000.0083270.0000000.0189250.0000000.0264950.0000000.0174110.0000000.0000000.0000000.0000000.0000000.0000000.0196820.0030280.0000000.0000000.0000000.0015140.0000000.0196820.0000000.018168
Elusimicrobia0.0211000.0000000.0000000.0406930.0000000.0000000.0188390.0000000.0000000.0000000.0000000.0226070.0000000.0000000.0000000.0000000.0000000.0000000.0000000.0000000.0000000.0000000.0022610.0007540.0037680.0165790.0000000.0030140.0000000.0248680.0000000.0233610.0000000.0233610.0060290.0000000.0000000.0000000.0000000.0000000.0000000.0000000.0000000.0000000.0000000.0007540.0000000.0165790.0000000.000000
(78 more rows not shown)

Phyla Correlation Network With 0.5 Threshold Edgelist

Number of nodes: 33

Number of edges: 42

Phyla Correlation Network With 0.5 Threshold