Datenmanagement am DKRZ. Hannes Thiemann Deutsches Klimarechenzentrum GmbH

Größe: px

Ab Seite anzeigen:

Download "Datenmanagement am DKRZ. Hannes Thiemann Deutsches Klimarechenzentrum GmbH"

Barbara Albert
vor 6 Jahren
Abrufe

1 Datenmanagement am DKRZ Hannes Thiemann Deutsches Klimarechenzentrum GmbH

2 In a nutshell Was ist das DKRZ? Was tun unsere Kunden? Was bieten wir unseren Kunden Datenmanagement Ausblick 2

3 Deutsches Klimarechenzentrum GmbH DKRZ to provide high performance computing platforms, sophisticated and high capacity data management, and superior service for premium climate science. DKRZ to provide a unique combination of world class computer power and expert personnel to enable superior climate modelling. 3

4 Modellbetreuung Modelle und Daten Datenmanagement 4

5 Shareholders of the DKRZ GmbH Max Planck Gesellschaft (MPG) Freie und Hansestadt Hamburg, vertreten durch die Universität (Uni HH) Alfred Wegener Institut für Polar und Meeresforschung (AWI) Helmholtz Zentrum Geesthacht (HZG) 5

6 Das Forschungsobjekt Das Klimasystem Verständnis von Wetter und Klima Klimavariabilität 7

7 Das Forschungsobjekt Das Klimasystem Verständnis von Wetter und Klima Klimavariabilität und Abschätzung von menschlichen Einflüssen 8

8 Klimasystem 9

9 Modell der Atmosphäre Gleichungen, die das Verhalten von Flüssigkeiten und Gasen beschreiben Erhaltungssätze (Impuls, Energie, Masse) Strahlung Randbedingungen (Erdgeometrie, Bahnparameter, Land Meer Verteilung, ) 11

10 Modell der Atmosphäre Gleichungen nicht direkt lösbar... 12

11 Modell der Atmosphäre... aber näherungsweise Lösung über iteratives Verfahren auf 3D Rechengitter 13

12 Modell Auflösung 14

13 Modell Auflösung 10-fache Rechenzeit! 15

14 Modell Auflösung 16

15 Compute Service IBM "Power6 (mit 264 Knoten) je 16 DualCore CPUs gesamt 8448 Cores Peak Performance ~ 19 GFlops/Core > 158 TeraFlops Memory insgesamt 20 TByte 7 Pbyte GPFS-Plattenspeichersystem Infiniband-Netzwerk mit 7.6 TB/sec 17

16 Entwicklung der Rechenleistung am DKRZ

17 Modell Auflösung 19

18 Modell Auflösung 10-fache Rechenzeit! >6-fache Datenmenge! 20

19 Datenmengen Horizontalauflösung des Klimamodells T42: 128 * 64 = 8192 Punkte pro Globalfeld T106: 160 * 320 = Punkte pro Globalfeld Erforderliche Speichereinheiten (GRIB Format) Horizontalfeld (Zugriffseinheit): 17.1 kb (T42) kb (T106) Unix Filegröße für monatsweise akkumulierte Ergebnisse mit 6 Std. Speicherintervall und 300 2d Variablen (Physikalische Einheit): 616 MB (T42) 3500 MB (T106) 240 Jahre Modellintegration (Logische Einheit): 1.7 TB (T42) 10 TB (T106)

20 CMIP5 Coupled Model Intercomparison Project Set of coordinated climate model experiments Generates input for Intergovernmental Panel on Climate Change, Fifth Assessment Report Approx. 50 Experiments 20 modelling centres Output will be close to 10 PetaBytes 22

21 Disksubsystem 7 Pbyte GPFS-Plattenspeichersystem 23

HSM System HPSS (High Performance Storage System) 7 robot-operated silos with a total of 67.

22 HSM System HPSS (High Performance Storage System) 7 robot-operated silos with a total of cartridges 78 tape drives primary capacity of >100 PetaByte average bandwidth 3 GigaByte/s (up to 5 GigaByte/s ) 500 GB disk cache 25

23 DKRZ archive over time 26

24 Data generation Data retrieval Data transport Data Life Cycle Management Data archival Data curation Data storage 28

25 Data Services Creation Evaluation Archiving Dissemination HLRE optimisation Consortial runs Data processing Visualisation Data sharing Quality control Data documentation Long term archiving Scientific data publication Bit stream preservation Data curation GUI based catalogue and data access API based direct data access Data federations 29

26 Long Term Archiving Long term archiving is requested by the founding agencies in the context of Rules for Good Scientific Practice and a prerequisite to enable future research activities. Storage period of at least 10 years Web based access Data consistency Collection and maintenance of metadata 30

27 Data documentation Reference Status Distribution Contact Coverage Entry Parameter Local Adm. Data Org Data Access Spatial Reference 31

28 Bit stream preservation Number of copies Independence of copies Geographically Organisational Technological Error frequency of copies Integrity checks 32

29 Bit stream preservation Number of copies Single copy for scratch data, raid 5 or raid 6 protected Single copy for short term tape data Dual copy for archival data (tape) 33

30 Bit stream preservation Independence of tape copies Technological: Distinct tape drives and tape media Technological: Distinct tape libraries Geographically: Place copies in different fire compartments Organisational:? 34

31 Bit stream preservation Data integrity No cksums for scratch and single copy tape data md5 cksums for dual copy tape data within LTA Two independent copies of cksum info Recheck data when changing tape media (in avg. every 3 years) 35

32 Bit stream preservation Error frequency Have a close look on media and error occurences 36

33 Data Services Creation Evaluation Archiving Dissemination HLRE optimisation Consortial runs Data processing Visualisation Data sharing Quality control Data documentation Long term archiving Scientific data publication Bit stream preservation Data curation GUI based catalogue and data access API based direct data access Data federations 37

34 Data curation Wikipedia: Digital curation is the selection, preservation, maintenance, collection and archiving of digital assets Digital Curation Blog: Data Curation comprises Data management Adding value to data Data sharing for re use Data preservation for later re use 38

35 Adding value to data Data documentation establish the context Assess the quality Make it usable Address the requirements of different user groups Address the conflict between data access and storage patterns 39

36 Container Most valuable data to be reprocessed to allow access of small granules. Granules are grouped in container files. 40

37 Container format Large amounts of data within each container file Huge variety of record sizes within a single file 64b 2 GB Efficient administration of all records Irregular access patterns Access latency independent of record number Only complete records to be read or written Read and write records within secure transactions Fault tolerant (disks, controller, tape) 41

38 Data Partitioning I Experiment Dataset Dataset Dataset Dataset Dataset Dataset Dataset Dataset Dataset Dataset Dataset Dataset Dataset Dataset Dataset Dataset Dataset Dataset Dataset Dataset 42

39 Data Partitioning II Dataset complete timeseries of single variable Container 1 st timerange Container 2 nd timerange Container 3 rd timerange 43

40 Data Partitioning III Container Header Index 2 dimensional field, single timestep 2 dimensional field, single timestep 2 dimensional field, single timestep 2 dimensional field, single timestep 2 dimensional field, single timestep 2 dimensional field, single timestep Index Header 44

41 Data Partitioning IV 2 dimensional field, single timestep Header Data Header 45

42 Data Services Creation Evaluation Archiving Dissemination HLRE optimisation Consortial runs Data processing Visualisation Data sharing Quality control Data documentation Long term archiving Scientific data publication Bit stream preservation Data curation GUI based catalogue and data access API based direct data access Data federations 46

43 Scientific data publication The process of scientific data publication makes scientific data available for use in scientific articles Data receives an accurate and persistent citation reference Data are not changeable any longer Research results are provable and reproducible 47

44 Data publication 48

45 Present Solution 158 TFLOS (with LINPACK) 20 Tbyte Memory 7 PB disk space 100 PB tape library 30 GB/s memory to disk 3 GB/s disk to tape Application to disk: too low 49

46 Future Solution: ExaFLOPS System announced for EFLOPS with LINPACK (x ) 32 PB main memory (x 1.000) 6 EB disk space ( TB disks) 100 EB tape library ( tapes) 30 TB/s memory to disk 3 TB/s disk to tape Application to disk:? Application to data Application to knowledge 50

47 CLM: Temperaturänderung 51

48 Vielen Dank! 52

Ähnliche Dokumente

DKRZ Datenhierarchie Von der Antragstellung bis zur Archivierung

DKRZ Datenhierarchie Von der Antragstellung bis zur Archivierung 07-May-2014 Hannes Thiemann Deutsches Klimarechenzentrum (DKRZ) Datenmanagement Antrag Ressourcen Archivierung + Zugriff Support LiveDemo