Accounting am LRZ Accounting in DEISA Anton Frank 14.3.2008 Anton Frank Accounting-Workshop
Leibniz-Rechenzentrum Bayerische Akademie der Wiss. IT-Dienste für Münchner Univ. Münchner Wissenschaftsnetz Nationales Höchstleistungsrechenzentrum Anton Frank LRZ / DEISA Accounting-Workshop
LRZ im D-Grid!DGI-1 Support und Packaging Globus Toolkit Aufbau Kern-D-Grid Monitoring und Accounting!DGI-2 Support und Packaging Globus Toolkit Betrieb zentraler Dienste (MDS, myproxy)! User-Environment, INCA Anton Frank LRZ / DEISA Accounting-Workshop
LRZ im D-Grid!IVOM Integriertes VO-Management!D-MON Middleware-übergreifendes Monitoring!AstroGrid-D assoziierter Partner!HEP-Grid assoziierter Partner Anton Frank LRZ / DEISA Accounting-Workshop
Rechenzeitvergabe Wissenschaftler stellt Projektantrag!Beschreibung des Projekts!Art und Umfang der Berechnungen Entscheidung!Steuerungsausschuss mit Gutachtern!Festlegung des Kontingents Eintrag in Benutzerverwaltung Anton Frank LRZ / DEISA Accounting-Workshop
Accounting am LRZ Ressource:!CPUh (CPU time)!!hlrb II: Shared Memory Architektur CPUh auch wenn nur Memory benötigt Batch Scheduler!HLRB II PBSpro!Linux-Cluster (incl. Sonderinvestitionen)! SGE6 Anton Frank LRZ / DEISA Accounting-Workshop
Datensammlung/Budgeting Sammlung der Daten!MySQL-Datenbank!SGE-Format Projekt-Budgeting (kein Pricing/Billing)!!Benutzerverwaltung Vergleich mit zugewiesenen Kontingenten Rückmeldung an Batchsystem!HLRB II: Blockierung, wenn Budget ausgeschöpft ist Anton Frank LRZ / DEISA Accounting-Workshop
Datenformat Anton Frank LRZ / DEISA Accounting-Workshop
Quotas/Statistiken Andere Ressourcen!Plattenplatz $HOME / $PROJECT: Quota $SCRATCH / $OPT_TMP: Gleitlöschung!Archiv/Backup: nach Anforderung!Netzwerke: kein Accounting Statistiken!Performance, Forschung, Herkunft, etc.!wichtig für Kontrolle und Rechtfertigung Anton Frank LRZ / DEISA Accounting-Workshop
GRID Accounting! in the EU-Project DEISA" Sascha Haupt! sascha.haupt@lrz-muenchen.de! 30. May 2007!
The EU-Project DEISA! DEISA = Distributed European Infrastructure for Supercomputing Applications! 11 Partners from 7 EU-Countries!! National supercomputing centres! Main objectives!! To deploy and operate a persistent, " production quality, distributed " supercomputing environment " with continental scope!! To enable scientific discovery " across a broad spectrum of " science and technology. Scientific " impact (enabling new science) is " the only criterion for success!
Requirements! Requirements for an accounting system in the DEISA Project:! Considering the Infrastructure!! Heterogeneous architectures with different profiles!! Different operation models (reservation, batch queues,...)! Sites control acces s to their accounting information, generated on their own site! No central site which can access all accounting information! Restricted access to a ccounting information for other sites, users and project leaders! Secure authentication, authorization and data transfer! 30. May 2007! 3!
Rechenzeit-Standardisierung! Heterogene Architekturen!! IBM Power5/6, BlueGene!! SGI Altix (SMP-System)!! NEC SX8 (Vector-System)!! Cray!! Hector (Accelerators)! Application Benchmark erzeugt Normalisierungsfaktoren!! Astro-/Plasma-/HE-Physik, Molekulardynami, Klima, CFD, etc.!! möglichst gute Abbildung einer durchschnittlichen Nutzung!! keine Berücksichtigung der Investitionen und Betriebskosten! Vergabe von Kontingenten in normalisierten CPUh!! Mapping bei Zuweisung, Abrechnung, Abfrage! 30. May 2007! 4!
DEISA accounting system (1)! Site accounting Import into local accounting system Site B DB DB Site A User Retrieves usage records DB Site C 30. May 2007! 5!
DEISA accounting system (2)! Distributed system / no central database! HTTP based communication (WSRF/CGI)! Standard OGF UR-WG Usage Record format (XML)! Secure communication channels (SS"TLS)! SSL Mutual Authentication!! Server and Client Authentication!! X509 Certificates!! Public Key Infrastructure (PKI)! Role based access (4 Roles):!! DEISA User!! DEISA Project!! DEISA Site!! DEISA Supervisor (limited circle of persons, only)! 30. May 2007! 6!
DEISA accounting system (3)! Batch System LDAP User Administration Relational Database - optional - RDB AcctDataProvider Generates OGF UR-WG Usage Records. XML Database (exist)! Stores Usage Records XMLDB XML OGF UR-WG XML OGF UR-WG XML OGF UR-WG Internet / Users Accounting CGI Script Provide Usage Records To the Users DEISA Accounting Report Tool Users can generate an report using the DART client. 30. May 2007! 7!
Usage Records! Sample of a Usage Record used by DEISA:! <ur:usage> <ur:recordidentity ur:recordid= LRZ-46f19676353b286ddc0d36d35cea9c03d7eb37" ur:createtime="2007-04-19t08:48:45.055z"/> <ur:jobidentity> <ur:globaljobid>lrz-2224</ur:globaljobid> <ur:localjobid>2224</ur:localjobid> </ur:jobidentity> <ur:useridentity> <ur:localuserid>sar00015</ur:localuserid> <xd:keyinfo> <xd:keyname>sar00015</xd:keyname> <xd:x509data> <xd:x509subjectname>cn=sascha Haupt,OU=Leibniz-Rechenzentrum,O=GridGermany,C=DE</xd:X509SubjectName> </xd:x509data> </xd:keyinfo> </ur:useridentity> <ur:status>completed</ur:status> <ur:starttime>2007-04-18t09:05:20.000z</ur:starttime> <ur:endtime>2007-04-18t09:05:38.000z</ur:endtime> <ur:wallduration>pt18s</ur:wallduration> <ur:cpuduration>pt15.542s</ur:cpuduration> <ur:machinename>hlrb II</ur:MachineName> <ur:host ur:primary="true">a5</ur:host> <ur:submithost>a1</ur:submithost> <ur:projectname>staff</ur:projectname> <ur:processors>128</ur:processors> <acct:submittime>2007-04-18t09:05:16.000z</acct:submittime> </ur:usage> 30. May 2007! 8!
Authorization! Authorization Roles: User, Project, Site and Supervisor! Account information (X509, UID, ) stored in LDAP directory! Accounting servers use accounting gridmapfile for authorization! Mapfile is generated by a script (LDAP->mapfile)! Possibility to add permissions directly by hand! Sample accounting gridmapfile:! "/O=dutchgrid/O=users/O=sara/CN=UserA" site-sara "/O=dutchgrid/O=users/O=sara/CN=UserA" project-testproject "/O=dutchgrid/O=users/O=sara/CN=UserA" user-sar0000a "/O=dutchgrid/O=users/O=sara/CN=UserB" user-sar0000b "/C=DE/O=GridGermany/OU=Leibniz-Rechenzentrum/CN=UserC" user-lrz0000c "/C=DE/O=GridGermany/OU=Leibniz-Rechenzentrum/CN=UserC" site-lrz 30. May 2007! 9!
Advantages and Drawbacks! Advantages of the DEISA accounting system:! Standardized protocols and XML schema! No central database / each site has its own XML database! Authorized access! Independent of used Middleware! Open Source" (Apache HTTP Server, Globus Toolkit, exist DB, Java, PERL)! Current drawbacks:! All records are transferred to the client for report generation!! does not scale well!! aggregates planned (necessary also for privacy reasons)! Incomplete reports if a site is not reachable!! notification and replication required (also for documentation)! No feedback to batch systems! 30. May 2007! 10!
DEISA Accounting Report Tool! Java 1.5 program " => can be used on mostly all platforms" => Unicore also uses Java 1.5 (installation of Java 6 not required)! Uses Java Webstart Technology" => automatic update of the client (important because the URLs" of the accounting servers can change)! User-friendly design" GUI: Java Swing! Possibility to access different data sources! Total period and monthly statistic view! Possibility to export data" (into a semicolon separated ASCII file and " via Copy & Paste to OpenOffice Calc or Excel)! 30. May 2007! 11!
DART Homepage! Java Webstart users receive configuration updates automatically 30. May 2007! 12!
Report configuration! 30. May 2007! 13!
Report screen! 30. May 2007! 14!
Thank you!! Questions?! 30. May 2007! 15!