University of North Carolina at Charlotte
College of Information Technology
Department of Computer Science

 


The grid virtualizes heterogeneous geographically disperse resources. From "Introduction to Grid Computing with Globus," IBM Redbooks
Grid Computing
Fall 2005
Tuesday/Thursday
11:00 am - 12:20 pm
NCREN room

UNC-C course number: 
ITCS 4010-001

Dr. Barry Wilkinson
University of North Carolina at Charlotte 
and 
Dr. Clayton Ferner
University of North Carolina at Wilmington

Figure due to Rajkumar Buyya, University of Melbourne

 

This course is taught from the University of North Carolina at Charlotte and University of North Carolina at Wilmington, and is broadcast on NC Research and Education Network (NCREN) to universities and colleges across the state.  It is currently received at Appalachian State University, Elon University, NC State University, University of North Carolina at Asheville, University of North Carolina, Chapel Hill, University of North Carolina at Charlotte, University of North Carolina at Pembroke, University of North Carolina at Wilmington, Western Carolina University, Winston-Salem State University, Lenoir Rhyne College, and Wake Technical Community College. The course is being developed with partial support from the National Science Foundation under grant DUE 0410667 (Course Curriculum and Laboratory Improvement Program), DUE 0533334  (additional funding), and two grants from the University of North Carolina Office of the President. The course was first broadcast in Fall 2004 (course home page).
This page is continually updated as the course proceeds. Watch for announcements. Modification date: Dec 21, 2005
Contents:
 
Announcements Lecture materials Assignments Tests Computing Environment

ANNOUNCEMENTS
 

Previous announcements

Top


Question-and-Answer from discussions in and out of class

Lecture Materials

The following slides are provided as Powerpoint slides.  You may wish to print these sides out as 1 x 2 or 2 x 3 thumbnails. Do not use slides until shown as "ready" in the ready column (generally one or two days before the class).
 
Lecture slides (Powerpoint format)
Wk Date
Slides
Number of slides Ready
Topics
1 Aug. 23, 2005 outline 32 Yes Course outline, prerequisites, course text,  course contents, assessment, instructor details.
1 Aug 23, 2005 assignprelim 17 Yes Important information regarding computer systems to use, set-up procedures, and submission of assignments.
1 Aug. 23/25, 2005 slides1 41 Yes Grid computing, virtual organizations, computational grid projects, grid computing networks, grid computing infrastructure, history of Globus Toolkit.
1 Aug 25, 2005 slides2 47 Yes Basic Internet technologies (review) , IP addresses, Telnet, FTP, HTTP, SSL, URL, HTML, XML.
2 Aug 25/30, 2005 slides3a 67 Yes Web Services I.  Service-Oriented Architecture (SOA), service registry, XML documents, XML schema, namespaces,  SOAP, XML/SOAP examples, Axis
2 Sept 1, 2005 slides3b 52 Yes Web Services II. WSDL, portType, message definition, WSDL to/from code
2 Sept 6, 2005 slidesA1 28 Yes Assignment 1 "Simple" Web service Java programming assignment. Tomcat environment,  axis, JWS facility, 
3 Sept 6, 2005 slides3c 14 Yes Elements of a WSDL document. More detail.
3 Sept 6, 2005 slides3d 17 Yes More on XML. XML schema definition language, XSD.
3 Sept 6, 2005 slides4a 12 Yes Grid computing standards, Open Grid Services Architecture (OGSA),  Web Services Resource Framework (WSRF)
3 Sept. 8, 2005


End-to-End discussion and demonstration by Mark Holliday
4 Sept 13, 2005  slides4b
28
Yes Components of Globus 4.0: - Basic structure, brief description of main services and components, common runtime, GT4 core, security, execution management, data management, information services.
4 Sept 13/15, 2005 slides4c 42 Yes Web Service Resource Framework: Creating Globus 4 Globus 4.0 services
4 Sept 15, 2005 slidesA2 27 Yes Assignment 2: "Simple" grid service Java programming assignment. Globus 4.0 environment.
5 Sept. 20, 2005 slides4d 35 Yes Notes on Assignment 2a: StickyNote Tutorial, GT4 index services, notifications.
5/6 Sept 22, 2005 slides5a 80 Yes Security, secure connection, authentication and authorization, password authentication, data confidentiality symmetric and asymmetric (public/private) key cyptography, RSA algorithm, non-repudiation, double encryption, digital signatures, certificates, certificate authorities, X509 certificate, Public Key Infrastructure (PKI), security protocols, SSI algorithm.
6 Sept 27/29, 2005 slides5b 66 Yes Grid Computing Security, Globus Security Infrastructure (GSI), authentication, certificates, certificate authorities, Certificate Authority for grid computing, simple CA, multiple CAs, getting a certificate, mutual authentication, authorization, gridmap file, Community Authorization Service (CAS), delegation, proxy certificates, chain of trust, MyProxy, summary of GSI components
7 Oct 4, 2005 slides6a 57 Yes Globus: - Job submission, Resource management, Globus Resource Allocation Manager (GRAM), GT 2, GT3, GT4 commands, Resource Specification Language (RSL and RSL-2), input/output, syntax and examples.
7  Oct 6, 2005 slidesA3 32 Yes Assignment 3: Submitting a GT 4 Job.  Also a extra part particularly for graduate students but for others for extra credit. Appears easy, but impossible or very difficult to do (Good Will Hunting).
7 Oct 6, 2005


Brief review for WebCT quiz 1
8 Oct 13, 2005 slides6d 70 Yes Schedulers and resource brokers, Condor, types of jobs, job submission, ClassAd, DAGMan, Condor-G.
9 Oct 18, 2005 slides
Yes Presentation by James Ruff, Western Carolina University. Sun Grid Engine and Assignment 4.
Assignment 4: Submitting an SGE Job
9 Oct 20, 2005 slides11 47 Yes Grid portals, purpose, application-based portals, historical examples, GPDK, Gridport, Hotpage, NCSA Alliance portal, DOE Fusion Grid portal, etc., portal implementation, portlets, JSR 168, OGCE portal

10
Oct 25, 2005 slides (ppt)
Yes GridNexus UNCW GUI for Workflow Management (www.gridnexus.org). Presented by Clayton Ferner
10 Oct 27, 2005 jxpl-intro
Yes Implementation of GridNexus, JXPL. Presented by Clayton Ferner.





Assignment 5: UNCC-W workflow assignment
11 Nov 1/3, 2005 slides12 137 Yes Introduction to message passing programming, MPI, Grid-enabled MPI, MPI-G2 internals, mpirun command, RSL script, Parallel programming, techniques suitable for a Grid, embarrassingly parallel computations, Monte Carlo, parameter studies





Current state-of-the-art applications, ... to be covered by expert guest speakers.
12 Nov 8, 2005 slides
Yes Presentation by Johnny Hopkins UNC-C graduate student: "Grids And Gaming: Developing MMOGs (Massively Multiplayer Online Games) on the Grid"
12 Nov 10, 2005 slides13 54 Yes Review of applications, "assignment 6"
13 Nov 15, 2005


Guest speaker, Jeff Schmitt, genesismolecular.com
13 Nov 17, 2005


Discussion, student slides, etc.
14 Tues, Nov 22, 2005 slides
Yes "Development and Implementation of an Inter-Institutional Multi-purpose Grid,"  Jim Jokl, University of Virginia, Art Vandenberg, Georgia State University, Mary Fran Yafchak, SURA.
15 Tues. Nov. 29, 2005 slides
Yes "Leveraging the Grid: Application Perspective, "Lavanya Ramakrishnan, The Renaissance Computing Institute (RENCI), University of North Carolina at Chapel Hill, North Carolina State University, and Duke University
15 Thurs. Dec, 1st, 2005


Last class -- wrap-up, course evaluation.

 


The following gave presentations in the Fall 2004 class:


slides
Yes Taped presentation "The Grid: Beyond the Hype," by Ian Foster, Argonne National Laboratory and University of Chicago, originally given at Duke University, Sept. 14th, 2004

Nov 16, 2004 slides
Yes Guest speaker, Wolfgang Gentzsch, Mangaing Director, MCNC Grid Computing and Networking Services.  Title of presentation "Grid Computing in the Industry"

Nov. 18, 2004


Presentation by Sammie Carter, NCSU, "Wolfgrid: the ncsu community supercomputer and Datamation Sort using OpenMP and MPI."

Nov. 23, 2004


Guest speaker: Professor Daniel A. Reed, Chancellor's Eminent Professor, Director of Institute for Renaissance Computing, University of North Carolina at Chapel Hill, Duke University, and  NC State University. 

Nov 30, 2004 slides
Yes Guest speaker: Chuck Kesler, Director, Grid Deployment and Data Center Services, MCNC.  Tentative title of presentation: "Security Policy, Legal, and Regulatory Challenges in Grid Computing 
Environments."

Course text

A specific textbook is not assigned for the course.  A lot of materials can be found on-line.

Reading/on-line materials


Assignments
 
 
Date set Date to report system problems Assignment Ready Topic Date due Presentation slides
Sept 1, 2005 Sept 6, 2005 Assignment 1 Yes Web service Sept 15, 2005 Assignment 1
Sept 15, 2005 Sept 20, 2005 Assignment 2 Yes Grid service Sept. 27, 2005 Assignment 2
Optional
Assignment 2a Yes Sticky note services
Assignment 2a
Oct 4, 2005 Oct 6, 2005 Assignment 3 Yes Submitting Job to Grid Oct 18, 2005 Assignment 3
Oct 18, 2005 Oct 20, 2005 Assignment 4 Yes Using Sun Grid Engine to submit a Job to the Grid Nov 1, 2005 Assignment 4a
Nov 1, 2005 Nov 3, 2005 Assignment 5 Yes UNC-W workflow assignment Nov 15, 2005
Nov 10, 2005
Assignment 6 Yes Find an interesting grid application. Nov 17, 2005 (firm)
Top


Tests

Class tests:



Class Test 1 -- on WebCT: Date: Anytime between Tuesday 11:55 pm Oct 4, 2005 and Wednesday 11:55 pm Oct 12, 2005.
Review:

Topics for test 1: Slides up to and including slides6a, assignments 1, 2, and 3.



Class Test 2 -- On WebCT: Date: Anytime between 12 noon Tuesday Nov 15, 2005 and 11:55 pm Wednesday Nov 22, 2005.

Topics for test 2: Slides from slides6d to slides 12 inclusive, including, schedulers Sun Grid Engine assignment, portals, workflow, GridNexus assignment 5, and MPI.



Final Exam Date: On WebCT: To be posted and taken anytime between Monday Dec 5th, 2005 (8:00 am) and Wednesday Dec 7th, 2005 (11:55 pm).

UNC-C scheduled final exam is 12:00 pm - 3:00 pm, Tuesday Dec 13, 2005, but the final will be a WebCT exam.

Topics: Comprehensive (40 questions, similar in format as previous WebCT tests, 120 minutes).

Top


Computing Environment

Ideally, students will use local computer equipment if required software installed.  Otherwise, they will be given accounts on an MCNC system to access remotely.  All software can be obtained free and downloaded.

Our installation documentation (includes list of software and version numbers):

Installation Guide for Globus 4.0, Condor-G, and Sun Grid Engine by J. Ruff

Top