CARLETON UNIVERSITY

Department of Systems and Computer Engineering

SYSC 5807                Advanced Topics in Computer Systems                                  Winter 2016/17 (Resource Management on Distributed Systems)

 

Lecturer: Dr. Imran Ahmad,

 

email:imran@cloudanum.com

 

 

Link to Class Notes Folder

 

Link to Class Presentations

 

 

Important Dates:

1st April: Assignment #4 Due date

3rd April: In class Exam

 

Schedule of Class Presentations

 

 

 

List of Class Projects/Presentations

A- Security in Distributed Systems

B- Functional Programming and Distributed Computing 

C- How to move High Volume Data to HDFS?

D- How to stream High Velocity Data to HDFS?

E- One of the NoSQL Databases.

      a. MongoDB

      b. Neo4j

F- One of MapReduce Compilers.

        a- Pig

        b- HIve

        c- RHadoop

G- Real time Analysis in Twitter

H- Efficient Resource Allocation in Distributed Systems.

I-  Architecture of Apache Spark

J-How to download, configure and run a MapReduce program in a Cloudera VM?

K- Resource Allocation in Grid Computing

L- Distributed Computing in Java.

M- RESTFUL WebServices.

N- Different Types of Data and Suggested Processing Architectures

 

 

Course Objectives:

This course is concerned with resource management on distributed systems including clouds and grids: concepts, techniques, analysis, and performance. Topics of discussion will include:

_  Principles and techniques for management of resources in distributed systems including grids and clouds.

_  Management of: computing and storage resources; service level agreements

_  Techniques for: scheduling; allocation;

_  Dynamic resource provisioning;

_  Techniques for handling heterogeneity.

_  Cyber-physical systems and large data sets: sensor networks & resource management techniques for analysis of large data sets.

Basic concepts will be covered through formal lectures. A more informal discussion will take place for addressing current research issues. The students will work on (up to two/three) assignments that will further their understanding of the subject. Each student will take a deeper investigation of a specific topic and make a class presentation based on the available literature on the topic. The student has to complete a course project that is concerned with a research problem. The course also has an exam. This exam is for evaluation purposes only and will not be returned to the student.

 

Approximate Marking Scheme:

 

Assignments: 20%

Class Presentation: 15%

Project: 30%

Exam (in class): 35%

 

Prerequisites: Operating systems concepts (SYSC 4001 or equivalent) or Permission of the instructor

 

Academic Accommodations for Students

You may need special arrangements to meet your academic obligations during the term. For an accommodation request the processes are as follows:

 

Pregnancy obligation: write to me with any requests for academic accommodation during the first two weeks of class, or as soon as possible after the need for accommodation is known to exist. For more details visit the Equity Services website: http://www2.carleton.ca/equity/

 

Religious obligation: write to me with any requests for academic accommodation during the first two weeks of class, or as soon as possible after the need for accommodation is known to exist. For more details visit the Equity Services website: http://www2.carleton.ca/equity/

 

Academic Accommodations for Students with Disabilities: The Paul Menton Centre for Students with Disabilities (PMC) provides services to students with Learning Disabilities (LD), psychiatric/mental health disabilities, Attention Deficit Hyperactivity Disorder (ADHD), Autism Spectrum Disorders (ASD), chronic medical conditions, and impairments in mobility, hearing, and vision. If you have a disability requiring academic accommodations in this course, please contact PMC at 613-520- 6608 or pmc@carleton.ca for a formal evaluation. If you are already registered with the PMC, contact your PMC coordinator to send me your Letter of Accommodation at the beginning of the term, and no later than two weeks before the first in-class scheduled test or exam requiring accommodation (if applicable). After requesting accommodation from PMC, meet with me to ensure accommodation arrangements are made. Please consult the PMC website for the deadline to request accommodations for the formally-scheduled exam (if applicable) at http://www2.carleton.ca/pmc/new-and-current-students/dates-and-deadlines/

 

You can visit the Equity Services website to view the policies and to obtain more detailed information on academic accommodation at  http://www2.carleton.ca/equity/


Plagiarism: Plagiarism (copying and handing in for credit someone else's work) is a serious instructional offense that will not be tolerated. Please refer to the section on instructional offenses in the graduate Calendar for additional information.

 

 

 

NOTE: Classroom teaching and learning activities, including lectures, discussions, presentations, etc., by both instructors and students, are copy protected and remain the intellectual property

of their respective author(s). All course materials, including PowerPoint presentations, outlines, and other materials, are also protected by copyright and remain the intellectual property of their respective author(s).

 

Students registered in the course may take notes and make copies of course materials for their own educational use only. Students are not permitted to reproduce or distribute lecture notes

and course materials publicly for commercial or non-commercial purposes without express written consent from the copyright holder(s).