EECS 4101/5101, Summer 2023
EECS 4101/5101: Advanced Data Structures
Summer 2023
Web page contents:
General Information
Announcements
Important Dates
Resources
Reading
Course Handouts
General Information
Instructor: Eric Ruppert
Email: [my last name]@eecs.yorku.ca (Please use a York email account when sending me email, and start your subject line with "[4101]" or "[5101]".)
Lectures: Tuesdays 13:00-14:30 in Curtis Lecture Hall K and Thursdays 13:00-14:30 in Curtis Lecture Hall J.
Office Hours: Tuesdays 14:30-15:30 and Thursdays 10:30-11:30 in room 3052 of the Lassonde Building.
Learning Outcomes
In this course, you will be invited to develop your ability to think clearly and carefully about data structures and the algorithms that operate on them, and to improve your skills in expressing those thoughts about data structures in a precise way.
Data structures are a crucial component of most computer applications. Understanding them is a key ingredient for writing correct and efficient computer programmes.
By the end of this course, you will be able to do the following things.
-
Describe important classes of data structures (dictionaries, priority queues, disjoint set union) and explain how they work.
Before trying to design your own data structures, it is important to be aware of a good collection of classical ones. They are useful in their own right, but the ideas that underlie them are also useful for new data structures.
-
Augment data structures to expand their functionality.
If one of the standard data structures doesn't work for the task at hand, it is useful to be able to tweak an existing one to fit your purpose.
-
Analyze the efficiency of data structures, including the use of amortized analysis and online competitive analysis.
In many cases, there are multiple data structures that could be used to solve a problem. In some cases, it is important to be able to analyze the different options and choose the one that will solve the problem most efficiently. Amortized and competitive analysis are two special types of analysis that are useful in some settings.
-
Demonstrate knowledge of important themes in data structure design such as persistence, self-adjustment, concurrency.
This course is not just about going through a catalogue of data structures. Certain ideas can be applied in the construction of many different data structures, and we want to understand those concepts too. Persistence deals with maintaining multiple versions of stored data so that old versions can be accessed when needed. Self-adjustment is used instead of carefully rebalancing data structures to improve the shape of the data structure in response to the sequence of operations performed on it. Concurrent data structures allow multiple threads to access the data simultaneously.
-
Select or design appropriate data structures to help solve problems for algorithmic applications.
The ultimate goal is to ensure that you can find (or build) the right data structure for whatever task you want to solve. You should also be able to justify your design choices and explain why the algorithms that operate on the data structures are correct.
How to Learn This Material
Much of the material in this course is in the same vein as the material of EECS3101. To develop your understanding of the material, it is important to do more than just read the textbook and attend lectures: you must work through exercises.
You can often learn by struggling with problems. However, if you get too stuck or don't know how to begin, help is available. Talk to your classmates (however; see the notes below about academic honesty regarding discussing assignment problems with others). Use the office hours; the instructor is there to help you! You also learn by making mistakes and getting feedback about those mistakes. Just make sure that you use the feedback to improve your understanding.
Groups of students can learn a lot by explaining their solutions to the suggested exercises from the textbook to one another and critiquing the solutions of others. After all, learning how to explain solutions clearly is one of the goals of this course. Seeing where other students' solutions are unclear to you helps you make your own explanations clearer. Be aware that a problem may have many different correct solutions; just because someone's solution is different from yours doesn't necessarily mean that one of them is wrong.
It takes time to build new skills, so it helps if you work on exercises regularly: don't leave all the work to the days right before a test. Similarly, some of the homework assignments will be difficult to finish if you leave them to the last minute.
Academic Honesty
The key to academic honesty for this course is simply this: Solutions that you submit should be your own work.
Although you may discuss the general approach to solving a homework problem
with other people, you should not discuss the solution in detail.
You must not take any written notes away from such a discussion.
Also, you must list on the cover page of your solutions any
people with whom you have discussed the problems.
The solutions you hand in should be your own work. While
writing them, you may look at the course textbook and your own
lecture notes but no other outside sources.
It is not acceptable to try to find the answer to a homework question on the web, put it in your own words and submit it. You may learn a little by doing this, but you will learn much, much more by working on the problem yourself, and the purpose of this course is to help you learn how to design and analyze data structures on your own.
Furthermore, the web will not be available during your exam (or during your job interview at Google), so you should learn to solve problems yourself, instead of relying on others to do your thinking for you.
As time runs out, students are sometimes tempted to get help from other students on assignments in a way that would violate the preceding policy on academic honesty. DO NOT DO THIS! If you do, I will refer the case to the Dean's Office, which is unpleasant for everyone. The assignments are worth very little, so it is not worth risking a sizable punishment. (Furthermore, I have noticed that the students who cheat on the homework assignments almost always fail the tests and exams, so even if I do not catch you cheating, you will likely fail the course if you do not do your own work on the homework assignments.)
It is important that you look at the departmental
guidelines
on academic honesty.
Marking Scheme
| EECS4101 | EECS5101 |
Homework exercises | 20% | 20% |
Test 1 | 20% | 15% |
Test 2 | 20% | 15% |
Wikipedia assignment (EECS5101 only) | 0% | 10% |
Exam | 40% | 30% |
It's a very good idea to type your solutions to homework assignments, since it allows you to edit and polish the answers, but handwritten solutions are also acceptable, as long as they are legible. If you want to type your solutions, LaTeX produces elegantly typeset documents, is available for free, and was built to handle even the most complicated mathematical notation. It can take a while to learn how to use it, but once you do, you will probably not want to type documents any other way.
You should make every effort to make your answers as brief as possible, while still being thorough. Brevity requires careful thought and editing. (Pascal once excused himself for writing a long letter, saying that he did not have enough time to write a shorter one.) Students who write copious amounts usually do not know what they want to say, or are saying it in a very disorganized way.
Usually, an answer to a homework question should fit on one sheet of paper. If you are writing much more than that, you probably have not found the best way to solve it. On tests, your answer should usually fit into the space provided for it.
Announcements
- (Aug 15) 79.55% of the class completed the course evaluations. This is close enough to 80% that I will drop the lowest assignment grade when computing final grades.
- (Aug 14) The review session at 10am on Friday, August 18 will be in CLH K.
- (Aug 10) You may bring one 8.5x11-inch sheet of paper with handwritten notes on both sides to the final exam.
- (Aug 10) Next week, I will have office hours on Tue and Thu from 14:30-15:30 in my office, and a review session on Fri at 10:00 in CLH K.
- (Aug 10) If you want to learn more about concurrent data structures, you can take a look at the textbook by Herlihy et al. listed under Other References. The original paper on snapshot objects is here.
- (Aug 1) Please fill out a course evaluation
- (Jul 20) Due to popular demand, Assignment 8 is extended to July 24 at 10:00 p.m.
- (Jul 20) Test 2 will focus on material from the beginning of the Jun 15 lecture to the end of the July 20 lecture. You may bring one 8.5x11-inch sheet of paper with handwritten notes on both sides into the test.
- (Jul 20) You will be able to fill out course evaluations from July 31 to August 14. I find information from these evaluations useful, so please fill out an evaluation for this course. As an incentive, if 80% of the class fills them out, I will drop your lowest assignment grade when computing your final grade.
- (Jul 13) Due to popular demand, Assignment 7 is extended to July 17 at 10:00 p.m.
- (Jun 13) See minor correction to Assignment 4 at bottom of this page.
- (Jun 7) Test 1 will cover material up to the end of the Jun 13 lecture. You may bring one 8.5x11-inch sheet of paper with handwritten notes on one side into the test.
- (May 30) We have a better classroom for our lectures: Curtis Lecture Hall K on Tuesdays and hall J on Thursdays.
- (May 25) By popular demand, the deadline for Assignment 2 has been moved to Monday, May 29. See correction to Assignment 2 at bottom of this page.
- (May 11) The office of student accessibility services is looking for a volunteer to share class notes from EECS4101. This is a good way to help out fellow students and get volunteer experience. Please see this link for more information.
Important Dates
First class | Tuesday, September 9 |
Reading week #1 (no classes) | May 27-June 2 |
Test 1 | Tuesday, June 20 |
Reading week #2 (no classes) | June 27-July 2 |
Last date to drop course without receiving a grade | Friday, July 7 |
Test 2 | Thursday, July 27 |
Last class | Thursday, August 10 |
Last date to withdraw from course (receiving W on transcript) | Tuesday, August 15 |
Exam period | August 17-24 |
Resources
Textbook
- Thomas H. Cormen, Charles E. Leiserson, Ronald L. Rivest and
Clifford Stein, Introduction to Algorithms, 4th edition,
MIT Press & McGraw-Hill, 2022. For solutions to some of the textbook's exercises and known bugs in the text, see the textbook's web page.
You can access an electronic version of the textbook through the York Library website.
If you have the older third edition of the book, that's fine.
Other References
- Peter Brass, Advanced Data Structures, Cambridge University Press, 2008. Available online through York library.
- Ronald L. Graham, Donald E. Knuth, and Oren Patashnik, Concrete
Mathematics: A Foundation for Computer Science (2nd edition),
Addison-Wesley, 1994.
- Maurice Herlihy, Nir Shavit, Victor Luchangco and Michael Spear, The Art of Multiprocessor Programming, 2nd edition, Morgan Kaufmann, 2020. Includes material on concurrent data structures. An earlier edition is available online through the York Library.
- Pat Morin, Open data structures.
- Gonzalo Navarro, Compact Data Structures, Cambridge University Press, 2016.
- Hanan Samet, Foundations of Multidimensional and Metric Data Structures, Elsevier/Morgan Kaufmann, 2006.
- Clifford A. Shaffer, Data Structures and Algorithm Analysis, edition 3.2.0.10, 2013.
- Daniel Solow, How to Read and Do Proofs (6th edition), Wiley, 2013.
Other Tools
Reading
This section will be filled in as the term progresses. To get an idea of what will be covered, see the course page for last fall (there may be some minor variations from that list of topics).
Don't fall behind with your reading.
Date | Topics | Reading in CLRS (4th ed) | Suggested questions, mostly from CLRS (4th ed) | Equivalent reading in CLRS (3rd ed) | Equivalent questions in CLRS (3rd ed) |
May 9 |
Introduction |
partial notes |
|
|
|
May 11 |
Aggregate Method of Amortized Analysis |
16.1 |
16.1-1 to 16.1-3, 16-2 |
17.1 |
17.1-1 to 17.1-3, 17-2 |
May 16 |
Accounting Method |
16.2 |
16.2-1 to 16.2-3 |
17.2 |
17.2-1 to 17.2-3 |
May 18 |
Potential Method |
16.3 |
16.3-1 to 16.3-6 |
17.3 |
17.3-1 to 17.3-7 |
May 23 |
Dynamically sized tables, including eager doubling/halving (not in text) |
16.4 |
16.4-4 |
17.4 |
17.4-3 |
May 25, Jun 6 |
Binomial Heaps |
Chapter 19 of 2nd edition |
from this link: 19.1-2, 19.2-1 to 19.2-4 |
|
|
Jun 6-13 |
Fibonacci Heaps |
19 in removed material |
from removed chapter: 19-2, 19.2-1, 19.3-2, 19.4-1, 19.4-2, 19-3 |
19.0 |
19-2, 19.2-1, 19.3-2, 19.4-1, 19.4-2, 19-3 |
Jun 13 |
Binary Search Trees (quick review from EECS2011) |
12.1-12.3 |
12.1-3, 12.1-5, 12.2-4, 12.2-7, 12.3-3, 12-2 |
12.1-12.3 |
12.1-3, 12.1-5, 12.2-4, 12.2-7, 12.3-3, 12-2 |
Jun 15 |
Random BSTs |
12.4 in removed material (Randomly Built BSTs) |
12.4-2, 12.4-3, 12-3 |
12.4 |
12.4-2, 12.4-3, 12-3 |
Jun 22 |
Red Black Trees |
13 |
13.1-4, 13.1-6, 13.1-7, 13.1-8, 13.2-4, 13.3-2, 13.3-3, 13.4-4, 13.4-7, 13.4-8, 13.4-9, 13-3 |
13 |
13.1-4, 13.1-6, 13.1-7, 13.2-4, 13.3-2, 13.3-3, 13.4-3, 13.4-6, 13.4-7, 13-3, 13-4, 17-4 |
Jul 4 |
Augmenting Data Structures |
17 |
17.1-3, 17.1-5, 17.2-1, 17.2-2, 17.2-3, 17.3-5, 17-1, 17-2, 16-3 |
14 |
14.1-3, 14.1-5, 14.2-1, 14.2-2, 14.2-3, 14.2-4, 14.3-6, 14-2, 17-3 |
Jul 6 |
B-Trees |
18 |
18.1-2, 18.1-3, 18.1-4, 18.2-1, 18.2-6, 18-1 |
18 |
18.1-2, 18.1-3, 18.1-4, 18.2-1, 18.2-6, 18-1 |
Jul 13 |
Hashing |
review 11.1 and 11.2; read 11.3; read old Section 11.5 from removed material (Perfect Hashing) |
11.1-1, 11.2-2, 11.2-5, 11.1-4, 11.3-1, 11-4
|
review 11.1 and 11.2; read 11.3, 11.5 |
11.1-4, 11.3-1, 11-4 |
Jul 25 |
Bloom Filters (briefly) |
not in text |
|
|
|
Jul 25 |
Union-Find Data Structures |
19 |
19.2-1, 19.3-1, 19.3-2, 19.3-3, 19.3-4, 19.3-5, 19-1, 19-2, 19-3 |
21 |
21.2-1, 21.3-1, 21.3-2, 21.3-3, 21.3-4, 21.3-5, 21-1, 21-2, 21-3 |
Aug 8 |
Lock-free data structures |
Some slides (we won't cover all of them) |
|
|
|
Course Handouts
- Prerequisite material
- Assignment 1
- Assignment 2 Revised deadline: May 29, 10pm. Correction: part (f)(ii), "line 11" should be "line 10". Clarification: Each array should be full (i.e., each array should contain 2^k elements of the set for some k).
- Assignment 3
- Sample tests from a previous year: Test 1, Test 2 (and hints for solutions), Exam
- Assignment 4
This version includes a correction to line 30 and 33 of the pseudocode to detach the root next from the root list (updated June 13).
- Assignment 5 -- the TA pointed out that there was some confusion in the solutions I handed out: the root should be the element with the minimum priority, not the maximum priority.
- Assignment 6
- Assignment 7 -- deadline extended to Monday, July 17 at 10:00 p.m.
- Assignment 8 -- deadline extended to Monday, July 24 at 10:00 p.m.
- Assignment 9
- Assignment 10 (last one!) -- a typo in Q2(b)(i) and 2(b)(ii) has been corrected, and the deadline extended to Monday, August 14.

Updated August 15, 2023