###Regular Expressions, Dictionary, Writing to CSV File
This question has multiple parts, and will take 20+ hours to complete, depending on your python proficiency level. Knowing these skills will be extremely beneficial during the first few weeks of the bootcamp.
For Part 1, use of regular expressions is optional. Work can be completed using a programming approach of your preference.
The data file represents the Biostats Faculty List at University of Pennsylvania
This data is available in this file: faculty.csv
###Part I - Regular Expressions
####Q1. Find how many different degrees there are, and their frequencies: Ex: PhD, ScD, MD, MPH, BSEd, MS, JD, etc.
I isolated degrees by looking in the 'degree' column, and then splitting the contents by spaces. Then I converted each degree to lower case and removed periods to compare the letter sequences. Then I linked these unique strings back to their original formatting, and counted the most common format.
I found 9 unique space-sepearated character combinations in the 'degrees' column. They are shown below with their counts.
Degree | Count --- | --- MD | 1 MA | 1 Sc.D. | 6 B.S.Ed. | 1 Ph.D. | 31 MPH | 2 M.S. | 2 JD | 1
I excluded degrees which did not consist of letters and periods. There is one such entry in the CSV ("0") belonging to my good friend Taki "Russell" Shinohara. Also, the number of degrees does not match the number of people because some people have multiple degrees.
####Q2. Find how many different titles there are, and their frequencies: Ex: Assistant Professor, Professor
I found three unique titles. Here they are, with their frequency:
Title | Count --- | --- Assistant Professor | 12 Professor | 13 Associate Professor | 12
####Q3. Search for email addresses and put them in a list. Print the list of email addresses.
['bellamys@mail.med.upenn.edu', 'warren@upenn.edu', 'bryanma@upenn.edu', 'jinboche@upenn.edu', 'sellenbe@upenn.edu', 'jellenbe@mail.med.upenn.edu', 'ruifeng@upenn.edu', 'bcfrench@mail.med.upenn.edu', 'pgimotty@upenn.edu', 'wguo@mail.med.upenn.edu', 'hsu9@mail.med.upenn.edu', 'rhubb@mail.med.upenn.edu', 'whwang@mail.med.upenn.edu', 'mjoffe@mail.med.upenn.edu', 'jrlandis@mail.med.upenn.edu', 'liy3@email.chop.edu', 'mingyao@mail.med.upenn.edu', 'hongzhe@upenn.edu', 'rlocalio@upenn.edu', 'nanditam@mail.med.upenn.edu', 'knashawn@mail.med.upenn.edu', 'propert@mail.med.upenn.edu', 'mputt@mail.med.upenn.edu', 'sratclif@upenn.edu', 'michross@upenn.edu', 'jaroy@mail.med.upenn.edu', 'msammel@cceb.med.upenn.edu', 'shawp@upenn.edu', 'rshi@mail.med.upenn.edu', 'hshou@mail.med.upenn.edu', 'jshults@mail.med.upenn.edu', 'alisaste@mail.med.upenn.edu', 'atroxel@mail.med.upenn.edu', 'rxiao@mail.med.upenn.edu', 'sxie@mail.med.upenn.edu', 'dxie@upenn.edu', 'weiyang@mail.med.upenn.edu']
####Q4. Find how many different email domains there are (Ex: mail.med.upenn.edu, upenn.edu, email.chop.edu, etc.). Print the list of unique email domains.
There are 4 unique domains:
Domain | Count --- | --- email.chop.edu | 1 upenn.edu | 12 cceb.med.upenn.edu | 1 mail.med.upenn.edu | 23
Place your code in this file: advanced_python_regex.py
###Part II - Write to CSV File
####Q5. Write email addresses from Part I to csv file
Place your code in this file: advanced_python_csv.py
The emails.csv file you create should be added and committed to your forked repository.
Your file, emails.csv, will look like this:
bellamys@mail.med.upenn.edu
warren@upenn.edu
bryanma@upenn.edu
####Q6. Create a dictionary in the below format:
faculty_dict = { 'Ellenberg': [['Ph.D.', 'Professor', 'sellenbe@upenn.edu'], ['Ph.D.', 'Professor', 'jellenbe@mail.med.upenn.edu']],
'Li': [['Ph.D.', 'Assistant Professor', 'liy3@email.chop.edu'], ['Ph.D.', 'Associate Professor', 'mingyao@mail.med.upenn.edu'], ['Ph.D.', 'Professor', 'hongzhe@upenn.edu']]}
Print the first 3 key and value pairs of the dictionary:
Putt: [['PhD ScD', 'Professor', 'mputt@mail.med.upenn.edu']]
Feng: [['Ph.D', 'Assistant Professor', 'ruifeng@upenn.edu']]
Bilker: [['Ph.D.', 'Professor', 'warren@upenn.edu']]
####Q7. The previous dictionary does not have the best design for keys. Create a new dictionary with keys as:
professor_dict = {('Susan', 'Ellenberg'): ['Ph.D.', 'Professor', 'sellenbe@upenn.edu'], ('Jonas', 'Ellenberg'): ['Ph.D.', 'Professor', 'jellenbe@mail.med.upenn.edu'], ('Yimei', 'Li'): ['Ph.D.', 'Assistant Professor', 'liy3@email.chop.edu'], ('Mingyao','Li'): ['Ph.D.', 'Associate Professor', 'mingyao@mail.med.upenn.edu'], ('Hongzhe','Li'): ['Ph.D.', 'Professor', 'hongzhe@upenn.edu'] }
Print the first 3 key and value pairs of the dictionary:
('Pamela Ann', 'Shaw'): ['PhD', 'Assistant Professor', 'shawp@upenn.edu']
('Kathleen Joy', 'Propert'): ['Sc.D.', 'Professor', 'propert@mail.med.upenn.edu']
('J. Richard', 'Landis'): ['B.S.Ed. M.S. Ph.D.', 'Professor', 'jrlandis@mail.med.upenn.edu']
####Q8. It looks like the current dictionary is printing by first name. Print out the dictionary key value pairs based on alphabetical orders of the last name of the professors
('Scarlett L.', 'Bellamy'): ['Sc.D.', 'Associate Professor', 'bellamys@mail.med.upenn.edu']
('Warren B.', 'Bilker'): ['Ph.D.', 'Professor', 'warren@upenn.edu']
('Matthew W', 'Bryan'): ['PhD', 'Assistant Professor', 'bryanma@upenn.edu']
('Jinbo', 'Chen'): ['Ph.D.', 'Associate Professor', 'jinboche@upenn.edu']
('Susan S', 'Ellenberg'): ['Ph.D.', 'Professor', 'sellenbe@upenn.edu']
('Jonas H.', 'Ellenberg'): ['Ph.D.', 'Professor', 'jellenbe@mail.med.upenn.edu']
('Rui', 'Feng'): ['Ph.D', 'Assistant Professor', 'ruifeng@upenn.edu']
('Benjamin C.', 'French'): ['PhD', 'Associate Professor', 'bcfrench@mail.med.upenn.edu']
('Phyllis A.', 'Gimotty'): ['Ph.D', 'Professor', 'pgimotty@upenn.edu']
('Wensheng', 'Guo'): ['Ph.D', 'Professor', 'wguo@mail.med.upenn.edu']
('Yenchih', 'Hsu'): ['Ph.D.', 'Assistant Professor', 'hsu9@mail.med.upenn.edu']
('Rebecca A', 'Hubbard'): ['PhD', 'Associate Professor', 'rhubb@mail.med.upenn.edu']
('Wei-Ting', 'Hwang'): ['Ph.D.', 'Associate Professor', 'whwang@mail.med.upenn.edu']
('Marshall M.', 'Joffe'): ['MD MPH Ph.D', 'Professor', 'mjoffe@mail.med.upenn.edu']
('J. Richard', 'Landis'): ['B.S.Ed. M.S. Ph.D.', 'Professor', 'jrlandis@mail.med.upenn.edu']
('Yimei', 'Li'): ['Ph.D.', 'Assistant Professor', 'liy3@email.chop.edu']
('Hongzhe', 'Li'): ['Ph.D', 'Professor', 'hongzhe@upenn.edu']
('Mingyao', 'Li'): ['Ph.D.', 'Associate Professor', 'mingyao@mail.med.upenn.edu']
('A. Russell', 'Localio'): ['JD MA MPH MS PhD', 'Associate Professor', 'rlocalio@upenn.edu']
('Nandita', 'Mitra'): ['Ph.D.', 'Associate Professor', 'nanditam@mail.med.upenn.edu']
('Knashawn H.', 'Morales'): ['Sc.D.', 'Associate Professor', 'knashawn@mail.med.upenn.edu']
('Kathleen Joy', 'Propert'): ['Sc.D.', 'Professor', 'propert@mail.med.upenn.edu']
('Mary E.', 'Putt'): ['PhD ScD', 'Professor', 'mputt@mail.med.upenn.edu']
('Sarah Jane', 'Ratcliffe'): ['Ph.D.', 'Associate Professor', 'sratclif@upenn.edu']
('Michelle Elana', 'Ross'): ['PhD', 'Assistant Professor', 'michross@upenn.edu']
('Jason A.', 'Roy'): ['Ph.D.', 'Associate Professor', 'jaroy@mail.med.upenn.edu']
('Mary D.', 'Sammel'): ['Sc.D.', 'Professor', 'msammel@cceb.med.upenn.edu']
('Pamela Ann', 'Shaw'): ['PhD', 'Assistant Professor', 'shawp@upenn.edu']
('Russell Takeshi', 'Shinohara'): ['0', 'Assistant Professor', 'rshi@mail.med.upenn.edu']
('Haochang', 'Shou'): ['Ph.D.', 'Assistant Professor', 'hshou@mail.med.upenn.edu']
('Justine', 'Shults'): ['Ph.D.', 'Professor', 'jshults@mail.med.upenn.edu']
('Alisa Jane', 'Stephens'): ['Ph.D.', 'Assistant Professor', 'alisaste@mail.med.upenn.edu']
('Andrea Beth', 'Troxel'): ['ScD', 'Professor', 'atroxel@mail.med.upenn.edu']
('Rui', 'Xiao'): ['PhD', 'Assistant Professor', 'rxiao@mail.med.upenn.edu']
('Sharon Xiangwen', 'Xie'): ['Ph.D.', 'Associate Professor', 'sxie@mail.med.upenn.edu']
('Dawei', 'Xie'): ['PhD', 'Assistant Professor', 'dxie@upenn.edu']
('Wei (Peter)', 'Yang'): ['Ph.D.', 'Assistant Professor', 'weiyang@mail.med.upenn.edu']
Place your code in this file: advanced_python_dict.py
If you're all done and looking for an extra challenge, then try the below problem: