{"id":12636,"date":"2019-03-08T09:00:25","date_gmt":"2019-03-08T14:00:25","guid":{"rendered":"https:\/\/michigan.it.umich.edu\/news\/?p=12636"},"modified":"2024-07-08T06:05:33","modified_gmt":"2024-07-08T10:05:33","slug":"two-solutions-for-gpu-efficiency-can-boost-ai-performance","status":"publish","type":"post","link":"https:\/\/michigan.it.umich.edu\/news\/2019\/03\/08\/two-solutions-for-gpu-efficiency-can-boost-ai-performance\/","title":{"rendered":"Two solutions for GPU efficiency can boost AI performance"},"content":{"rendered":"\n<figure class=\"wp-block-image\"><img loading=\"lazy\" decoding=\"async\" width=\"640\" height=\"426\" src=\"https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2019\/03\/mining-2648004_640.jpg\" alt=\"cluster of GPUs\" class=\"wp-image-12638\" srcset=\"https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2019\/03\/mining-2648004_640.jpg 640w, https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2019\/03\/mining-2648004_640-200x133.jpg 200w, https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2019\/03\/mining-2648004_640-300x200.jpg 300w\" sizes=\"auto, (max-width: 640px) 100vw, 640px\" \/><figcaption><a href=\"https:\/\/pixabay.com\/photos\/mining-ethereum-market-digital-2648004\/\">(LauraTara\/Pixabay)<\/a><\/figcaption><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Graphics Processing Units (GPUs) have been getting a big workout from new advancements in AI because they offer significant performance boosts thanks to their parallel computing capabilities. GPUs are employed by large computing clusters to handle huge datasets for deep learning applications. Achieving cost-effectiveness in these clusters relies on efficiently sharing resources between multiple users.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">However, these systems are not designed for efficient, fine-grained sharing of GPU resources at either the micro or macro scale. Memory and computation power are regularly wasted at the level of individual GPUs and at that of an entire GPU cluster.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Professor <strong>Mosharaf Chowdhury <\/strong>is working to overcome both of these shortcomings, multiplying the number of jobs a cluster can finish in a set amount of time and streamlining methods of sharing resources on the fly. His team has described <a href=\"http:\/\/eecs.umich.edu\/eecs\/about\/articles\/2019\/chowdhury-salus-tiresias.html\">a set of solutions to achieve efficient GPU resource sharing at multiple scales<\/a>: both within a single GPU and across many GPUs in a cluster.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Graphics Processing Units (GPUs) have been getting a big workout from new advancements in AI because they offer significant performance boosts thanks to their parallel computing capabilities. GPUs are employed by large computing clusters to handle huge datasets for deep learning applications. Achieving cost-effectiveness in these clusters relies on efficiently sharing resources between multiple users. However, these systems\u2026 <span class=\"read-more\"><a href=\"https:\/\/michigan.it.umich.edu\/news\/2019\/03\/08\/two-solutions-for-gpu-efficiency-can-boost-ai-performance\/\">Read More &raquo;<\/a><\/span><\/p>\n","protected":false},"author":1,"featured_media":12638,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_uag_custom_page_level_css":"","_umich_oidc_access":"","_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_ef_editorial_meta_date_first-draft-date":"","_ef_editorial_meta_paragraph_assignment":"","_ef_editorial_meta_checkbox_needs-photo":"","_ef_editorial_meta_number_word-count":"","footnotes":""},"categories":[5],"tags":[61,630,130],"class_list":["post-12636","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-campus-news","tag-ai","tag-gpu","tag-research"],"uagb_featured_image_src":{"full":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2019\/03\/mining-2648004_640.jpg",640,426,false],"thumbnail":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2019\/03\/mining-2648004_640-200x133.jpg",200,133,true],"medium":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2019\/03\/mining-2648004_640-300x200.jpg",300,200,true],"medium_large":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2019\/03\/mining-2648004_640.jpg",640,426,false],"large":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2019\/03\/mining-2648004_640.jpg",600,399,false],"1536x1536":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2019\/03\/mining-2648004_640.jpg",640,426,false],"2048x2048":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2019\/03\/mining-2648004_640.jpg",640,426,false],"excerpt-thumbnail":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2019\/03\/mining-2648004_640-200x140.jpg",200,140,true],"themonic-thumbnail":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2019\/03\/mining-2648004_640-60x42.jpg",60,42,true],"ioslider-thumbnail":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2019\/03\/mining-2648004_640-640x300.jpg",640,300,true],"post-thumbnail":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2019\/03\/mining-2648004_640.jpg",640,426,false],"400x250-crop":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2019\/03\/mining-2648004_640.jpg",376,250,false]},"uagb_author_info":{"display_name":"News Staff","author_link":"https:\/\/michigan.it.umich.edu\/news\/author\/mitnewsadm\/"},"uagb_comment_info":0,"uagb_excerpt":"Graphics Processing Units (GPUs) have been getting a big workout from new advancements in AI because they offer significant performance boosts thanks to their parallel computing capabilities. GPUs are employed by large computing clusters to handle huge datasets for deep learning applications. Achieving cost-effectiveness in these clusters relies on efficiently sharing resources between multiple users.&hellip;","_links":{"self":[{"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/posts\/12636","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/comments?post=12636"}],"version-history":[{"count":2,"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/posts\/12636\/revisions"}],"predecessor-version":[{"id":12640,"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/posts\/12636\/revisions\/12640"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/media\/12638"}],"wp:attachment":[{"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/media?parent=12636"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/categories?post=12636"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/tags?post=12636"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}