{"id":10108,"date":"2018-10-08T08:00:28","date_gmt":"2018-10-08T12:00:28","guid":{"rendered":"https:\/\/michigan.it.umich.edu\/news\/?p=10108"},"modified":"2024-07-08T06:05:44","modified_gmt":"2024-07-08T10:05:44","slug":"cavium-thunderx-delivers-10x-big-data-performance-increase","status":"publish","type":"post","link":"https:\/\/michigan.it.umich.edu\/news\/2018\/10\/08\/cavium-thunderx-delivers-10x-big-data-performance-increase\/","title":{"rendered":"Cavium ThunderX delivers 10x Big Data performance increase"},"content":{"rendered":"<div id=\"attachment_10111\" style=\"width: 610px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-10111\" class=\"size-full wp-image-10111\" src=\"https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2018\/09\/cavium-nodes2-e1510012516905-768x576.jpg\" alt=\"cavium nodes\" width=\"600\" height=\"400\" srcset=\"https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2018\/09\/cavium-nodes2-e1510012516905-768x576.jpg 600w, https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2018\/09\/cavium-nodes2-e1510012516905-768x576-200x133.jpg 200w, https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2018\/09\/cavium-nodes2-e1510012516905-768x576-300x200.jpg 300w\" sizes=\"auto, (max-width: 600px) 100vw, 600px\" \/><p id=\"caption-attachment-10111\" class=\"wp-caption-text\">Cavium nodes (Brock Palen\/ARC-TS)<\/p><\/div>\n<p><span style=\"font-weight: 400;\">Recently, ARC-TS and the School of Information used the new Big Data platform <a href=\"https:\/\/arc-ts.umich.edu\/cavium\/\">Cavium ThunderX<\/a>\u00a0to reduce run times of the school&#8217;s analytics pipeline by a factor of 10, taking overall run time from almost a week to only a few hours. <\/span><span style=\"font-weight: 400;\"><br \/>\n<\/span><span style=\"font-weight: 400;\"><br \/>\n<\/span><span style=\"font-weight: 400;\">Cavium ThunderX is a free-to-use Big Data platform for researchers at U-M. Currently ThunderX supports mapreduce, Spark, Python, Hive, RMR, R and other common Hadoop ecosystem tools. Cavium is made available by <a href=\"https:\/\/arc-ts.umich.edu\/u-m-partners-with-cavium-on-big-data-computing-platform\/\">generous alumni support<\/a> and the <a href=\"https:\/\/midas.umich.edu\/dsi\/\">Data Science Initiative<\/a>.<\/span><span style=\"font-weight: 400;\"><br \/>\n<\/span><span style=\"font-weight: 400;\"><br \/>\n<\/span><span style=\"font-weight: 400;\">Current Cavium ThunderX configuration has 3 petabytes of storage; 4,800 ARM cores; and 25 terabytes of main memory on a 40\/100 Gbps network. Training and consulting is available for those looking to take their first steps into Big Data.\u00a0<\/span><\/p>\n<p><strong>To get started, contact ARC-TS at <a href=\"mailto:hpc-support@umich.edu\">hpc-support@umich.edu<\/a>.<\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Recently, ARC-TS and the School of Information used the new Big Data platform Cavium ThunderX\u00a0to reduce run times of the school&#8217;s analytics pipeline by a factor of 10, taking overall run time from almost a week to only a few hours. Cavium ThunderX is a free-to-use Big Data platform for researchers at U-M. Currently ThunderX supports mapreduce, Spark,\u2026 <span class=\"read-more\"><a href=\"https:\/\/michigan.it.umich.edu\/news\/2018\/10\/08\/cavium-thunderx-delivers-10x-big-data-performance-increase\/\">Read More &raquo;<\/a><\/span><\/p>\n","protected":false},"author":96,"featured_media":10111,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_uag_custom_page_level_css":"","_umich_oidc_access":"","_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_ef_editorial_meta_date_first-draft-date":"","_ef_editorial_meta_paragraph_assignment":"","_ef_editorial_meta_checkbox_needs-photo":"","_ef_editorial_meta_number_word-count":"","footnotes":""},"categories":[7],"tags":[85,43,130],"class_list":["post-10108","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-projects-services","tag-arc-ts","tag-data","tag-research"],"uagb_featured_image_src":{"full":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2018\/09\/cavium-nodes2-e1510012516905-768x576.jpg",600,400,false],"thumbnail":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2018\/09\/cavium-nodes2-e1510012516905-768x576-200x133.jpg",200,133,true],"medium":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2018\/09\/cavium-nodes2-e1510012516905-768x576-300x200.jpg",300,200,true],"medium_large":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2018\/09\/cavium-nodes2-e1510012516905-768x576.jpg",600,400,false],"large":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2018\/09\/cavium-nodes2-e1510012516905-768x576.jpg",600,400,false],"1536x1536":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2018\/09\/cavium-nodes2-e1510012516905-768x576.jpg",600,400,false],"2048x2048":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2018\/09\/cavium-nodes2-e1510012516905-768x576.jpg",600,400,false],"excerpt-thumbnail":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2018\/09\/cavium-nodes2-e1510012516905-768x576-200x140.jpg",200,140,true],"themonic-thumbnail":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2018\/09\/cavium-nodes2-e1510012516905-768x576-60x42.jpg",60,42,true],"ioslider-thumbnail":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2018\/09\/cavium-nodes2-e1510012516905-768x576-600x300.jpg",600,300,true],"post-thumbnail":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2018\/09\/cavium-nodes2-e1510012516905-768x576.jpg",600,400,false],"400x250-crop":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2018\/09\/cavium-nodes2-e1510012516905-768x576.jpg",375,250,false]},"uagb_author_info":{"display_name":"Brock Palen, ARC-TS","author_link":"https:\/\/michigan.it.umich.edu\/news\/author\/brockp\/"},"uagb_comment_info":0,"uagb_excerpt":"Recently, ARC-TS and the School of Information used the new Big Data platform Cavium ThunderX\u00a0to reduce run times of the school&#8217;s analytics pipeline by a factor of 10, taking overall run time from almost a week to only a few hours. Cavium ThunderX is a free-to-use Big Data platform for researchers at U-M. Currently ThunderX&hellip;","_links":{"self":[{"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/posts\/10108","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/users\/96"}],"replies":[{"embeddable":true,"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/comments?post=10108"}],"version-history":[{"count":7,"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/posts\/10108\/revisions"}],"predecessor-version":[{"id":10123,"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/posts\/10108\/revisions\/10123"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/media\/10111"}],"wp:attachment":[{"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/media?parent=10108"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/categories?post=10108"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/tags?post=10108"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}