{"id":4360,"date":"2017-07-19T11:38:07","date_gmt":"2017-07-19T15:38:07","guid":{"rendered":"https:\/\/michigan.it.umich.edu\/news\/?p=4360"},"modified":"2024-07-08T06:06:19","modified_gmt":"2024-07-08T10:06:19","slug":"new-data-science-computing-platform","status":"publish","type":"post","link":"https:\/\/michigan.it.umich.edu\/news\/2017\/07\/19\/new-data-science-computing-platform\/","title":{"rendered":"New data science computing platform"},"content":{"rendered":"<p><a href=\"https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2017\/07\/ARC-TS-signature-stationery-white.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-large wp-image-4372\" src=\"https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2017\/07\/ARC-TS-signature-stationery-white-700x120.jpg\" alt=\"Advanced Research Computing - Technology Services\" width=\"665\" height=\"114\" srcset=\"https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2017\/07\/ARC-TS-signature-stationery-white.jpg 700w, https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2017\/07\/ARC-TS-signature-stationery-white-125x21.jpg 125w, https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2017\/07\/ARC-TS-signature-stationery-white-300x51.jpg 300w, https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2017\/07\/ARC-TS-signature-stationery-white-665x114.jpg 665w\" sizes=\"auto, (max-width: 665px) 100vw, 665px\" \/><\/a><\/p>\n<p>Advanced Research Computing \u2013 Technology Services (ARC-TS) is pleased to announce an expanded data science computing platform, giving all U-M researchers new capabilities to host structured and unstructured databases, and to ingest, store, query, and analyze large datasets.<\/p>\n<p>The new platform features a flexible, robust, and scalable database environment and a set of data pipeline tools that can ingest and process large amounts of data from sensors, mobile devices, wearables, and other sources of streaming data. The platform leverages\u00a0the advanced virtualization capabilities of\u00a0ARC-TS\u2019s Yottabyte Research Cloud (<a href=\"http:\/\/arc-ts.umich.edu\/systems-and-services\/yottabyte\/\" target=\"_blank\" rel=\"noopener\">YBRC<\/a>) infrastructure and is supported by U-M\u2019s Data Science Initiative launched in 2015. YBRC was created through a partnership between Yottabyte and ARC-TS<a href=\"http:\/\/arc-ts.umich.edu\/u-m-yottabyte-partnership\/\" target=\"_blank\" rel=\"noopener\">\u00a0announced last fall<\/a>.<\/p>\n<p>The following functionalities are immediately available:<\/p>\n<ul>\n<li>Structured databases: \u00a0MySQL\/MariaDB, and PostgreSQL.<\/li>\n<li>Unstructured databases: Cassandra, MongoDB, InfluxDB, Grafana, and ElasticSearch.<\/li>\n<li>Data ingestion: Redis, Kafka, RabbitMQ.<\/li>\n<li>Data processing: Apache Flink, Apache Storm, Node.js and Apache NiFi.<\/li>\n<\/ul>\n<p>Other types of databases can be created upon request.<\/p>\n<p>These tools are offered to all researchers at U-M free of charge, provided certain usage restrictions are not exceeded. Large-scale users who outgrow the no-cost allotment may purchase additional YBRC resources. All interested parties should contact\u00a0<a href=\"mailto:hpc-support@umich.edu\" target=\"_blank\" rel=\"noopener\">hpc-support@umich.edu<\/a>.<\/p>\n<p>At this time, the YBRC platform only accepts unrestricted data. The platform is expected to accommodate restricted data within the next few months.<\/p>\n<p>ARC-TS also operates a separate data science computing cluster available for researchers using the latest\u00a0Hadoop components. This cluster also will be expanded in the near future.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>An expanded data science computing platform from ARC-TS gives all U-M researchers new capabilities to host structured and unstructured databases, and to ingest, store, query, and analyze large datasets.<\/p>\n","protected":false},"author":58,"featured_media":4371,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_uag_custom_page_level_css":"","_umich_oidc_access":"","_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_ef_editorial_meta_date_first-draft-date":"1500336000","_ef_editorial_meta_paragraph_assignment":"","_ef_editorial_meta_checkbox_needs-photo":"1","_ef_editorial_meta_number_word-count":"","footnotes":""},"categories":[7],"tags":[85,43,254,130],"class_list":["post-4360","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-projects-services","tag-arc-ts","tag-data","tag-hpc","tag-research"],"uagb_featured_image_src":{"full":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2017\/07\/ARC-TS-signature-vertical.jpg",200,140,false],"thumbnail":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2017\/07\/ARC-TS-signature-vertical.jpg",200,140,false],"medium":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2017\/07\/ARC-TS-signature-vertical.jpg",200,140,false],"medium_large":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2017\/07\/ARC-TS-signature-vertical.jpg",200,140,false],"large":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2017\/07\/ARC-TS-signature-vertical.jpg",200,140,false],"1536x1536":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2017\/07\/ARC-TS-signature-vertical.jpg",200,140,false],"2048x2048":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2017\/07\/ARC-TS-signature-vertical.jpg",200,140,false],"excerpt-thumbnail":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2017\/07\/ARC-TS-signature-vertical.jpg",200,140,false],"themonic-thumbnail":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2017\/07\/ARC-TS-signature-vertical-60x42.jpg",60,42,true],"ioslider-thumbnail":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2017\/07\/ARC-TS-signature-vertical.jpg",200,140,false],"post-thumbnail":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2017\/07\/ARC-TS-signature-vertical.jpg",200,140,false],"400x250-crop":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2017\/07\/ARC-TS-signature-vertical.jpg",200,140,false]},"uagb_author_info":{"display_name":"Dan Meisler","author_link":"https:\/\/michigan.it.umich.edu\/news\/author\/dmeisler\/"},"uagb_comment_info":0,"uagb_excerpt":"An expanded data science computing platform from ARC-TS gives all U-M researchers new capabilities to host structured and unstructured databases, and to ingest, store, query, and analyze large datasets.","_links":{"self":[{"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/posts\/4360","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/users\/58"}],"replies":[{"embeddable":true,"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/comments?post=4360"}],"version-history":[{"count":6,"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/posts\/4360\/revisions"}],"predecessor-version":[{"id":4376,"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/posts\/4360\/revisions\/4376"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/media\/4371"}],"wp:attachment":[{"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/media?parent=4360"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/categories?post=4360"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/tags?post=4360"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}