{"id":1408,"date":"2017-07-31T15:59:09","date_gmt":"2017-07-31T15:59:09","guid":{"rendered":"http:\/\/press3.mcs.anl.gov\/scienceclouds\/?page_id=1408"},"modified":"2022-11-29T23:49:04","modified_gmt":"2022-11-29T23:49:04","slug":"cloud-traces","status":"publish","type":"page","link":"https:\/\/wordpress.cels.anl.gov\/scienceclouds\/cloud-traces\/","title":{"rendered":"Cloud traces"},"content":{"rendered":"<p>Traces from existing parallel and distributed computing systems are a useful resource for researchers to replicate real-life workloads for their experiments. However, since cloud computing is a relatively new area few such traces are currently available.<\/p>\n<h3>Using Chameleon Cloud Traces<\/h3>\n<p>We have developed a <a href=\"http:\/\/scienceclouds.org\/cloud-traces\/cloud-trace-format\/\">trace data structure<\/a> based on data from OpenStack Nova\/Blazar\/Ironic services, as well as <a href=\"https:\/\/github.com\/ChameleonCloud\/starcompactor\">software<\/a> to extract the appropriate data. We are making available data from the OpenStack cloud operated by the <a href=\"https:\/\/www.chameleoncloud.org\">Chameleon testbed<\/a> for educational projects.<\/p>\n<ul>\n<li><a href=\"\/cloud-traces\/chameleon-chiuc-cloud-trace-2020-09-03\">Chameleon CHI@UC cloud trace (2020-09-03)<\/a><\/li>\n<li><a href=\"\/cloud-traces\/chameleon-chitacc-cloud-trace-2020-09-03\/\">Chameleon CHI@TACC cloud trace (2020-09-03)<\/a><\/li>\n<li><a href=\"\/cloud-traces\/chameleon-openstack-kvm-cloud-trace-2020-09-04\/\">Chameleon OpenStack KVM cloud trace (2020-09-04)<\/a><\/li>\n<li><a href=\"\/cloud-traces\/chameleon-openstack-legacy-kvm-cloud-trace-2020-02-03\/\">Chameleon OpenStack Legacy KVM cloud trace (2020-02-03)<\/a><\/li>\n<li><a href=\"\/cloud-traces\/chameleon-chiuc-cloud-trace-2019-11-01\/\">Chameleon CHI@UC cloud trace (2019-11-01)<\/a><\/li>\n<li><a href=\"\/cloud-traces\/chameleon-chitacc-cloud-trace-2019-11-01\/\">Chameleon CHI@TACC cloud trace (2019-11-01)<\/a><\/li>\n<li><a href=\"\/cloud-traces\/chameleon-openstack-kvm-cloud-trace-2019-11-01\">Chameleon OpenStack KVM cloud trace (2019-11-01)<\/a><\/li>\n<li><a href=\"\/cloud-traces\/chameleon-openstack-kvm-cloud-trace-2018-12-17\">Chameleon OpenStack KVM cloud trace (2018-12-17)<\/a><\/li>\n<li><a href=\"\/cloud-traces\/chameleon-openstack-kvm-cloud-trace-2\/\">Chameleon OpenStack KVM cloud trace (2018-11-06)<\/a><\/li>\n<li><a href=\"\/cloud-traces\/chameleon-openstack-kvm-cloud-trace-1\/\">Chameleon OpenStack KVM cloud trace (2017-08-02)<\/a><\/li>\n<\/ul>\n<p>We released Chameleon cloud traces to enable researchers to run their experiment and\/or simulations with more realistic scientific testbed data. It would be a huge encouragement to us to see your works using our cloud traces. If you use our data in your research, it would be great to let us know. You can find our contact information <a href=\"https:\/\/press3.mcs.anl.gov\/scienceclouds\/contact\/\">here<\/a>.<\/p>\n<p>For a quick start on downloading and using our cloud traces, we provided a <a href=\"https:\/\/github.com\/ChameleonCloud\/starcompactor\/blob\/master\/ChameleonKVMCloudTraces.ipynb\">Jupyter Notebook example<\/a>, which you can upload\u00a0to <a href=\"https:\/\/jupyter.chameleoncloud.org\">Chameleon Jupyter server<\/a>. For more information about Chameleon Jupyter interface, please visit <a href=\"https:\/\/chameleoncloud.readthedocs.io\/en\/latest\/technical\/jupyter.html\">Chameleon user documentation<\/a>.<\/p>\n<h3>Sharing Your Cloud Traces<\/h3>\n<p>We also encourage research groups and cloud testbed providers to share their cloud traces with us. To share your cloud traces, please provide the following information with your cloud traces:<\/p>\n<ul>\n<li>Cloud trace format and format version<\/li>\n<li>How the cloud trace was generated (i.e. software tools)<\/li>\n<li>Cloud trace period<\/li>\n<li>Release date<\/li>\n<li>Contact information<\/li>\n<li>(Optional) Publications<\/li>\n<\/ul>\n<p>If you are interested in sharing your cloud traces with us, please <a href=\"https:\/\/press3.mcs.anl.gov\/scienceclouds\/contact\/\">contact us<\/a>!<\/p>\n<ul>\n<li><a href=\"http:\/\/press3.mcs.anl.gov\/scienceclouds\/cloud-traces\/aps-lcrc\/\">ASP\/LCRC<\/a><\/li>\n<\/ul>\n<h3>Other Released Cloud Traces<\/h3>\n<p>The commercial cloud providers have released their cloud traces, and numerous\u00a0researches had been done based on these released traces. We listed Microsoft Azure, Alibaba and Google release below for your reference.<\/p>\n<ul>\n<li><a href=\"https:\/\/github.com\/Azure\/AzurePublicDataset\">Microsoft Azure VM traces<\/a><\/li>\n<li><a href=\"https:\/\/github.com\/alibaba\/clusterdata\">Alibaba cluster data<\/a><\/li>\n<li><a href=\"https:\/\/github.com\/google\/cluster-data\">Google cluster data<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Traces from existing parallel and distributed computing systems are a useful resource for researchers to replicate real-life workloads for their experiments. However, since cloud computing is a relatively new area few such traces are currently available. Using Chameleon Cloud Traces We have developed a trace data structure based on data from OpenStack Nova\/Blazar\/Ironic services, as&#8230;  <a href=\"https:\/\/wordpress.cels.anl.gov\/scienceclouds\/cloud-traces\/\" class=\"more-link\" title=\"Read Cloud traces\">Read more &raquo;<\/a><\/p>\n","protected":false},"author":849,"featured_media":0,"parent":0,"menu_order":1,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"_monsterinsights_skip_tracking":false,"footnotes":"","_members_access_role":[],"_members_access_error":""},"class_list":["post-1408","page","type-page","status-publish","hentry"],"acf":[],"_links":{"self":[{"href":"https:\/\/wordpress.cels.anl.gov\/scienceclouds\/wp-json\/wp\/v2\/pages\/1408","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/wordpress.cels.anl.gov\/scienceclouds\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/wordpress.cels.anl.gov\/scienceclouds\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/wordpress.cels.anl.gov\/scienceclouds\/wp-json\/wp\/v2\/users\/849"}],"replies":[{"embeddable":true,"href":"https:\/\/wordpress.cels.anl.gov\/scienceclouds\/wp-json\/wp\/v2\/comments?post=1408"}],"version-history":[{"count":1,"href":"https:\/\/wordpress.cels.anl.gov\/scienceclouds\/wp-json\/wp\/v2\/pages\/1408\/revisions"}],"predecessor-version":[{"id":1732,"href":"https:\/\/wordpress.cels.anl.gov\/scienceclouds\/wp-json\/wp\/v2\/pages\/1408\/revisions\/1732"}],"wp:attachment":[{"href":"https:\/\/wordpress.cels.anl.gov\/scienceclouds\/wp-json\/wp\/v2\/media?parent=1408"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}