2024-03-29T07:02:41Zhttps://scholarworks.iu.edu/dspace-oai/requestoai:scholarworks.iu.edu:2022/184232016-03-14T18:36:36Zcom_2022_12992com_2022_356com_2022_19673col_2022_13011oai:scholarworks.iu.edu:2022/231862021-10-18T11:26:34Zcom_2022_12992com_2022_356com_2022_19673col_2022_13011
Stewart, Craig A.
Hancock, David Y.
Wernert, Julie
Furlani, Thomas
Lifka, David
Sill, Alan
Berente, Nicholas
McMullen, Donald F.
Cheatham, Thomas
Apon, Amy
Payne, Ron
Slavin, Shawn D.
2019-06-11T13:52:55Z
2019-06-11T13:52:55Z
2019
http://hdl.handle.net/2022/23186
In recent years, considerable attention has been given to assessing the value of investments in cyberinfrastructure (CI). This paper includes a survey of current methods for the assessment of financial returns on investment (ROI) in CI. Applying the financial concept of ROI proves challenging with regard to a service that, in most academic environments, does not generate a “sold amount” such as one would find in the buying and selling of stocks. The paper concludes with a discussion of future research directions and challenges in the assessment of financial ROI in CI. This work is intended less as a definitive guide than as a starting point for further exploration in the assessment of CI’s value for scientific research.
Submitted by Harmony Jankowski (hjankows@iu.edu) on 2019-06-11T13:28:32Z
No. of bitstreams: 1
Stewart_et_al-ROI_Financial_PEARC19_FINAL.pdf: 517721 bytes, checksum: aa6085dd085923f1794743505368faef (MD5)
Approved for entry into archive by Winona Snapp-Childs (wsnappch@iu.edu) on 2019-06-11T13:52:55Z (GMT) No. of bitstreams: 1
Stewart_et_al-ROI_Financial_PEARC19_FINAL.pdf: 517721 bytes, checksum: aa6085dd085923f1794743505368faef (MD5)
Made available in DSpace on 2019-06-11T13:52:55Z (GMT). No. of bitstreams: 1
Stewart_et_al-ROI_Financial_PEARC19_FINAL.pdf: 517721 bytes, checksum: aa6085dd085923f1794743505368faef (MD5)
Previous issue date: 2019
en
https://creativecommons.org/licenses/by/4.0/
ROI, Total Cost of Ownership, TCO, cost avoidance
Assessment of financial returns on investments in cyberinfrastructure facilities: A survey of current methods
Preprint
ORIGINAL
Stewart_et_al-ROI_Financial_PEARC19_FINAL.pdf
Stewart_et_al-ROI_Financial_PEARC19_FINAL.pdf
application/pdf
517721
https://scholarworks.iu.edu/dspace/bitstream/2022/23186/1/Stewart_et_al-ROI_Financial_PEARC19_FINAL.pdf
aa6085dd085923f1794743505368faef
MD5
1
LICENSE
license.txt
license.txt
text/plain
2730
https://scholarworks.iu.edu/dspace/bitstream/2022/23186/2/license.txt
8b5355396084efce0c43805344408e89
MD5
2
TEXT
Stewart_et_al-ROI_Financial_PEARC19_FINAL.pdf.txt
Stewart_et_al-ROI_Financial_PEARC19_FINAL.pdf.txt
Extracted text
text/plain
51016
https://scholarworks.iu.edu/dspace/bitstream/2022/23186/3/Stewart_et_al-ROI_Financial_PEARC19_FINAL.pdf.txt
2948cb3a462e138ac3eae3f1d7564062
MD5
3
THUMBNAIL
Stewart_et_al-ROI_Financial_PEARC19_FINAL.pdf.jpg
Stewart_et_al-ROI_Financial_PEARC19_FINAL.pdf.jpg
IM Thumbnail
image/jpeg
1548
https://scholarworks.iu.edu/dspace/bitstream/2022/23186/4/Stewart_et_al-ROI_Financial_PEARC19_FINAL.pdf.jpg
208b4470424043a12d887abf73958d5f
MD5
4
2022/23186
oai:scholarworks.iu.edu:2022/23186
2021-10-18 07:26:34.028
IUScholarWorks
iusw@indiana.edu
T3BlbiBBY2Nlc3MgUG9saWN5CgpJZiB5b3UgYXJlIHN1Ym1pdHRpbmcgYSBzY2hvbGFybHkgYXJ0aWNsZSBwdXJzdWFudCB0byB0aGUgSW5kaWFuYSBVbml2ZXJzaXR5IEJsb29taW5ndG9uIE9wZW4gQWNjZXNzIFBvbGljeSwgeW91ciBzdWJtaXNzaW9uIGlzIGdvdmVybmVkIGJ5IHRoZSB0ZXJtcyBvZiB0aGUgbm9uLWV4Y2x1c2l2ZSBsaWNlbnNlIGdyYW50ZWQgdW5kZXIgdGhlIE9wZW4gQWNjZXNzIFBvbGljeS4gSWYgeW91IG5lZWQgYXNzaXN0YW5jZSBkZXRlcm1pbmluZyB3aGV0aGVyIHlvdXIgYXJ0aWNsZSBpcyBzdWJqZWN0IHRvIHRoZSBPcGVuIEFjY2VzcyBQb2xpY3ksIHBsZWFzZSBjb250YWN0IHRoZSBTY2hvbGFybHkgQ29tbXVuaWNhdGlvbiBEZXBhcnRtZW50LiBUbyByZWFkIHRoZSBwb2xpY3ksIHZpc2l0OiBodHRwOi8vZ28uaXUuZWR1LzIxdHguIFRvIHJlYWQgdGhlIEZBUSBvbiB0aGUgcG9saWN5LCB2aXNpdDogaHR0cHM6Ly9vcGVuc2Nob2xhcnNoaXAuaW5kaWFuYS5lZHUvcG9saWN5LWZhcS4gCgpBbGwgb3RoZXIgc3VibWlzc2lvbnMgdG8gSVVTY2hvbGFyV29ya3MgYXJlIHN1YmplY3QgdG8gdGhlIHRlcm1zIG9mIHRoZSBub24tZXhjbHVzaXZlIGxpY2Vuc2UgYmVsb3c6CgpJVVNjaG9sYXJXb3JrcyBSZXBvc2l0b3J5IExpY2Vuc2UgCgpCeSBzdWJtaXR0aW5nIHlvdXIgd29yayB0byB0aGUgSVVTY2hvbGFyV29ya3MgcmVwb3NpdG9yeSwgeW91ICh0aGUgY3JlYXRvciBvciBjb3B5cmlnaHQgb3duZXIpIGdyYW50IHRvIEluZGlhbmEgVW5pdmVyc2l0eSBhIG5vbi1leGNsdXNpdmUsIHBlcnBldHVhbCwgaXJyZXZvY2FibGUgcmlnaHQgdG8gcmVwcm9kdWNlLCByZWZvcm1hdCAoYXMgZGVmaW5lZCBiZWxvdyksIGFuZC9vciBkaXN0cmlidXRlIHlvdXIgc3VibWlzc2lvbiAoaW5jbHVkaW5nIHRoZSBhYnN0cmFjdCkgd29ybGR3aWRlIGluIHByaW50IGFuZCBlbGVjdHJvbmljIGZvcm1hdCBhbmQgaW4gYW55IG1lZGl1bSwgaW5jbHVkaW5nIGJ1dCBub3QgbGltaXRlZCB0byBhdWRpbyBvciB2aWRlby4gWW91IGFncmVlIHRoYXQgSW5kaWFuYSBVbml2ZXJzaXR5IG1heSwgd2l0aG91dCBjaGFuZ2luZyB0aGUgY29udGVudCwgcmVmb3JtYXQgdGhlIHN1Ym1pc3Npb24gdG8gYW55IG1lZGl1bSBvciBmb3JtYXQsIG5vdyBrbm93biBvciBsYXRlciBkZXZlbG9wZWQsIGZvciBwcmVzZXJ2YXRpb24gb3IgYWNjZXNzLCBhbmQgcHJvdmlkZSBiYXNpYyBtZXRhZGF0YSB0aGF0IGRlc2NyaWJlcyB0aGUgY29udGVudHMgZm9yIGRpc2NvdmVyeS4gWW91IGFsc28gYWdyZWUgdGhhdCBJbmRpYW5hIFVuaXZlcnNpdHkgbWF5IGtlZXAgbW9yZSB0aGFuIG9uZSBjb3B5IG9mIHRoaXMgc3VibWlzc2lvbiBmb3Igc2VjdXJpdHksIGJhY2stdXAgYW5kIHByZXNlcnZhdGlvbi4gWW91IHJlcHJlc2VudCB0aGF0IHRoZSBzdWJtaXNzaW9uIGlzIHlvdXIgb3JpZ2luYWwgd29yaywgYW5kIHRoYXQgeW91IGhhdmUgdGhlIHJpZ2h0IHRvIGdyYW50IHRoZSByaWdodHMgY29udGFpbmVkIGluIHRoaXMgbGljZW5zZS4gWW91IGFsc28gcmVwcmVzZW50IHRoYXQgeW91ciBzdWJtaXNzaW9uIGRvZXMgbm90LCB0byB0aGUgYmVzdCBvZiB5b3VyIGtub3dsZWRnZSwgaW5mcmluZ2UgdXBvbiBhbnlvbmUncyBjb3B5cmlnaHQuIElmIHRoZSBzdWJtaXNzaW9uIGNvbnRhaW5zIG1hdGVyaWFsIGZvciB3aGljaCB5b3UgZG8gbm90IGhvbGQgY29weXJpZ2h0LCB5b3UgcmVwcmVzZW50IHRoYXQgeW91IGhhdmUgb2J0YWluZWQgdGhlIHVucmVzdHJpY3RlZCBwZXJtaXNzaW9uIG9mIHRoZSBjb3B5cmlnaHQgb3duZXIgdG8gZ3JhbnQgSW5kaWFuYSBVbml2ZXJzaXR5IHRoZSByaWdodHMgcmVxdWlyZWQgYnkgdGhpcyBsaWNlbnNlLCBhbmQgdGhhdCBzdWNoIHRoaXJkLXBhcnR5IG93bmVkIG1hdGVyaWFsIGlzIGNsZWFybHkgaWRlbnRpZmllZCBhbmQgYWNrbm93bGVkZ2VkIHdpdGhpbiB0aGUgdGV4dCBvciBjb250ZW50IG9mIHRoZSBzdWJtaXNzaW9uLiBJZiB0aGUgc3VibWlzc2lvbiBpcyBiYXNlZCB1cG9uIHdvcmsgdGhhdCBoYXMgYmVlbiBzcG9uc29yZWQgb3Igc3VwcG9ydGVkIGJ5IGFuIGFnZW5jeSBvciBvcmdhbml6YXRpb24gb3RoZXIgdGhhbiBJbmRpYW5hIFVuaXZlcnNpdHksIHlvdSByZXByZXNlbnQgdGhhdCB5b3UgaGF2ZSBmdWxmaWxsZWQgYW55IHJpZ2h0IG9mIHJldmlldyBvciBvdGhlciBvYmxpZ2F0aW9ucyByZXF1aXJlZCBieSBzdWNoIGNvbnRyYWN0IG9yIGFncmVlbWVudC4gSW5kaWFuYSBVbml2ZXJzaXR5IHdpbGwgY2xlYXJseSBpZGVudGlmeSB5b3VyIG5hbWUgYXMgdGhlIGNyZWF0b3IgYW5kL29yIGNvcHlyaWdodCBvd25lciBvZiB0aGUgc3VibWlzc2lvbiwgYW5kIHdpbGwgbm90IG1ha2UgYW55IGFsdGVyYXRpb25zLCBvdGhlciB0aGFuIGFzIGFsbG93ZWQgYnkgdGhpcyBsaWNlbnNlLCB0byB5b3VyIHN1Ym1pc3Npb24uIFdlIGFncmVlIHRvIG5vdCBtYWtlIGF2YWlsYWJsZSBhbnkgZmlsZXMgdGhhdCBhcmUgZW1iYXJnb2VkIHVudGlsIHRoZSBlbWJhcmdvIGhhcyBleHBpcmVkLiBJZiB5b3UgYXJlIHN1Ym1pdHRpbmcgdGhpcyBpdGVtIG9uIGJlaGFsZiBvZiB0aGUgcmlnaHRzIGhvbGRlciwgeW91IG11c3QgaGF2ZSB0aGUgcmlnaHRzIG93bmVyJ3Mgd3JpdHRlbiBwZXJtaXNzaW9uIHRvIGFjY2VwdCB0aGlzIGxpY2Vuc2Ugb24gaGlzL2hlciBiZWhhbGYuIAoKcmV2LiAxMS8zLzIwMTcK
oai:scholarworks.iu.edu:2022/233222021-10-18T16:58:50Zcom_2022_12992com_2022_356com_2022_19673col_2022_13011
Gopu, A
Young, M.D.
West, J.
Parasivam, M.
Avena-Koenigsberger, A.
2019-07-31T17:08:46Z
2019-07-31T17:08:46Z
2019
http://hdl.handle.net/2022/23322
10.5967/yk35-st11
Medical imaging, a key component in the clinical diagnosis of and research on neurodegenerative diseases such as Alzheimer’s and Parkinson’s, and various brain cancers, can generate massive datasets in the order of tens to even hundreds of thousands of images for a single subject over the course of a study, and studies typically include hundreds of subjects. Quality assurance (QA) plays a critical role in guaranteeing high reliability of medical imaging research ; it requires continuous involvement by all stakeholders and use of specific quality control (QC) methods. Imaging is very costly, and many projects lack funds to reacquire images if QC issues are detected later, or this reacquisition may be impractical based on the distance between the patient and the facility, or difficulties inherent in the illness. Therefore, appropriate QC methods are imperative, as they can rapidly identify bad data and areas likely to require to post-processing correction or real-time re-acquisition. While many useful QC methods including automated or semi-automated procedures exist, they are often complex, limited in informational scope, require time consuming manual techniques, and lack documentation; they are generally designed for specific use-cases, making integration with other setups difficult. In this paper, we summarize the work done by the the Indiana University Scalable Compute Archive (IU SCA) team and the RADY Imaging Center (Indianapolis) between 2015-now on the Scalable Quality Assurance for Neuroimaging project (SQAN - pronounced “scan”) software suite. SQAN runs a comprehensive QC pipeline, comparing various facets of each scan for each subject with an appropriate template. It ensures all the scans required across each modality expected by a research study’s pre-defined protocol are present with the expected image counts; and that values match exactly, or within a percentage threshold of the template value. It safely ignores keywords expected to differ between the template and subject exam (e.g. timestamps, subject demographics). Outside of coding, our project required a significant amount of engagement and feedback cycles with researchers, scanner technologists, and data scientists, each of whom approach QC with their own unique priorities and insights. Since Fall 2017, a fully operational production SQAN service instance has supported the Indianapolis-based RADY Imaging Center (RADY-SQAN) providing QC for 50+ research projects; it has QC’ed nearly 3 million images and validated over 600 million metadata tags. A more detailed description of the QC capabilities is available in an accompanying technical description paper.
Submitted by Harmony Jankowski (hjankows@iu.edu) on 2019-07-31T14:33:44Z
No. of bitstreams: 0
Approved for entry into archive by Winona Snapp-Childs (wsnappch@iu.edu) on 2019-07-31T17:08:46Z (GMT) No. of bitstreams: 0
Made available in DSpace on 2019-07-31T17:08:46Z (GMT). No. of bitstreams: 0
Previous issue date: 2019
en
https://creativecommons.org/licenses/by/4.0/
Scalable Quality Assurance for Neuroimaging (SQAN): Quality Control for Medical Imaging Project
Preprint
TEXT
2019-08 SQAN Overview FULL PAPER-2.pdf.txt
2019-08 SQAN Overview FULL PAPER-2.pdf.txt
Extracted text
text/plain
38975
https://scholarworks.iu.edu/dspace/bitstream/2022/23322/3/2019-08%20SQAN%20Overview%20FULL%20PAPER-2.pdf.txt
658089f8e7d60081394de6f6debe156d
MD5
3
LICENSE
license.txt
license.txt
text/plain
2730
https://scholarworks.iu.edu/dspace/bitstream/2022/23322/1/license.txt
8b5355396084efce0c43805344408e89
MD5
1
ORIGINAL
2019-08 SQAN Overview FULL PAPER-2.pdf
2019-08 SQAN Overview FULL PAPER-2.pdf
Pre-print
application/pdf
777642
https://scholarworks.iu.edu/dspace/bitstream/2022/23322/2/2019-08%20SQAN%20Overview%20FULL%20PAPER-2.pdf
2d9a19c850b4a127a25065bb1614f7ca
MD5
2
THUMBNAIL
2019-08 SQAN Overview FULL PAPER-2.pdf.jpg
2019-08 SQAN Overview FULL PAPER-2.pdf.jpg
IM Thumbnail
image/jpeg
4889
https://scholarworks.iu.edu/dspace/bitstream/2022/23322/4/2019-08%20SQAN%20Overview%20FULL%20PAPER-2.pdf.jpg
21d9175407d8ecee4485d53101d5ae00
MD5
4
2022/23322
oai:scholarworks.iu.edu:2022/23322
2021-10-18 12:58:50.59
IUScholarWorks
iusw@indiana.edu
T3BlbiBBY2Nlc3MgUG9saWN5CgpJZiB5b3UgYXJlIHN1Ym1pdHRpbmcgYSBzY2hvbGFybHkgYXJ0aWNsZSBwdXJzdWFudCB0byB0aGUgSW5kaWFuYSBVbml2ZXJzaXR5IEJsb29taW5ndG9uIE9wZW4gQWNjZXNzIFBvbGljeSwgeW91ciBzdWJtaXNzaW9uIGlzIGdvdmVybmVkIGJ5IHRoZSB0ZXJtcyBvZiB0aGUgbm9uLWV4Y2x1c2l2ZSBsaWNlbnNlIGdyYW50ZWQgdW5kZXIgdGhlIE9wZW4gQWNjZXNzIFBvbGljeS4gSWYgeW91IG5lZWQgYXNzaXN0YW5jZSBkZXRlcm1pbmluZyB3aGV0aGVyIHlvdXIgYXJ0aWNsZSBpcyBzdWJqZWN0IHRvIHRoZSBPcGVuIEFjY2VzcyBQb2xpY3ksIHBsZWFzZSBjb250YWN0IHRoZSBTY2hvbGFybHkgQ29tbXVuaWNhdGlvbiBEZXBhcnRtZW50LiBUbyByZWFkIHRoZSBwb2xpY3ksIHZpc2l0OiBodHRwOi8vZ28uaXUuZWR1LzIxdHguIFRvIHJlYWQgdGhlIEZBUSBvbiB0aGUgcG9saWN5LCB2aXNpdDogaHR0cHM6Ly9vcGVuc2Nob2xhcnNoaXAuaW5kaWFuYS5lZHUvcG9saWN5LWZhcS4gCgpBbGwgb3RoZXIgc3VibWlzc2lvbnMgdG8gSVVTY2hvbGFyV29ya3MgYXJlIHN1YmplY3QgdG8gdGhlIHRlcm1zIG9mIHRoZSBub24tZXhjbHVzaXZlIGxpY2Vuc2UgYmVsb3c6CgpJVVNjaG9sYXJXb3JrcyBSZXBvc2l0b3J5IExpY2Vuc2UgCgpCeSBzdWJtaXR0aW5nIHlvdXIgd29yayB0byB0aGUgSVVTY2hvbGFyV29ya3MgcmVwb3NpdG9yeSwgeW91ICh0aGUgY3JlYXRvciBvciBjb3B5cmlnaHQgb3duZXIpIGdyYW50IHRvIEluZGlhbmEgVW5pdmVyc2l0eSBhIG5vbi1leGNsdXNpdmUsIHBlcnBldHVhbCwgaXJyZXZvY2FibGUgcmlnaHQgdG8gcmVwcm9kdWNlLCByZWZvcm1hdCAoYXMgZGVmaW5lZCBiZWxvdyksIGFuZC9vciBkaXN0cmlidXRlIHlvdXIgc3VibWlzc2lvbiAoaW5jbHVkaW5nIHRoZSBhYnN0cmFjdCkgd29ybGR3aWRlIGluIHByaW50IGFuZCBlbGVjdHJvbmljIGZvcm1hdCBhbmQgaW4gYW55IG1lZGl1bSwgaW5jbHVkaW5nIGJ1dCBub3QgbGltaXRlZCB0byBhdWRpbyBvciB2aWRlby4gWW91IGFncmVlIHRoYXQgSW5kaWFuYSBVbml2ZXJzaXR5IG1heSwgd2l0aG91dCBjaGFuZ2luZyB0aGUgY29udGVudCwgcmVmb3JtYXQgdGhlIHN1Ym1pc3Npb24gdG8gYW55IG1lZGl1bSBvciBmb3JtYXQsIG5vdyBrbm93biBvciBsYXRlciBkZXZlbG9wZWQsIGZvciBwcmVzZXJ2YXRpb24gb3IgYWNjZXNzLCBhbmQgcHJvdmlkZSBiYXNpYyBtZXRhZGF0YSB0aGF0IGRlc2NyaWJlcyB0aGUgY29udGVudHMgZm9yIGRpc2NvdmVyeS4gWW91IGFsc28gYWdyZWUgdGhhdCBJbmRpYW5hIFVuaXZlcnNpdHkgbWF5IGtlZXAgbW9yZSB0aGFuIG9uZSBjb3B5IG9mIHRoaXMgc3VibWlzc2lvbiBmb3Igc2VjdXJpdHksIGJhY2stdXAgYW5kIHByZXNlcnZhdGlvbi4gWW91IHJlcHJlc2VudCB0aGF0IHRoZSBzdWJtaXNzaW9uIGlzIHlvdXIgb3JpZ2luYWwgd29yaywgYW5kIHRoYXQgeW91IGhhdmUgdGhlIHJpZ2h0IHRvIGdyYW50IHRoZSByaWdodHMgY29udGFpbmVkIGluIHRoaXMgbGljZW5zZS4gWW91IGFsc28gcmVwcmVzZW50IHRoYXQgeW91ciBzdWJtaXNzaW9uIGRvZXMgbm90LCB0byB0aGUgYmVzdCBvZiB5b3VyIGtub3dsZWRnZSwgaW5mcmluZ2UgdXBvbiBhbnlvbmUncyBjb3B5cmlnaHQuIElmIHRoZSBzdWJtaXNzaW9uIGNvbnRhaW5zIG1hdGVyaWFsIGZvciB3aGljaCB5b3UgZG8gbm90IGhvbGQgY29weXJpZ2h0LCB5b3UgcmVwcmVzZW50IHRoYXQgeW91IGhhdmUgb2J0YWluZWQgdGhlIHVucmVzdHJpY3RlZCBwZXJtaXNzaW9uIG9mIHRoZSBjb3B5cmlnaHQgb3duZXIgdG8gZ3JhbnQgSW5kaWFuYSBVbml2ZXJzaXR5IHRoZSByaWdodHMgcmVxdWlyZWQgYnkgdGhpcyBsaWNlbnNlLCBhbmQgdGhhdCBzdWNoIHRoaXJkLXBhcnR5IG93bmVkIG1hdGVyaWFsIGlzIGNsZWFybHkgaWRlbnRpZmllZCBhbmQgYWNrbm93bGVkZ2VkIHdpdGhpbiB0aGUgdGV4dCBvciBjb250ZW50IG9mIHRoZSBzdWJtaXNzaW9uLiBJZiB0aGUgc3VibWlzc2lvbiBpcyBiYXNlZCB1cG9uIHdvcmsgdGhhdCBoYXMgYmVlbiBzcG9uc29yZWQgb3Igc3VwcG9ydGVkIGJ5IGFuIGFnZW5jeSBvciBvcmdhbml6YXRpb24gb3RoZXIgdGhhbiBJbmRpYW5hIFVuaXZlcnNpdHksIHlvdSByZXByZXNlbnQgdGhhdCB5b3UgaGF2ZSBmdWxmaWxsZWQgYW55IHJpZ2h0IG9mIHJldmlldyBvciBvdGhlciBvYmxpZ2F0aW9ucyByZXF1aXJlZCBieSBzdWNoIGNvbnRyYWN0IG9yIGFncmVlbWVudC4gSW5kaWFuYSBVbml2ZXJzaXR5IHdpbGwgY2xlYXJseSBpZGVudGlmeSB5b3VyIG5hbWUgYXMgdGhlIGNyZWF0b3IgYW5kL29yIGNvcHlyaWdodCBvd25lciBvZiB0aGUgc3VibWlzc2lvbiwgYW5kIHdpbGwgbm90IG1ha2UgYW55IGFsdGVyYXRpb25zLCBvdGhlciB0aGFuIGFzIGFsbG93ZWQgYnkgdGhpcyBsaWNlbnNlLCB0byB5b3VyIHN1Ym1pc3Npb24uIFdlIGFncmVlIHRvIG5vdCBtYWtlIGF2YWlsYWJsZSBhbnkgZmlsZXMgdGhhdCBhcmUgZW1iYXJnb2VkIHVudGlsIHRoZSBlbWJhcmdvIGhhcyBleHBpcmVkLiBJZiB5b3UgYXJlIHN1Ym1pdHRpbmcgdGhpcyBpdGVtIG9uIGJlaGFsZiBvZiB0aGUgcmlnaHRzIGhvbGRlciwgeW91IG11c3QgaGF2ZSB0aGUgcmlnaHRzIG93bmVyJ3Mgd3JpdHRlbiBwZXJtaXNzaW9uIHRvIGFjY2VwdCB0aGlzIGxpY2Vuc2Ugb24gaGlzL2hlciBiZWhhbGYuIAoKcmV2LiAxMS8zLzIwMTcK
oai:scholarworks.iu.edu:2022/233212021-10-18T17:24:51Zcom_2022_12992com_2022_356com_2022_19673col_2022_13011
Young, M.D.
Avena-Koenigsberger, A.
Hayashi, S.
Gopu, A.
West, J.
Paramasivam, M.
Perigo, R.
2019-07-31T17:08:18Z
2019-07-31T17:08:18Z
2019
http://hdl.handle.net/2022/23321
10.5967/481s-nt96
In medical research a single magnetic resonance imaging (MRI) exam of a single subject can produce hundreds of thousands of individual images and millions of key-value metadata pairs which must be verified to ensure instrument performance and compliance with the research protocol. Here we describe a system to address this concern, the Scalable Quality Assurance for Neuroimaging (SQAN), an open-source suite of tools used to extract metadata and perform quality control (QC) protocol and instrumental validation on medical imaging files (e.g. DICOM). The design features several discrete components, including: systems for receiving and storing incoming live data from remote imaging centers; processes for performing quality control validation on new and archive data; an Application Programming Interface (API) for mediating secure authorized access to imaging data and QC results; and a web-based User Interface (UI) for viewing stored data, QC results, modifying QC templates and access controls, commenting on QC issues, and alerting affected researchers, and re-running QC tests as needed. This paper is the second in a series, with the first discussing the background, motivations, and broad overview of SQAN as a project. In this paper we will provide a low-level technical description of the systems, methods, and infrastructure of the SQAN application stack. In addition to a further examination of the principal SQAN components we will explore additional features, including: anonymization of electronically Protected Health Information (ePHI); secure data transfer from remote imaging centers; extraction and compression of imaging metadata; optimized mongo database structure; and the QC templates and validations, including exclusions and handling of edge-cases, which are numerous. We will also describe the lifecycle of typical medical imaging exam, from acquisition through QC acceptance.
Submitted by Harmony Jankowski (hjankows@iu.edu) on 2019-07-31T14:37:15Z
No. of bitstreams: 0
Approved for entry into archive by Winona Snapp-Childs (wsnappch@iu.edu) on 2019-07-31T17:08:18Z (GMT) No. of bitstreams: 0
Made available in DSpace on 2019-07-31T17:08:18Z (GMT). No. of bitstreams: 0
Previous issue date: 2019
en
https://creativecommons.org/licenses/by/4.0/
Scalable Quality Assurance for Neuroimaging (SQAN) - Technical design including software application stack
Preprint
ORIGINAL
2019-08 SQAN Technical Description Full Paper.pdf
2019-08 SQAN Technical Description Full Paper.pdf
Preprint
application/pdf
652604
https://scholarworks.iu.edu/dspace/bitstream/2022/23321/2/2019-08%20SQAN%20Technical%20Description%20Full%20Paper.pdf
4455a69bd5e7dc5ca79d76ea7eefc525
MD5
2
TEXT
2019-08 SQAN Technical Description Full Paper.pdf.txt
2019-08 SQAN Technical Description Full Paper.pdf.txt
Extracted text
text/plain
23531
https://scholarworks.iu.edu/dspace/bitstream/2022/23321/3/2019-08%20SQAN%20Technical%20Description%20Full%20Paper.pdf.txt
0abd701c4faf274eba23d47623e724f2
MD5
3
LICENSE
license.txt
license.txt
text/plain
2730
https://scholarworks.iu.edu/dspace/bitstream/2022/23321/1/license.txt
8b5355396084efce0c43805344408e89
MD5
1
THUMBNAIL
2019-08 SQAN Technical Description Full Paper.pdf.jpg
2019-08 SQAN Technical Description Full Paper.pdf.jpg
IM Thumbnail
image/jpeg
4820
https://scholarworks.iu.edu/dspace/bitstream/2022/23321/4/2019-08%20SQAN%20Technical%20Description%20Full%20Paper.pdf.jpg
32736fbb66ca97bc1ec5a34d9ed184c9
MD5
4
2022/23321
oai:scholarworks.iu.edu:2022/23321
2021-10-18 13:24:51.543
IUScholarWorks
iusw@indiana.edu
T3BlbiBBY2Nlc3MgUG9saWN5CgpJZiB5b3UgYXJlIHN1Ym1pdHRpbmcgYSBzY2hvbGFybHkgYXJ0aWNsZSBwdXJzdWFudCB0byB0aGUgSW5kaWFuYSBVbml2ZXJzaXR5IEJsb29taW5ndG9uIE9wZW4gQWNjZXNzIFBvbGljeSwgeW91ciBzdWJtaXNzaW9uIGlzIGdvdmVybmVkIGJ5IHRoZSB0ZXJtcyBvZiB0aGUgbm9uLWV4Y2x1c2l2ZSBsaWNlbnNlIGdyYW50ZWQgdW5kZXIgdGhlIE9wZW4gQWNjZXNzIFBvbGljeS4gSWYgeW91IG5lZWQgYXNzaXN0YW5jZSBkZXRlcm1pbmluZyB3aGV0aGVyIHlvdXIgYXJ0aWNsZSBpcyBzdWJqZWN0IHRvIHRoZSBPcGVuIEFjY2VzcyBQb2xpY3ksIHBsZWFzZSBjb250YWN0IHRoZSBTY2hvbGFybHkgQ29tbXVuaWNhdGlvbiBEZXBhcnRtZW50LiBUbyByZWFkIHRoZSBwb2xpY3ksIHZpc2l0OiBodHRwOi8vZ28uaXUuZWR1LzIxdHguIFRvIHJlYWQgdGhlIEZBUSBvbiB0aGUgcG9saWN5LCB2aXNpdDogaHR0cHM6Ly9vcGVuc2Nob2xhcnNoaXAuaW5kaWFuYS5lZHUvcG9saWN5LWZhcS4gCgpBbGwgb3RoZXIgc3VibWlzc2lvbnMgdG8gSVVTY2hvbGFyV29ya3MgYXJlIHN1YmplY3QgdG8gdGhlIHRlcm1zIG9mIHRoZSBub24tZXhjbHVzaXZlIGxpY2Vuc2UgYmVsb3c6CgpJVVNjaG9sYXJXb3JrcyBSZXBvc2l0b3J5IExpY2Vuc2UgCgpCeSBzdWJtaXR0aW5nIHlvdXIgd29yayB0byB0aGUgSVVTY2hvbGFyV29ya3MgcmVwb3NpdG9yeSwgeW91ICh0aGUgY3JlYXRvciBvciBjb3B5cmlnaHQgb3duZXIpIGdyYW50IHRvIEluZGlhbmEgVW5pdmVyc2l0eSBhIG5vbi1leGNsdXNpdmUsIHBlcnBldHVhbCwgaXJyZXZvY2FibGUgcmlnaHQgdG8gcmVwcm9kdWNlLCByZWZvcm1hdCAoYXMgZGVmaW5lZCBiZWxvdyksIGFuZC9vciBkaXN0cmlidXRlIHlvdXIgc3VibWlzc2lvbiAoaW5jbHVkaW5nIHRoZSBhYnN0cmFjdCkgd29ybGR3aWRlIGluIHByaW50IGFuZCBlbGVjdHJvbmljIGZvcm1hdCBhbmQgaW4gYW55IG1lZGl1bSwgaW5jbHVkaW5nIGJ1dCBub3QgbGltaXRlZCB0byBhdWRpbyBvciB2aWRlby4gWW91IGFncmVlIHRoYXQgSW5kaWFuYSBVbml2ZXJzaXR5IG1heSwgd2l0aG91dCBjaGFuZ2luZyB0aGUgY29udGVudCwgcmVmb3JtYXQgdGhlIHN1Ym1pc3Npb24gdG8gYW55IG1lZGl1bSBvciBmb3JtYXQsIG5vdyBrbm93biBvciBsYXRlciBkZXZlbG9wZWQsIGZvciBwcmVzZXJ2YXRpb24gb3IgYWNjZXNzLCBhbmQgcHJvdmlkZSBiYXNpYyBtZXRhZGF0YSB0aGF0IGRlc2NyaWJlcyB0aGUgY29udGVudHMgZm9yIGRpc2NvdmVyeS4gWW91IGFsc28gYWdyZWUgdGhhdCBJbmRpYW5hIFVuaXZlcnNpdHkgbWF5IGtlZXAgbW9yZSB0aGFuIG9uZSBjb3B5IG9mIHRoaXMgc3VibWlzc2lvbiBmb3Igc2VjdXJpdHksIGJhY2stdXAgYW5kIHByZXNlcnZhdGlvbi4gWW91IHJlcHJlc2VudCB0aGF0IHRoZSBzdWJtaXNzaW9uIGlzIHlvdXIgb3JpZ2luYWwgd29yaywgYW5kIHRoYXQgeW91IGhhdmUgdGhlIHJpZ2h0IHRvIGdyYW50IHRoZSByaWdodHMgY29udGFpbmVkIGluIHRoaXMgbGljZW5zZS4gWW91IGFsc28gcmVwcmVzZW50IHRoYXQgeW91ciBzdWJtaXNzaW9uIGRvZXMgbm90LCB0byB0aGUgYmVzdCBvZiB5b3VyIGtub3dsZWRnZSwgaW5mcmluZ2UgdXBvbiBhbnlvbmUncyBjb3B5cmlnaHQuIElmIHRoZSBzdWJtaXNzaW9uIGNvbnRhaW5zIG1hdGVyaWFsIGZvciB3aGljaCB5b3UgZG8gbm90IGhvbGQgY29weXJpZ2h0LCB5b3UgcmVwcmVzZW50IHRoYXQgeW91IGhhdmUgb2J0YWluZWQgdGhlIHVucmVzdHJpY3RlZCBwZXJtaXNzaW9uIG9mIHRoZSBjb3B5cmlnaHQgb3duZXIgdG8gZ3JhbnQgSW5kaWFuYSBVbml2ZXJzaXR5IHRoZSByaWdodHMgcmVxdWlyZWQgYnkgdGhpcyBsaWNlbnNlLCBhbmQgdGhhdCBzdWNoIHRoaXJkLXBhcnR5IG93bmVkIG1hdGVyaWFsIGlzIGNsZWFybHkgaWRlbnRpZmllZCBhbmQgYWNrbm93bGVkZ2VkIHdpdGhpbiB0aGUgdGV4dCBvciBjb250ZW50IG9mIHRoZSBzdWJtaXNzaW9uLiBJZiB0aGUgc3VibWlzc2lvbiBpcyBiYXNlZCB1cG9uIHdvcmsgdGhhdCBoYXMgYmVlbiBzcG9uc29yZWQgb3Igc3VwcG9ydGVkIGJ5IGFuIGFnZW5jeSBvciBvcmdhbml6YXRpb24gb3RoZXIgdGhhbiBJbmRpYW5hIFVuaXZlcnNpdHksIHlvdSByZXByZXNlbnQgdGhhdCB5b3UgaGF2ZSBmdWxmaWxsZWQgYW55IHJpZ2h0IG9mIHJldmlldyBvciBvdGhlciBvYmxpZ2F0aW9ucyByZXF1aXJlZCBieSBzdWNoIGNvbnRyYWN0IG9yIGFncmVlbWVudC4gSW5kaWFuYSBVbml2ZXJzaXR5IHdpbGwgY2xlYXJseSBpZGVudGlmeSB5b3VyIG5hbWUgYXMgdGhlIGNyZWF0b3IgYW5kL29yIGNvcHlyaWdodCBvd25lciBvZiB0aGUgc3VibWlzc2lvbiwgYW5kIHdpbGwgbm90IG1ha2UgYW55IGFsdGVyYXRpb25zLCBvdGhlciB0aGFuIGFzIGFsbG93ZWQgYnkgdGhpcyBsaWNlbnNlLCB0byB5b3VyIHN1Ym1pc3Npb24uIFdlIGFncmVlIHRvIG5vdCBtYWtlIGF2YWlsYWJsZSBhbnkgZmlsZXMgdGhhdCBhcmUgZW1iYXJnb2VkIHVudGlsIHRoZSBlbWJhcmdvIGhhcyBleHBpcmVkLiBJZiB5b3UgYXJlIHN1Ym1pdHRpbmcgdGhpcyBpdGVtIG9uIGJlaGFsZiBvZiB0aGUgcmlnaHRzIGhvbGRlciwgeW91IG11c3QgaGF2ZSB0aGUgcmlnaHRzIG93bmVyJ3Mgd3JpdHRlbiBwZXJtaXNzaW9uIHRvIGFjY2VwdCB0aGlzIGxpY2Vuc2Ugb24gaGlzL2hlciBiZWhhbGYuIAoKcmV2LiAxMS8zLzIwMTcK
oai:scholarworks.iu.edu:2022/245672021-10-19T04:15:15Zcom_2022_12992com_2022_356com_2022_19673col_2022_13011
Michael, Scott
Teige, Scott
Li, Junjie
Lowe, John Michael
Turner, George
Henschel, Robert
2019-10-17T16:33:31Z
2019-10-17T16:33:31Z
2019-10
http://hdl.handle.net/2022/24567
Preprint
As deep learning techniques and algorithms become
more and more common in scientific workflows, HPC centers are
grappling with how best to provide GPU resources and support
deep learning workloads. One novel method of deployment is to
virtualize GPU resources allowing for multiple VM instances to
have logically distinct virtual GPUs (vGPUs) on a shared physical
GPU. However, there are many operational and performance
implications to consider before deploying a vGPU service in
an HPC center. In this paper, we investigate the performance
characteristics of vGPUs for both traditional HPC workloads
and for deep learning training and inference workloads. Using
NVIDIA’s vDWS virtualization software, we perform a series
of HPC and deep learning benchmarks on both non-virtualized
(bare metal) and vGPUs of various sizes and configurations. We
report on several of the challenges we discovered in deploying
and operating a variety of virtualized instance sizes and configurations. We find that the overhead of virtualization on HPC
workloads is generally < 10%, and can vary considerably for
deep learning, depending on the task.
Submitted by Harmony Jankowski (hjankows@iu.edu) on 2019-10-17T16:31:43Z
No. of bitstreams: 1
Virtualized_GPU_Benchmarks_for_Deep_Learning.pdf: 165620 bytes, checksum: 8a030e4e25a8881c1ad0092d917881c8 (MD5)
Approved for entry into archive by Winona Snapp-Childs (wsnappch@iu.edu) on 2019-10-17T16:33:31Z (GMT) No. of bitstreams: 1
Virtualized_GPU_Benchmarks_for_Deep_Learning.pdf: 165620 bytes, checksum: 8a030e4e25a8881c1ad0092d917881c8 (MD5)
Made available in DSpace on 2019-10-17T16:33:31Z (GMT). No. of bitstreams: 1
Virtualized_GPU_Benchmarks_for_Deep_Learning.pdf: 165620 bytes, checksum: 8a030e4e25a8881c1ad0092d917881c8 (MD5)
Previous issue date: 2019-10
en
https://creativecommons.org/licenses/by/4.0/
Deep Learning
High Performance Computing
Virtualization
Performance Characteristics of Virtualized GPUs for Deep Learning
Preprint
ORIGINAL
Virtualized_GPU_Benchmarks_for_Deep_Learning.pdf
Virtualized_GPU_Benchmarks_for_Deep_Learning.pdf
Article preprint
application/pdf
165620
https://scholarworks.iu.edu/dspace/bitstream/2022/24567/1/Virtualized_GPU_Benchmarks_for_Deep_Learning.pdf
8a030e4e25a8881c1ad0092d917881c8
MD5
1
LICENSE
license.txt
license.txt
text/plain
2730
https://scholarworks.iu.edu/dspace/bitstream/2022/24567/2/license.txt
8b5355396084efce0c43805344408e89
MD5
2
TEXT
Virtualized_GPU_Benchmarks_for_Deep_Learning.pdf.txt
Virtualized_GPU_Benchmarks_for_Deep_Learning.pdf.txt
Extracted text
text/plain
38413
https://scholarworks.iu.edu/dspace/bitstream/2022/24567/3/Virtualized_GPU_Benchmarks_for_Deep_Learning.pdf.txt
7195da9c7982323cae7d0ff662111943
MD5
3
THUMBNAIL
Virtualized_GPU_Benchmarks_for_Deep_Learning.pdf.jpg
Virtualized_GPU_Benchmarks_for_Deep_Learning.pdf.jpg
IM Thumbnail
image/jpeg
1854
https://scholarworks.iu.edu/dspace/bitstream/2022/24567/4/Virtualized_GPU_Benchmarks_for_Deep_Learning.pdf.jpg
1e45e73b1412aca5390da39ff72f458e
MD5
4
2022/24567
oai:scholarworks.iu.edu:2022/24567
2021-10-19 00:15:15.425
IUScholarWorks
iusw@indiana.edu
T3BlbiBBY2Nlc3MgUG9saWN5CgpJZiB5b3UgYXJlIHN1Ym1pdHRpbmcgYSBzY2hvbGFybHkgYXJ0aWNsZSBwdXJzdWFudCB0byB0aGUgSW5kaWFuYSBVbml2ZXJzaXR5IEJsb29taW5ndG9uIE9wZW4gQWNjZXNzIFBvbGljeSwgeW91ciBzdWJtaXNzaW9uIGlzIGdvdmVybmVkIGJ5IHRoZSB0ZXJtcyBvZiB0aGUgbm9uLWV4Y2x1c2l2ZSBsaWNlbnNlIGdyYW50ZWQgdW5kZXIgdGhlIE9wZW4gQWNjZXNzIFBvbGljeS4gSWYgeW91IG5lZWQgYXNzaXN0YW5jZSBkZXRlcm1pbmluZyB3aGV0aGVyIHlvdXIgYXJ0aWNsZSBpcyBzdWJqZWN0IHRvIHRoZSBPcGVuIEFjY2VzcyBQb2xpY3ksIHBsZWFzZSBjb250YWN0IHRoZSBTY2hvbGFybHkgQ29tbXVuaWNhdGlvbiBEZXBhcnRtZW50LiBUbyByZWFkIHRoZSBwb2xpY3ksIHZpc2l0OiBodHRwOi8vZ28uaXUuZWR1LzIxdHguIFRvIHJlYWQgdGhlIEZBUSBvbiB0aGUgcG9saWN5LCB2aXNpdDogaHR0cHM6Ly9vcGVuc2Nob2xhcnNoaXAuaW5kaWFuYS5lZHUvcG9saWN5LWZhcS4gCgpBbGwgb3RoZXIgc3VibWlzc2lvbnMgdG8gSVVTY2hvbGFyV29ya3MgYXJlIHN1YmplY3QgdG8gdGhlIHRlcm1zIG9mIHRoZSBub24tZXhjbHVzaXZlIGxpY2Vuc2UgYmVsb3c6CgpJVVNjaG9sYXJXb3JrcyBSZXBvc2l0b3J5IExpY2Vuc2UgCgpCeSBzdWJtaXR0aW5nIHlvdXIgd29yayB0byB0aGUgSVVTY2hvbGFyV29ya3MgcmVwb3NpdG9yeSwgeW91ICh0aGUgY3JlYXRvciBvciBjb3B5cmlnaHQgb3duZXIpIGdyYW50IHRvIEluZGlhbmEgVW5pdmVyc2l0eSBhIG5vbi1leGNsdXNpdmUsIHBlcnBldHVhbCwgaXJyZXZvY2FibGUgcmlnaHQgdG8gcmVwcm9kdWNlLCByZWZvcm1hdCAoYXMgZGVmaW5lZCBiZWxvdyksIGFuZC9vciBkaXN0cmlidXRlIHlvdXIgc3VibWlzc2lvbiAoaW5jbHVkaW5nIHRoZSBhYnN0cmFjdCkgd29ybGR3aWRlIGluIHByaW50IGFuZCBlbGVjdHJvbmljIGZvcm1hdCBhbmQgaW4gYW55IG1lZGl1bSwgaW5jbHVkaW5nIGJ1dCBub3QgbGltaXRlZCB0byBhdWRpbyBvciB2aWRlby4gWW91IGFncmVlIHRoYXQgSW5kaWFuYSBVbml2ZXJzaXR5IG1heSwgd2l0aG91dCBjaGFuZ2luZyB0aGUgY29udGVudCwgcmVmb3JtYXQgdGhlIHN1Ym1pc3Npb24gdG8gYW55IG1lZGl1bSBvciBmb3JtYXQsIG5vdyBrbm93biBvciBsYXRlciBkZXZlbG9wZWQsIGZvciBwcmVzZXJ2YXRpb24gb3IgYWNjZXNzLCBhbmQgcHJvdmlkZSBiYXNpYyBtZXRhZGF0YSB0aGF0IGRlc2NyaWJlcyB0aGUgY29udGVudHMgZm9yIGRpc2NvdmVyeS4gWW91IGFsc28gYWdyZWUgdGhhdCBJbmRpYW5hIFVuaXZlcnNpdHkgbWF5IGtlZXAgbW9yZSB0aGFuIG9uZSBjb3B5IG9mIHRoaXMgc3VibWlzc2lvbiBmb3Igc2VjdXJpdHksIGJhY2stdXAgYW5kIHByZXNlcnZhdGlvbi4gWW91IHJlcHJlc2VudCB0aGF0IHRoZSBzdWJtaXNzaW9uIGlzIHlvdXIgb3JpZ2luYWwgd29yaywgYW5kIHRoYXQgeW91IGhhdmUgdGhlIHJpZ2h0IHRvIGdyYW50IHRoZSByaWdodHMgY29udGFpbmVkIGluIHRoaXMgbGljZW5zZS4gWW91IGFsc28gcmVwcmVzZW50IHRoYXQgeW91ciBzdWJtaXNzaW9uIGRvZXMgbm90LCB0byB0aGUgYmVzdCBvZiB5b3VyIGtub3dsZWRnZSwgaW5mcmluZ2UgdXBvbiBhbnlvbmUncyBjb3B5cmlnaHQuIElmIHRoZSBzdWJtaXNzaW9uIGNvbnRhaW5zIG1hdGVyaWFsIGZvciB3aGljaCB5b3UgZG8gbm90IGhvbGQgY29weXJpZ2h0LCB5b3UgcmVwcmVzZW50IHRoYXQgeW91IGhhdmUgb2J0YWluZWQgdGhlIHVucmVzdHJpY3RlZCBwZXJtaXNzaW9uIG9mIHRoZSBjb3B5cmlnaHQgb3duZXIgdG8gZ3JhbnQgSW5kaWFuYSBVbml2ZXJzaXR5IHRoZSByaWdodHMgcmVxdWlyZWQgYnkgdGhpcyBsaWNlbnNlLCBhbmQgdGhhdCBzdWNoIHRoaXJkLXBhcnR5IG93bmVkIG1hdGVyaWFsIGlzIGNsZWFybHkgaWRlbnRpZmllZCBhbmQgYWNrbm93bGVkZ2VkIHdpdGhpbiB0aGUgdGV4dCBvciBjb250ZW50IG9mIHRoZSBzdWJtaXNzaW9uLiBJZiB0aGUgc3VibWlzc2lvbiBpcyBiYXNlZCB1cG9uIHdvcmsgdGhhdCBoYXMgYmVlbiBzcG9uc29yZWQgb3Igc3VwcG9ydGVkIGJ5IGFuIGFnZW5jeSBvciBvcmdhbml6YXRpb24gb3RoZXIgdGhhbiBJbmRpYW5hIFVuaXZlcnNpdHksIHlvdSByZXByZXNlbnQgdGhhdCB5b3UgaGF2ZSBmdWxmaWxsZWQgYW55IHJpZ2h0IG9mIHJldmlldyBvciBvdGhlciBvYmxpZ2F0aW9ucyByZXF1aXJlZCBieSBzdWNoIGNvbnRyYWN0IG9yIGFncmVlbWVudC4gSW5kaWFuYSBVbml2ZXJzaXR5IHdpbGwgY2xlYXJseSBpZGVudGlmeSB5b3VyIG5hbWUgYXMgdGhlIGNyZWF0b3IgYW5kL29yIGNvcHlyaWdodCBvd25lciBvZiB0aGUgc3VibWlzc2lvbiwgYW5kIHdpbGwgbm90IG1ha2UgYW55IGFsdGVyYXRpb25zLCBvdGhlciB0aGFuIGFzIGFsbG93ZWQgYnkgdGhpcyBsaWNlbnNlLCB0byB5b3VyIHN1Ym1pc3Npb24uIFdlIGFncmVlIHRvIG5vdCBtYWtlIGF2YWlsYWJsZSBhbnkgZmlsZXMgdGhhdCBhcmUgZW1iYXJnb2VkIHVudGlsIHRoZSBlbWJhcmdvIGhhcyBleHBpcmVkLiBJZiB5b3UgYXJlIHN1Ym1pdHRpbmcgdGhpcyBpdGVtIG9uIGJlaGFsZiBvZiB0aGUgcmlnaHRzIGhvbGRlciwgeW91IG11c3QgaGF2ZSB0aGUgcmlnaHRzIG93bmVyJ3Mgd3JpdHRlbiBwZXJtaXNzaW9uIHRvIGFjY2VwdCB0aGlzIGxpY2Vuc2Ugb24gaGlzL2hlciBiZWhhbGYuIAoKcmV2LiAxMS8zLzIwMTcK