Publication archive

Publications

Peer-reviewed work spanning AI accelerators, memory systems, hardware reliability, and hardware/software codesign.

Publications

Composition of Experts on the SN40L Reconfigurable Dataflow Unit

IEEE Micro (preprint) doi:10.1109/MM.2024.3428548

Raghu Prabhakar, Ram Sivaramakrishnan, Darshan Gandhi, Yun Du, Mingran Wang, Xiangyu Song, Kejie Zhang, Tianren Gao, Angela Wang, Karen Li, Joshua Brot, Calvin Leung, Tuowen Zhao, Mark Gottscho, Edison Chen, Kaizhao Liang, Swayambhoo Jain, Urmish Thakker, Kevin J. Brown, and Kunle Olukotun. Composition of Experts on the SN40L Reconfigurable Dataflow Unit. IEEE Micro preprint. August 2024.

PDF
BiBTeX
@article{RPrabhakarMicro2024,
        author = {Prabhakar, Raghu and Sivaramakrishnan, Ram and Gandhi, Darshan, and Du, Yun and Wang, Mingran and Song, Xiangyu and Zhang, Kejie and Gao, Tianren and Wang, Angela and Li, Karen and Brot, Joshua and Leung, Calvin and Zhao, Tuowen and Gottscho, Mark and Chen, Edison and Liang, Kaizhao and Jain, Swayambhoo and Thakker, Urmish and Brown, Kevin J. and Olukotun, Kunle},
        doi = {10.1109/MM.2024.3428548},
        title = {{Composition of Experts on the SN40L Reconfigurable Dataflow Unit}},
        year = {2024},
    }

SambaNova SN40L: Scaling the AI Memory Wall with Dataflow and Composition of Experts

Raghu Prabhakar, Ram Sivaramakrishnan, Darshan Gandhi, Yun Du, Mingran Wang, Xiangyu Song, Kejie Zhang, Tianren Gao, Angela Wang, Karen Li, Yongning Sheng, Joshua Brot, Denis Sokolov, Apurv Vivek, Calvin Leung, Arjun Sabnis, Jiayu Bai, Tuowen Zhao, Mark Gottscho, David Jackson, Mark Luttrell, Manish K. Shah, Edison Chen, Kaizhao Liang, Swayambhoo Jain, Urmish Thakker, Dawei Huang, Sumti Jairath, Kevin J. Brown, and Kunle Olukotun. SambaNova SN40L: Scaling the AI Memory Wall with Dataflow and Composition of Experts. Arxiv preprint. May 2024.

PDF
BiBTeX
@article{RPrabhakarArxiv2024,
        author = {Prabhakar, Raghu and Sivaramakrishnan, Ram and Gandhi, Darshan, and Du, Yun and Wang, Mingran and Song, Xiangyu and Zhang, Kejie and Gao, Tianren and Wang, Angela and Li, Karen and Sheng, Yongning and Brot, Joshua and Sokolov, Denis and Vivek, Apurv and Leung, Calvin and Sabnis, Arjun and Bai, Jiayu and Zhao, Tuowen and Gottscho, Mark and Jackson, David and Luttrell and Shah, Manish K. and Chen, Edison and Liang, Kaizhao and Jain, Swayambhoo and Thakker, Urmish and Huang, Dawei and Jairath, Sumti and Brown, Kevin J. and Olukotun, Kunle},
        doi = {10.48550/arXiv.2405.07518},
        title = {{SambaNova SN40L: Scaling the AI Memory Wall with Dataflow and Composition of Experts}},
        year = {2024},
    }

Ten Lessons from Three Generations Shaped Google's TPUv4i: Industrial Product

Norman P. Jouppi, Doe Hyun Yoon, Matthew Ashcraft, Mark Gottscho, Thomas B. Jablin, George Kurian, James Laudon, Sheng Li, Peter Ma, Xiaoyu Ma, Thomas Norrie, Nishant Patil, Sushma Prasad, Cliff Young, Zongwei Zhou, and David Patterson. Ten Lessons from Three Generations Shaped Google's TPUv4i: Industrial Product. In ACM/IEEE International Symposium on Computer Architecture (ISCA), in Valencia, Spain (virtual/online). June 2021.

PDF
BiBTeX
@article{NJouppiISCA2021,
    author = {Jouppi, Normal P. and Yoon, Doe Hyun and Ashcraft, Matthew and Gottscho, Mark and Jablin, Thomas B. and Kurian, George and Laudon, James and Li, Sheng and Ma, Peter and Ma, Xiaoyu and Norrie, Thomas and Patil, Nishant and Prasad, Sushma and Young, Cliff and Zhou, Zongwei and Patterson, David},
    doi = {10.1109/ISCA52012.2021.00010},
    inproceedings = {ACM/IEEE International Symposium on Computer Architecture (ISCA)},
    title = {{Ten Lessons from Three Generations Shaped Google's TPUv4i: Industrial Product}},
    year = {2021},
}

Context-Aware Resiliency: Unequal Message Protection for Random-Access Memories

Clayton Schoeny, Frederic Sala, Mark Gottscho, Irina Alam, Puneet Gupta, and Lara Dolecek. Context-Aware Resiliency: Unequal Message Protection for Random-Access Memories. In IEEE Transactions on Information Theory, Vol. 65, issue 10, pp. 6146-6159. May 2019.

PDF
BiBTeX
@article{SchoenyTransIT2019,
    author = {Schoeny, Clayton and Sala, Frederic and Gottscho, Mark and Alam, Irina and Gupta, Puneet and Dolecek, Lara},
    title = {{Context-Aware Resiliency: Unequal Message Protection for Random-Access Memories}},
    year = {2019},
    booktitle = {IEEE Transactions on Information Theory},
    volume = {65},
    issue = {10},
    pages = {6146-6159},
    year = {2019},
    doi = {10.1109/TIT.2019.2918209}
}

Error Correction and Detection for Computing Memories Using System Side Information

Clayton Schoeny, Irina Alam, Mark Gottscho, Puneet Gupta, and Lara Dolecek. Error Correction and Detection for Computing Memories Using System Side Information. In IEEE Information Theory Workshop (ITW), in Guangzhou, China. November 2018.

PDF
BiBTeX
@article{CSchoenyITW2018,
    author = {Schoeny, Clayton and Alam, Irina and Gottscho, Mark and Gupta, Puneet and Dolecek, Lara},
    doi = {10.1109/ITW.2018.8613473},
    inproceedings = {IEEE Information Theory Workshop (ITW)},
    title = {{Error Correction and Detection for Computing Memories Using System Side Information}},
    year = {2018},
}

Software-Defined ECC: Heuristic Recovery from Uncorrectable Memory Errors

UCLA Tech. Rep.

Mark Gottscho, Clayton Schoeny, Lara Dolecek, and Puneet Gupta. Software-Defined ECC: Heuristic Recovery from Uncorrectable Memory Errors. UCLA Technical Report, published online October 2017.

PDF
BiBTeX
@article{GottschoUCLATR2017,
    author = {Gottscho, Mark and Schoeny, Clayton and Dolecek, Lara and Gupta, Puneet},
    title = {{Software-Defined ECC: Hueristic Recovery from Uncorrectable Memory Errors}},
    year = {2017},
}

Low-Cost Memory Fault Tolerance for IoT Devices

Mark Gottscho, Irina Alam, Clayton Schoeny, Lara Dolecek, and Puneet Gupta. Low-Cost Memory Fault Tolerance for IoT Devices. In ACM Transactions on Embedded Computing Systems (TECS), online July 2017. TECS ESWEEK Special Issue, appeared at the ACM/IEEE International Conference on Compilers, Architecture, and System Synthesis (CASES) in Seoul, South Korea, October 2017.

Best Paper Award

PDF
BiBTeX
@article{GottschoESWEEK2017,
    address = {Seoul, South Korea},
    author = {Gottscho, Mark and Alam, Irina and Schoeny, Clayton and Dolecek, Lara and Gupta, Puneet},
    booktitle = {ACM Transactions on Embedded Computing Systems (TECS) ESWEEK Special Issue},
    title = {{Low-Cost Memory Fault Tolerance for IoT Devices}},
    year = {2017},
    volume = {16},
    number = {5s},
    doi = {10.1145/3126534},
}

Measuring the Impact of Memory Errors on Application Performance

Mark Gottscho, Mohammed Shoaib, Sriram Govindan, Bikash Sharma, Di Wang, and Puneet Gupta. Measuring the Impact of Memory Errors on Application Performance. In IEEE Computer Architecture Letters (CAL), Vol. 16, No. 1, pp. 51-55, online August 2016, print 2017.

Best Paper Award

PDF
BiBTeX
@article{GottschoCAL2016,
    author = {Gottscho, Mark and Shoaib, Mohammed and Govindan, Sriram and Sharma, Bikash and Wang, Di and Gupta, Puneet},
    doi = {10.1109/LCA.2016.2599513},
    journal = {IEEE Computer Architecture Letters (CAL)},
    title = {{Measuring the Impact of Memory Errors on Application Performance}},
    year = {2016},
    volume = {16},
    number = {1},
    pages = {51--55},
}

Software-Defined Error-Correcting Codes

Mark Gottscho, Clayton Schoeny, Lara Dolecek and Puneet Gupta. Software-Defined Error-Correcting Codes. In Proceedings of the IEEE/IFIP International Conference on Dependable Systems and Networks Workshops (DSN-W), pp. 276-282, Best of SELSE Special Session. Toulouse, France, June 2016.

Best Paper Award (SELSE)

PDF
BiBTeX
@inproceedings{GottschoDSNW2016,
    address = {Toulouse, France},
    author = {Gottscho, Mark and Schoeny, Clayton and Dolecek, Lara and Gupta, Puneet},
    booktitle = {IEEE/IFIP International Conference on Dependable Systems and Networks Workshops (DSN-W)},
    doi = {10.1109/DSN-W.2016.67},
    title = {{Software-Defined Error-Correcting Codes}},
    year = {2016},
    pages = {276--282}
}

X-Mem: A Cross-Platform and Extensible Memory Characterization Tool for the Cloud

Mark Gottscho, Sriram Govindan, Mohammed Shoaib, Bikash Sharma, and Puneet Gupta. X-Mem: A Cross-Platform and Extensible Memory Characterization Tool for the Cloud. In Proceedings of the IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS), pp. 263-273, April 2016.

Best Paper Award (SELSE)

PDF
BiBTeX
@article{GottschoISPASS016,
    author = {Gottscho, Mark and Govindan, Sriram and Shoaib, Mohammed and Sharma, Bikash and Gupta, Puneet},
    doi = {10.1109/ISPASS.2016.7482101},
    journal = {IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS)},
    title = {{X-Mem: A Cross-Platform and Extensible Memory Characterization Tool for the Cloud}},
    year = {2016},
    pages = {263--273}
}

Multi-Story Power Distribution Networks for GPUs

DATE

Qixiang Zhang, Liangzhen Lai, Mark Gottscho, and Puneet Gupta. Multi-Story Power Distribution Networks for GPUs. In IEEE Design, Automation, and Test in Europe, pp. 451-456. Dresden, Germany, March 2016.

PDF
BiBTeX
@inproceedings{ZhangDATE2016,
    address = {Dresden, Germany},
    author = {Zhang, Qixiang and Lai, Liangzhen and Gottscho, Mark and Gupta, Puneet},
    booktitle = {IEEE Design, Automation, and Test in Europe (DATE)},
    title = {{Multi-Story Power Distribution Networks for GPUs}},
    year = {2016},
    pages = {451--256}
}

DPCS: Dynamic Power/Capacity Scaling for SRAM Caches in the Nanoscale Era

Mark Gottscho, Abbas BanaiyanMofrad, Nikil Dutt, Alex Nicolau, and Puneet Gupta. DPCS: Dynamic Power/Capacity Scaling for SRAM Caches in the Nanoscale Era. In ACM Transactions on Architecture and Code Optimization (TACO), Vol. 12, No. 3, Article 27. Online August 2015, in print October 2015.

PDF
BiBTeX
@article{GottschoTACO2015,
    author = {Gottscho, Mark and BanaiyanMofrad, Abbas and Dutt, Nikil and Nicolau, Alex and Gupta, Puneet},
    doi = {10.1145/2792982},
    journal = {ACM Transactions on Architecture and Code Optimization (TACO)},
    title = {{DPCS: Dynamic Power/Capacity Scaling for SRAM Caches in the Nanoscale Era}},
    year = {2015},
    volume = {12},
    number = {3}
}

NSF Expedition on Variability-Aware Software: Recent Results and Contributions

Lucas Wanner, Liangzhen Lai, Abbas Rahimi, Mark Gottscho, Pietro Mercati, Chu-Hsiang Huang, Frederic Sala, Yuvraj Agarwal, Lara Dolecek, Nikil Dutt, Puneet Gupta, Rajesh Gupta, Ranjit Jhala, Rakesh Kumar, Sorin Lerner, Subhashish Mitra, Alexandru Nicolau, Tajana Simunic Rosing, Mani B. Srivastava, Steve Swanson, Dennis Sylvester, and Yuanyuan Zhou. NSF Expedition on Variability-Aware Software: Recent Results and Contributions. In De Gruyter Information Technology (it), Vol. 57, No. 3. Invited paper. June 2015.

PDF
BiBTeX
@article{Wannerit2015,
    author = {Wanner, Lucas and Lai, Liangzhen and Rahimi, Abbas and Gottscho, Mark and Mercati, Pietro and Huang, Chu-Hsiang and Sala, Frederic and Agarwal, Yuvraj and Dolecek, Lara and Dutt, Nikil and Gupta, Puneet and Gupta, Rajesh and Jhala, Ranjit and Kumar, Rakesh and Lerner, Sorin and Mitra, Subhasish and Nicolau, Alexandru and {Simunic Rosing}, Tajana and Srivastava, Mani B. and Swanson, Steve and Sylvester, Dennis and Zhou, Yuanyuan},
    year = {2016},
    pages = {451--256}
    journal = {De Gruyter it - Information Technology},
    number = {3},
    title = {{NSF Expedition on Variability-Aware Software: Recent Results and Contributions}},
    volume = {57},
    year = {2015},
    doi = {10.1515/itit-2014-1085}
}

A Case for Battery Charging-Aware Power Management and Deferrable Task Scheduling

HotPower

Salma Elmalaki, Mark Gottscho, Puneet Gupta, and Mani Srivastava. A Case for Battery Charging-Aware Power Management and Deferrable Task Scheduling. In USENIX Workshop on Power-Aware Computing and Systems (HotPower), 6 pages. Bloomfield, Colorado, October 2014.

PDF
BiBTeX
@inproceedings{ElmalakiHotPower2014,
    author = {Elmalaki, Salma and Gottscho, Mark and Srivastava, Mani B. and Gupta, Puneet},
    booktitle = {USENIX Workshop on Power-Aware Computing and Systems (HotPower)},
    title = {{A Case for Battery Charging-Aware Power Management and Deferrable Task Scheduling}},
    year = {2014}
}

Power / Capacity Scaling: Energy Savings With Simple Fault-Tolerant Caches

Mark Gottscho, Abbas BanaiyanMofrad, Nikil Dutt, Alex Nicolau, and Puneet Gupta. Power / Capacity Scaling: Energy Savings With Simple Fault-Tolerant Caches. In Proceedings of the ACM/IEEE Design Automation Conference (DAC), San Francisco, California. June 2014.

PDF
BiBTeX
@inproceedings{GottschoDAC2014,
author = {Gottscho, Mark and BanaiyanMofrad, Abbas and Dutt, Nikil and Nicolau, Alex and Gupta, Puneet},
booktitle = {Proceedings of the ACM/IEEE Design Automation Conference (DAC)},
doi = {10.1145/2593069.2593184},
title = {{Power / Capacity Scaling: Energy Savings With Simple Fault-Tolerant Caches}},
year = {2014}
}

Multi-Layer Memory Resiliency

Nikil Dutt, Alex Nicolau, Puneet Gupta, Mark Gottscho, and Majid Shoushtari. Multi-Layer Memory Resiliency. In Proceedings of the ACM/IEEE Design Automation Conference (DAC), San Francisco, California. June 2014.

Invited paper

PDF
BiBTeX
@inproceedings{DuttDAC2014,
author = {Dutt, Nikil and Nicolau, Alex and Gupta, Puneet and Gottscho, Mark and Shoushtari, Majid},
booktitle = {Proceedings of the ACM/IEEE Design Automation Conference (DAC)},
doi = {10.1145/2593069.2596684},
title = {{Multi-Layer Memory Resiliency}},
year = {2014}
}

ViPZonE: Hardware Power Variability-Aware Virtual Memory Management for Energy Savings

Mark Gottscho, Luis A.D. Bathen, Nikil Dutt, Alex Nicolau, and Puneet Gupta. ViPZonE: Hardware Power Variability-Aware Virtual Memory Management for Energy Savings. In IEEE Transactions on Computers, Vol. 64, Issue 5, pp. 1483-1496. Published online June 2014, print May 2015.

PDF
BiBTeX
@article{GottschoTC2015,
author = {Gottscho, Mark and Bathen, Luis A. D. and Dutt, Nikil and Nicolau, Alex and Gupta, Puneet},
journal = {IEEE Transactions on Computers (TC)},
doi = {10.1109/TC.2014.2329675},
title = {{ViPZonE: Hardware Power Variability-Aware Virtual Memory Management for Energy Savings}},
year = {2015}
}

Variability-Aware Memory Management for Nanoscale Computing

Nikil Dutt, Puneet Gupta, Alex Nicolau, Luis A. D. Bathen, and Mark Gottscho. Variability-Aware Memory Management for Nanoscale Computing. In Proceedings of the ACM/IEEE Asia and South Pacific Design Automation Conference (ASP-DAC), pp. 125-132. Yokohama, Japan, January 2013.

Invited paper

PDF
BiBTeX
@inproceedings{DuttASPDAC2013,
author = {Dutt, Nikil and Gupta, Puneet and Nicolau, Alex and Bathen, Luis A. D. and Gottscho, Mark},
booktitle = {Proceedings of the ACM/IEEE Asia and South Pacific Design Automation Conference (ASP-DAC)},
doi = {10.1109/ASPDAC.2013.6509584},
title = {{Variability-Aware Memory Management for Nanoscale Computing}},
year = {2013}
}

ViPZonE: OS-Level Memory Variability-Driven Physical Address Zoning for Energy Savings

Luis A.D. Bathen, Mark Gottscho, Nikil Dutt, Alex Nicolau, and Puneet Gupta. ViPZonE: OS-Level Memory Variability-Driven Physical Address Zoning for Energy Savings. In Proceedings of the ACM International Conference on Hardware/Software Codesign and System Synthesis (CODES+ISSS), pp. 33-42. Tampere, Finland, October 2012.

PDF
BiBTeX
@inproceedings{BathenESWEEK2012,
author = {Bathen, Luis A. D. and Gottscho, Mark and Dutt, Nikil and Nicolau, Alex and Gupta, Puneet},
booktitle = {Proceedings of the ACM International Conference on Hardware/Software Codesign and System Synthesis (CODES+ISSS)},
doi = {10.1145/2380445.2380457},
title = {{ViPZonE: OS-Level Memory Variability-Driven Physical Address Zoning for Energy Savings}},
year = {2012}
}

Power Variability in Contemporary DRAMs

Mark Gottscho, Abde Ali Kagalwalla, and Puneet Gupta. Power Variability in Contemporary DRAMs. In IEEE Embedded Systems Letters (ESL), Vol. 4, No. 2. June 2012.

PDF
BiBTeX
@article{GottschoESL2012,
author = {Gottscho, Mark and Kagalwalla, Abde Ali and Gupta, Puneet},
journal = {IEEE Embedded Systems Letters (ESL)},
doi = {10.1109/LES.2012.2192414},
title = {{Power Variability in Contemporary DRAMs}},
year = {2012}
}